-- Logs begin at Tue 2022-05-03 08:12:24 UTC, end at Tue 2022-05-03 09:44:11 UTC. -- May 03 08:44:33.373481 dv-cinder-840276-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 03 08:44:33.386015 dv-cinder-840276-2-iscsi devstack@n-api.service[109010]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 03 08:44:33.386015 dv-cinder-840276-2-iscsi devstack@n-api.service[109010]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 3 08:44:33 2022] *** May 03 08:44:33.386015 dv-cinder-840276-2-iscsi devstack@n-api.service[109010]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 03 08:44:33.386015 dv-cinder-840276-2-iscsi devstack@n-api.service[109010]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 03 08:44:33.386015 dv-cinder-840276-2-iscsi devstack@n-api.service[109010]: nodename: dv-cinder-840276-2-iscsi May 03 08:44:33.386015 dv-cinder-840276-2-iscsi devstack@n-api.service[109010]: machine: x86_64 May 03 08:44:33.386015 dv-cinder-840276-2-iscsi devstack@n-api.service[109010]: clock source: unix May 03 08:44:33.386015 dv-cinder-840276-2-iscsi devstack@n-api.service[109010]: pcre jit disabled May 03 08:44:33.386015 dv-cinder-840276-2-iscsi devstack@n-api.service[109010]: detected number of CPU cores: 4 May 03 08:44:33.386015 dv-cinder-840276-2-iscsi devstack@n-api.service[109010]: current working directory: / May 03 08:44:33.386015 dv-cinder-840276-2-iscsi devstack@n-api.service[109010]: detected binary path: /usr/bin/uwsgi-core May 03 08:44:33.387208 dv-cinder-840276-2-iscsi devstack@n-api.service[109010]: your processes number limit is 47680 May 03 08:44:33.387208 dv-cinder-840276-2-iscsi devstack@n-api.service[109010]: your memory page size is 4096 bytes May 03 08:44:33.387208 dv-cinder-840276-2-iscsi devstack@n-api.service[109010]: detected max file descriptor number: 2048 May 03 08:44:33.387208 dv-cinder-840276-2-iscsi devstack@n-api.service[109010]: lock engine: pthread robust mutexes May 03 08:44:33.387208 dv-cinder-840276-2-iscsi devstack@n-api.service[109010]: thunder lock: enabled May 03 08:44:33.387208 dv-cinder-840276-2-iscsi devstack@n-api.service[109010]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 03 08:44:33.387208 dv-cinder-840276-2-iscsi devstack@n-api.service[109010]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 03 08:44:33.431755 dv-cinder-840276-2-iscsi devstack@n-api.service[109010]: Python main interpreter initialized at 0x5572491769c0 May 03 08:44:33.431755 dv-cinder-840276-2-iscsi devstack@n-api.service[109010]: python threads support enabled May 03 08:44:33.431755 dv-cinder-840276-2-iscsi devstack@n-api.service[109010]: your server socket listen backlog is limited to 100 connections May 03 08:44:33.431755 dv-cinder-840276-2-iscsi devstack@n-api.service[109010]: your mercy for graceful operations on workers is 90 seconds May 03 08:44:33.432133 dv-cinder-840276-2-iscsi devstack@n-api.service[109010]: mapped 403077 bytes (393 KB) for 2 cores May 03 08:44:33.432201 dv-cinder-840276-2-iscsi devstack@n-api.service[109010]: *** Operational MODE: preforking *** May 03 08:44:33.432504 dv-cinder-840276-2-iscsi devstack@n-api.service[109010]: *** uWSGI is running in multiple interpreter mode *** May 03 08:44:33.432504 dv-cinder-840276-2-iscsi devstack@n-api.service[109010]: spawned uWSGI master process (pid: 109010) May 03 08:44:33.432698 dv-cinder-840276-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 03 08:44:33.433194 dv-cinder-840276-2-iscsi devstack@n-api.service[109010]: spawned uWSGI worker 1 (pid: 109011, cores: 1) May 03 08:44:33.433543 dv-cinder-840276-2-iscsi devstack@n-api.service[109010]: spawned uWSGI worker 2 (pid: 109012, cores: 1) May 03 08:44:33.433699 dv-cinder-840276-2-iscsi devstack@n-api.service[109010]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 03 08:44:34.605419 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 03 08:44:34.636657 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 03 08:44:35.319372 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 03 08:44:35.319372 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: from cryptography.utils import int_from_bytes May 03 08:44:35.319643 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 03 08:44:35.319643 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: from cryptography.utils import int_from_bytes May 03 08:44:35.358345 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 03 08:44:35.358345 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: from cryptography.utils import int_from_bytes May 03 08:44:35.358664 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 03 08:44:35.358664 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: from cryptography.utils import int_from_bytes May 03 08:44:37.873135 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 03 08:44:37.873756 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 03 08:44:37.873756 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 03 08:44:37.874182 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 03 08:44:37.874268 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 03 08:44:37.874342 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 03 08:44:37.874413 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 03 08:44:37.874508 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 03 08:44:37.874592 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 03 08:44:37.874665 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 03 08:44:37.874834 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.874928 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.875174 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.875315 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.875465 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.875570 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.875780 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.875894 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.876149 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.876294 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.876434 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.876536 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.876771 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.876912 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.877055 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.877167 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.877402 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.877544 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.877644 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.877724 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.877948 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.878090 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.878270 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-840276-2-iscsi {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.878410 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-840276-2-iscsi {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.878560 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.878714 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.878886 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.878983 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.879193 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.879293 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.879505 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.879614 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.879822 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.879910 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.880138 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.880234 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.880440 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.880541 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.880929 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.881037 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.882098 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.882206 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.882293 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.882367 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.882448 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.882521 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.882625 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.882704 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.882781 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.882855 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.882926 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.882997 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.883160 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.883249 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.883448 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.883547 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.883842 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.883942 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.884086 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.884185 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.884476 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-840276-2-iscsi {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.884575 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-840276-2-iscsi {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.884804 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.885046 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.885046 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.885482 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.885712 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.885920 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.886138 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.886350 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.886572 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.886758 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.886968 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.887113 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.887290 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.887438 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.887612 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.887793 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.887959 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.888103 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.888248 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.888418 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.888563 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.888724 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.888870 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.889014 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.889155 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.889297 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.889445 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.889587 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.889769 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.889916 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.890058 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.890201 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.890347 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.890489 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.890630 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.890764 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.890904 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.891040 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.891186 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.891335 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.891540 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.891703 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.891878 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.892032 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.892177 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.892355 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.892527 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.892678 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.892840 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.893133 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.893284 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.893421 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.893580 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.893724 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.893868 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.894005 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.894147 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.894289 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.894529 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.894667 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.894811 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.894946 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.895081 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.895222 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.895374 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.895526 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.895661 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.895814 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.895963 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.896105 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.896248 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.896390 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.896531 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.896679 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.896821 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.896962 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.897104 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.897259 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.897414 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.897550 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.897696 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.897840 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.897981 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.11 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.898127 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.11 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.898262 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.11 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.898397 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.11 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.898530 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.898664 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.898803 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.898959 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.899101 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.899247 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.899389 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.899529 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.899679 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.899848 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.899988 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.900124 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.900257 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.900398 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.900545 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.900680 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.900834 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.900977 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.901121 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.901256 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.901401 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.901561 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.901765 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.901914 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.902064 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.902201 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.902344 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.902479 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.902623 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.902784 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.902939 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.903167 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.903317 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.903453 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.903587 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.903723 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.903878 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.904024 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.904159 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.904300 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.904435 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.904570 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.904716 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.904859 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.904994 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.905128 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.905269 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.905403 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.905536 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.905684 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.905827 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.905969 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.906110 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.906245 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.906385 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.906544 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.906687 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.906830 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.906965 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.907110 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.907258 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.907399 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.907534 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.907670 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.907857 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.907998 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.908144 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.908292 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.908436 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.908580 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.908721 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.908856 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.908989 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.909131 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.909267 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.909400 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.909541 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.909682 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.909824 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.909971 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.910127 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.910264 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.910398 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.910539 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.910686 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.910827 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.910963 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.911097 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.911231 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.911364 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.911506 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.911641 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.911817 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.911977 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.912121 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.912267 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.912412 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.912546 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.912691 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.912836 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.912984 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.913135 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.913353 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.913492 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.913633 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.913768 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.913922 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.914067 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.914209 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.914344 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.914485 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.914625 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.914760 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.914906 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.915043 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.915178 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.915312 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.915449 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.915583 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.915735 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.915926 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.916071 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.916206 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.916340 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.916474 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.916617 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:44:37.916753 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.916894 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.917028 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.917175 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.917325 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.917470 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.917604 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.917745 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.917879 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.918017 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.918228 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.918366 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.918500 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.918633 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.918776 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.918920 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.919077 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.919223 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.919359 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.919493 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.919628 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.919792 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.919932 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.920079 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.920213 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.920348 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.920480 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.920625 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.920760 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.920917 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.921072 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.921208 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.921345 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.921492 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.921628 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.921762 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.921896 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.922036 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.922173 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.922320 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.922456 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.922590 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.922734 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.922881 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.923016 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.923158 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.923303 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.923521 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.923663 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.923830 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.923972 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.924124 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.924260 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.924401 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.924537 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.924686 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.924830 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.924966 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.925109 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.925244 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.925385 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.925520 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.925749 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.925897 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.926034 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.926169 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.926303 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.926445 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.926600 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.926745 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.926886 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.927021 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.927155 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.927298 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.927442 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.927581 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.927715 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.927877 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.928012 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.928158 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.928294 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.928446 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.928590 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.928727 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.928861 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.929003 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.929138 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.929273 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.929407 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.929548 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.929691 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.929835 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.929970 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.930110 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.930261 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.930406 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.930541 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.930684 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.930820 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.930953 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.931094 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.931235 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.931371 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.931518 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.931661 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.931843 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.931985 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.932140 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.932287 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.932424 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.932568 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.932704 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.932838 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.933010 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.933165 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.933339 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.933480 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.933705 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.933853 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.934009 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.934158 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.934294 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.934443 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.934579 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.934714 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.934856 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.934999 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.935136 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.935270 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.935411 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.935546 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.935689 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.935877 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.936025 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.936162 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.936334 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.936487 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.936631 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.936775 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.936947 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.937088 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.937280 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.937427 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.937572 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.937715 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.937868 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.938004 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.938147 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.938284 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.938432 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.938568 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.938729 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.938870 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.939043 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.939267 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.939406 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.939542 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.939699 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.939875 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.940021 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.940169 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.940317 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.940454 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.940620 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.940760 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.940921 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.941069 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.941267 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.941411 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.941582 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.941732 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.941867 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.942011 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.942177 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.942333 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.942470 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.942608 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.942750 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.942886 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.943049 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.943191 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.943334 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.943469 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.943626 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.943900 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.944043 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.944178 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.944313 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.944448 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.944594 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.944731 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.944865 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.944999 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.945134 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.945267 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.945410 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.945558 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.945696 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.945830 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.945963 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.946106 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.946241 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.946382 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.946569 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.946723 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.946860 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.947001 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.947187 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.947341 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.947519 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.947662 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.947854 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.948014 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.948157 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.948304 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.948468 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.948609 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.948776 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.948930 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.949067 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.949200 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.949374 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.949522 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.949666 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.949807 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.949971 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.950111 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.950279 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.950420 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.950590 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.950730 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.950898 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.951037 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.951203 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.951360 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.951504 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.951638 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.951836 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.951978 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.952144 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.952297 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.952446 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.952589 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.952744 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.952884 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.953053 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.953191 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.953389 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.953532 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.953698 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.953854 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.954066 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.954214 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.954351 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.954485 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.954618 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.954754 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.954888 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.955032 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.955168 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.955318 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.955475 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.955624 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.955792 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.955945 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.956104 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.956244 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.956411 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.956551 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.956716 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.956923 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.957105 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.957341 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.957501 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.957652 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.957802 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.957977 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.958122 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.958256 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.958390 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.958602 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.958802 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.958941 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.959075 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.959210 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.959363 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.959499 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.959643 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.959806 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.959957 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.960118 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.960269 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.960413 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.960555 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.960731 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.960871 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.961042 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.961183 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.961352 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.961488 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.961622 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.961755 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.961923 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.962065 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.962221 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.962364 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.962511 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.962655 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.962822 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.962984 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.963138 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.963298 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.963441 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.963582 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.963724 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.963926 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.964096 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.964307 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.964454 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.964597 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.964738 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.964891 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.964891 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.965167 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.965319 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.965461 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.965615 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.965770 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.965912 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.966051 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.966191 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.966331 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.966472 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.966619 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.966761 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.966901 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.967040 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.967190 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.967331 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.967550 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.967696 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.967862 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.968004 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.968144 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.968284 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.968437 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.968587 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.968731 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.968872 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.969031 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.969187 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.969336 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.969489 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.969631 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.969771 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.969912 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.970065 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.970207 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.970347 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.970487 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.970627 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.970770 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.970931 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.971085 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.971227 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.971381 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.971523 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.971663 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.971871 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.972019 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.972159 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.972299 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.972461 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.972621 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.972765 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.972937 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.973080 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.973221 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.973375 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.973528 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.973670 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.973811 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.973951 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.974118 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.974267 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.974504 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.974651 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.974792 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.974945 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.975087 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.975087 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.975371 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.975514 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.975660 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.976003 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.976159 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.976314 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.976462 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.976603 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.976744 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.976895 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.977039 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.977193 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.977337 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.977486 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.977629 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.977810 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.977971 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.978122 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.978273 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.978421 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.978562 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.978710 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.978872 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.979014 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.979162 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.979321 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.979463 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.979603 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.979754 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.979955 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.980097 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.980249 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.980717 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.980869 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.981010 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.981164 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.981305 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.981454 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.981597 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.981737 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.981878 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.982025 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.982166 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.982315 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.982457 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.982604 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.982779 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.982938 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.983109 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.983252 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.983392 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.983533 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.983680 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.983856 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.984016 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.984158 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.984299 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.984440 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.984663 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.984810 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.984971 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.985116 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.985257 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.985407 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.985561 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.985703 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.985853 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.985995 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.986172 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.986316 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.986459 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.986608 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.986750 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.986902 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.987043 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.987197 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.987347 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.987498 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.987640 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.987826 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.987974 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.988199 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.988383 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.988542 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.988685 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.988845 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.988988 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.989128 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.989283 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.989426 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.989568 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.989708 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.989849 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.989996 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.990147 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.990295 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.990438 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.990580 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.990730 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.990872 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.991086 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.991230 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.991378 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.991521 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.991663 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.991837 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.991993 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.992136 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.992276 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.992416 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.992557 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.992710 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.992860 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.993009 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.993152 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.993292 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.993440 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.993590 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.993733 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.993873 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.994013 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.994161 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.994309 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.994464 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.994616 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.994858 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.995005 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.995155 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.995296 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.995446 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.995587 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.995728 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.995897 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.996039 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.996179 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.996331 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.996473 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.996624 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.996774 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.996917 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.997066 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.997209 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.997349 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.997489 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.997629 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.997770 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.997920 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.998112 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.998258 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.998399 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.998553 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.998694 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.998844 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.998987 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.999127 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.999267 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.999407 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.999549 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.999698 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:37.999890 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.000033 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.000174 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.000337 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.000487 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.000629 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.000769 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.000909 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.001048 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.001189 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.001340 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.001481 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.001621 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.001761 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.001908 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.002049 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.002218 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.002361 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.002502 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.002642 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.002781 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.002926 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.003085 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.003228 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.003368 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.003518 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.003659 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.003879 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.004032 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.004189 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.004331 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.004479 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.004621 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.004770 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.005028 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.005170 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.005311 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.005451 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.005592 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.005740 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.005882 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.006022 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.006174 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.006317 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.006457 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.006606 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.006747 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.006887 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.007027 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.007174 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.007322 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.007464 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.007604 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.007744 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.007915 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.008066 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.008219 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.008360 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.008501 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.008639 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.008778 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.008928 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.009083 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.009232 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.009375 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.009516 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.009657 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.009814 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.009971 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.010119 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.010261 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.010401 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.010541 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.010689 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.010831 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.010978 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.011127 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.011268 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.011409 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.011558 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.011709 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.011878 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.012030 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.012171 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.012312 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.012473 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.012616 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.012756 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.012904 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.013054 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.013195 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.013344 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.013485 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.013636 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.013788 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.013930 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.014078 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.014228 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.014377 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.014517 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.014657 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.014797 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.014968 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.015178 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.015323 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.015465 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.015614 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.015755 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.015962 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.016114 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.016256 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.016396 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.016536 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.016683 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.016835 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.016976 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.017116 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.017257 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.017416 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.017566 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.017708 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.017856 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.018006 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.018147 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.018287 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.018504 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.018664 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.018806 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.018946 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.019086 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.019226 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.019415 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.019559 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.019708 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.019887 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.020038 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.020180 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.020328 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.020328 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.020597 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.020738 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.020878 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.021021 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.021170 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.021170 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.021448 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.021448 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.021715 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.021864 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.022016 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.022016 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.022285 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.022433 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.022574 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.022727 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.022875 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.023039 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.023182 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.023330 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.023471 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.023619 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.023818 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.023968 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.024108 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.024249 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.024401 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.024543 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.024691 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.024833 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.024985 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.025222 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.025389 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.025539 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.025688 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.025830 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.025970 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.026110 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.026260 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.026410 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.026559 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.026707 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.026879 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.027041 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.027191 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.027334 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.027486 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.027628 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.027801 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.027951 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.028092 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.028232 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.028459 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.028603 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.028752 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.028893 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.029045 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.029187 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.029336 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.029478 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.029619 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.029759 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.029899 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.030053 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.030196 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.030344 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.030487 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.030660 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.030822 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.030974 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.031116 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.031286 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.031441 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.031583 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.031730 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.031970 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.032121 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.032262 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.032410 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.032552 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.032701 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.032853 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.033000 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.033156 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.033298 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.033438 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.033588 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.033729 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.033869 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.034009 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.034150 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.034290 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.034443 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.034585 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.034736 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.034877 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.035075 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.035232 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.035466 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.035614 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.035757 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.035933 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.036076 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.036225 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.036376 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.036518 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.036666 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.036820 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.036961 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.037109 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.037252 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.037408 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.037591 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.037746 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.037890 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.038039 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.038195 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.038337 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.038478 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.038635 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.038776 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.038927 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.039077 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.039219 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.039374 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.039515 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.039663 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.039853 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.040002 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.040143 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.040284 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.040424 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.040587 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.040730 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.040871 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.041013 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.041153 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.041293 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.041443 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.041615 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.041763 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.041929 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.042077 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.042220 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.042371 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.042524 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.042665 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.042806 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.042947 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.043110 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.043260 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.043402 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.043542 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.043685 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.043853 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.044010 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.044161 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.044313 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.044463 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.044614 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.044756 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.044905 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.045056 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.045198 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.045347 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.045568 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.045728 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.045879 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.046021 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.046171 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.046327 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.046468 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.046628 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.046777 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.046919 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.047071 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.047215 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.047362 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.047513 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.047662 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.047849 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.047995 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.048147 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.048302 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.048452 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.048593 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.048734 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.048882 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.049036 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.049185 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.049337 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.049478 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.049618 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.049765 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.049914 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.050064 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.050216 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.050367 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.050509 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.050676 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.050816 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.050974 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.051116 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.051264 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.051417 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.051558 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.051705 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.051885 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.052038 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.052180 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.052323 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.052465 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.052613 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.052762 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.052912 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.053062 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.053201 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.053341 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.053482 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.053773 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.053920 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.054098 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.054254 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.054398 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.054547 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.054697 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.054847 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.054997 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.055139 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.055302 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.055464 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.055687 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.055886 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.056045 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.056200 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.056343 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.056558 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.056711 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.056853 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.057009 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.057187 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.057306 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.057403 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.057486 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.057572 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.057797 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.057943 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.058067 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.058151 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.058408 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.058552 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.058728 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.058874 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.059043 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.059186 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.059329 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.059504 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.059708 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.059901 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.059995 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.060107 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.060302 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.060450 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.060600 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.060749 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.060913 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.061059 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.061207 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.061348 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.061507 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.061650 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.061814 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.061961 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.062131 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.062278 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.062428 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.062570 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.062739 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.062886 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.063041 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.063191 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.063355 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.063498 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.063638 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.063829 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.063979 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.064132 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.064276 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.064417 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.064599 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.064747 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.064908 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.065067 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.065225 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.065420 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.065830 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.065980 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.066142 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.066345 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.066489 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.066630 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.066770 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.066920 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.067070 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.067212 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.067352 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.067492 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.067646 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.067808 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.067968 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.068109 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.068259 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.068408 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.068550 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.068691 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.068840 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.068983 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.069124 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.069280 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.069434 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.069585 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.069727 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.069868 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.070011 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.070151 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.070321 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.070481 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.070624 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.070763 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.070911 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.071146 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.071294 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.071490 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.071739 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.071907 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.072118 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.072276 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.072421 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.072571 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.072754 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.072910 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.073053 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.073193 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.073370 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.073519 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.073673 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.073822 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.073971 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.074114 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.074280 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.074430 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.074574 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.074715 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.074856 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.074998 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.075147 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.075290 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.075447 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.075593 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.075736 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.075945 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.076102 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.076245 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.076393 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.076535 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.076685 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.076836 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.076978 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.077119 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.077260 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.077415 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.077556 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.077707 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.077849 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.077990 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.078131 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.078271 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.078412 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.078562 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.078706 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.078860 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.079001 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.079149 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.079300 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.079451 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.079605 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.079750 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.079913 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.080054 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.080207 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.080350 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.080498 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.080648 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.080791 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.080932 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.081081 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.081233 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.081374 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.081515 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.081694 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.081862 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.082039 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.082186 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.082327 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.082467 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.082629 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.082804 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.082960 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.083104 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.083256 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.083398 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.083539 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.083692 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.083871 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.084017 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.084157 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.084298 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.084488 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.084716 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.084861 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.085004 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.085165 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.085306 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.085448 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.085610 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.085926 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.086072 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.086255 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.086411 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.086552 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.086700 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.086877 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.087022 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.087163 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.087321 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.087472 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.087622 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.087793 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.087941 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.088082 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.088224 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.088375 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.088526 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.088668 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.088808 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.088972 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.089122 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.089287 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.089431 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.089572 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.089714 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.089855 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.090005 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.090157 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.090299 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.090440 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.090588 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.090730 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.090879 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.091032 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.091176 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.091318 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.091459 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.091607 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.091785 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.091949 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.092092 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.092233 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.092376 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.092579 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.092735 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.092888 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.093029 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.093202 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.093349 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.093499 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.093641 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.093790 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.093940 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.094081 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.094222 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.094373 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.094525 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.094689 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.094855 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.094997 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.095138 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.095295 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.095439 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.095607 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.095792 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.095942 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.096100 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.096250 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.096393 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.096635 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.096796 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.096939 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.097088 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.097231 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.097372 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.097595 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.097744 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.097917 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.098073 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.098216 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.098357 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.098534 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.098692 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.098842 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.098985 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.099153 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.099298 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.099463 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.099609 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.099818 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.099971 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.100123 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.100265 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.100415 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.100564 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.100725 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.100875 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.101025 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.101167 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.101317 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.101467 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.101610 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.101752 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.101893 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.102033 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.102174 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.102324 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.102483 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.102634 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.102777 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.102917 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.103058 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.103208 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.103350 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.103491 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.103632 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.103795 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.103943 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.104096 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.104239 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.104392 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.104542 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.104685 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.104834 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.104977 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.105119 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.105259 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.105717 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.105860 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.106019 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.106162 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.106311 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.106453 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.106609 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.106751 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.106900 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.107043 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.107184 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.107324 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.107465 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.107607 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.107757 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.107964 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.108107 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.108258 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.108401 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.108565 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.108709 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.108851 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.108993 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.109134 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.109277 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.109428 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.109570 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.109711 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.109852 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.109993 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.110135 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.110294 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.110444 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.110586 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.110727 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.110868 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.111008 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.111161 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.111305 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.111446 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.111588 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.111729 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.111918 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.112063 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.112215 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.112357 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.112508 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.112657 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.112877 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.113030 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.113205 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.113349 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.113489 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.113630 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.113780 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.113922 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.114072 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.114225 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.114367 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.114520 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.114671 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.114814 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.114955 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.115105 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.115247 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.115402 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.115545 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.115685 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.115879 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.116038 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.116182 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.116336 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.116480 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.116621 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.116762 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.116934 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.117094 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.117237 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.117378 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.117541 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.117695 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.117856 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.118008 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.118150 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.118290 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.118438 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.118581 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.118744 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.118905 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.119049 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.119189 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.119368 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.119515 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.119692 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.119890 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.120035 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.120175 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.120352 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.120499 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.120700 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.120848 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.121011 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.121157 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.121306 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.121448 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.121597 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.121751 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.121892 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 03 08:44:38.122042 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.122259 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.122564 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:44:38.122804 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 03 08:44:38.144284 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG oslo_db.sqlalchemy.engines [None req-a45a32db-fe06-4d3d-89b3-c32887b97abc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109011) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 03 08:44:38.145424 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG oslo_db.sqlalchemy.engines [None req-56d3657d-11df-4c9e-9b68-9ac45c61fe3c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109012) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 03 08:44:38.206612 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.context [None req-a45a32db-fe06-4d3d-89b3-c32887b97abc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),704ac130-5e75-4d30-aa38-214e2e8ddc38(cell1) {{(pid=109011) load_cells /opt/stack/nova/nova/context.py:464}} May 03 08:44:38.206839 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.context [None req-56d3657d-11df-4c9e-9b68-9ac45c61fe3c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),704ac130-5e75-4d30-aa38-214e2e8ddc38(cell1) {{(pid=109012) load_cells /opt/stack/nova/nova/context.py:464}} May 03 08:44:38.211042 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG oslo_concurrency.lockutils [None req-56d3657d-11df-4c9e-9b68-9ac45c61fe3c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:44:38.211193 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG oslo_concurrency.lockutils [None req-a45a32db-fe06-4d3d-89b3-c32887b97abc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:44:38.212659 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG oslo_concurrency.lockutils [None req-56d3657d-11df-4c9e-9b68-9ac45c61fe3c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:44:38.212795 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG oslo_concurrency.lockutils [None req-a45a32db-fe06-4d3d-89b3-c32887b97abc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:44:38.213456 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG oslo_concurrency.lockutils [None req-56d3657d-11df-4c9e-9b68-9ac45c61fe3c None None] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:44:38.213591 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG oslo_concurrency.lockutils [None req-a45a32db-fe06-4d3d-89b3-c32887b97abc None None] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:44:38.215388 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG oslo_concurrency.lockutils [None req-56d3657d-11df-4c9e-9b68-9ac45c61fe3c None None] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:44:38.215536 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG oslo_concurrency.lockutils [None req-a45a32db-fe06-4d3d-89b3-c32887b97abc None None] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:44:38.225894 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG oslo_db.sqlalchemy.engines [None req-56d3657d-11df-4c9e-9b68-9ac45c61fe3c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109012) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 03 08:44:38.229258 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG oslo_db.sqlalchemy.engines [None req-a45a32db-fe06-4d3d-89b3-c32887b97abc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109011) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 03 08:44:38.231945 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG oslo_db.sqlalchemy.engines [None req-a45a32db-fe06-4d3d-89b3-c32887b97abc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109011) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 03 08:44:38.235107 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG oslo_db.sqlalchemy.engines [None req-56d3657d-11df-4c9e-9b68-9ac45c61fe3c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109012) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 03 08:44:38.392560 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG oslo_db.sqlalchemy.engines [None req-a45a32db-fe06-4d3d-89b3-c32887b97abc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109011) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 03 08:44:38.395812 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG oslo_db.sqlalchemy.engines [None req-56d3657d-11df-4c9e-9b68-9ac45c61fe3c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109012) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 03 08:44:38.728276 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: WARNING keystonemiddleware.auth_token [None req-a45a32db-fe06-4d3d-89b3-c32887b97abc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 03 08:44:38.729321 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: WARNING keystonemiddleware.auth_token [None req-56d3657d-11df-4c9e-9b68-9ac45c61fe3c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 03 08:44:38.734931 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: WARNING keystonemiddleware.auth_token [None req-a45a32db-fe06-4d3d-89b3-c32887b97abc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 03 08:44:38.736309 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: WARNING keystonemiddleware.auth_token [None req-56d3657d-11df-4c9e-9b68-9ac45c61fe3c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 03 08:44:39.071942 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: WARNING keystonemiddleware.auth_token [None req-a45a32db-fe06-4d3d-89b3-c32887b97abc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 03 08:44:39.074872 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: WARNING keystonemiddleware.auth_token [None req-56d3657d-11df-4c9e-9b68-9ac45c61fe3c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 03 08:44:39.077021 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: WARNING keystonemiddleware.auth_token [None req-a45a32db-fe06-4d3d-89b3-c32887b97abc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 03 08:44:39.080215 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: WARNING keystonemiddleware.auth_token [None req-56d3657d-11df-4c9e-9b68-9ac45c61fe3c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 03 08:44:39.082353 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5572491769c0 pid: 109011 (default app) May 03 08:44:39.084431 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi [None req-a45a32db-fe06-4d3d-89b3-c32887b97abc None None] Calling method '>' {{(pid=109011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:44:39.085337 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5572491769c0 pid: 109012 (default app) May 03 08:44:39.085582 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: INFO nova.api.openstack.requestlog [None req-a45a32db-fe06-4d3d-89b3-c32887b97abc None None] 10.222.0.11 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001721 May 03 08:44:39.085987 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: [pid: 109011|app: 0|req: 1/1] 10.222.0.11 () {50 vars in 788 bytes} [Tue May 3 08:44:39 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:45:56.336499 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi [None req-56d3657d-11df-4c9e-9b68-9ac45c61fe3c None None] Calling method '>' {{(pid=109012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:45:56.337714 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: INFO nova.api.openstack.requestlog [None req-56d3657d-11df-4c9e-9b68-9ac45c61fe3c None None] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002000 May 03 08:45:56.338108 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: [pid: 109012|app: 0|req: 1/2] 10.222.0.11 () {54 vars in 930 bytes} [Tue May 3 08:45:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:45:56.750566 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi [None req-068304c1-bee7-4ac3-904a-3410af27d3a7 admin admin] Calling method '>' {{(pid=109011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:45:56.780352 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: INFO nova.api.openstack.requestlog [None req-068304c1-bee7-4ac3-904a-3410af27d3a7 admin admin] 10.222.0.11 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.436342 May 03 08:45:56.781117 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: [pid: 109011|app: 0|req: 2/3] 10.222.0.11 () {60 vars in 1291 bytes} [Tue May 3 08:45:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 08:45:59.047572 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi [None req-56d3657d-11df-4c9e-9b68-9ac45c61fe3c None None] Calling method '>' {{(pid=109012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:45:59.048614 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: INFO nova.api.openstack.requestlog [None req-56d3657d-11df-4c9e-9b68-9ac45c61fe3c None None] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 May 03 08:45:59.049208 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: [pid: 109012|app: 0|req: 2/4] 10.222.0.11 () {54 vars in 930 bytes} [Tue May 3 08:45:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:45:59.110760 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi [None req-9edd34ac-2bd5-43e2-8c6d-a3c7fede10bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "id": "c1", "disk": 1, "os-flavor-access:is_public": true, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=109011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:45:59.129399 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 08:45:59.129399 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: warnings.warn(msg) May 03 08:45:59.161130 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: INFO nova.api.openstack.requestlog [None req-9edd34ac-2bd5-43e2-8c6d-a3c7fede10bc admin admin] 10.222.0.11 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.105637 May 03 08:45:59.162362 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: [pid: 109011|app: 0|req: 3/5] 10.222.0.11 () {64 vars in 1282 bytes} [Tue May 3 08:45:59 2022] POST /compute/v2.1/flavors => generated 407 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 03 08:45:59.382243 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi [None req-79180888-94eb-4ec9-8b48-c6af08ca2898 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:45:59.385283 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 08:45:59.385283 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: warnings.warn(msg) May 03 08:45:59.433247 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: INFO nova.api.openstack.requestlog [None req-79180888-94eb-4ec9-8b48-c6af08ca2898 admin admin] 10.222.0.11 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.262416 May 03 08:45:59.434053 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: [pid: 109012|app: 0|req: 3/6] 10.222.0.11 () {64 vars in 1335 bytes} [Tue May 3 08:45:59 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 08:46:01.696938 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi [None req-9edd34ac-2bd5-43e2-8c6d-a3c7fede10bc admin admin] Calling method '>' {{(pid=109011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:46:01.698563 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: INFO nova.api.openstack.requestlog [None req-9edd34ac-2bd5-43e2-8c6d-a3c7fede10bc admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002100 May 03 08:46:01.699382 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: [pid: 109011|app: 0|req: 4/7] 10.222.0.11 () {54 vars in 930 bytes} [Tue May 3 08:46:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:46:01.803805 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi [None req-f76ee824-c07c-4714-bcb1-1c3867dba10e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "id": "d1", "os-flavor-access:is_public": true, "disk": 5, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=109012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:46:01.821580 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 08:46:01.821580 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: warnings.warn(msg) May 03 08:46:01.841758 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: INFO nova.api.openstack.requestlog [None req-f76ee824-c07c-4714-bcb1-1c3867dba10e admin admin] 10.222.0.11 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.135760 May 03 08:46:01.842326 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: [pid: 109012|app: 0|req: 4/8] 10.222.0.11 () {64 vars in 1282 bytes} [Tue May 3 08:46:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:46:01.854821 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi [None req-f12381ed-3379-443c-8b0c-7d1690f9a8c1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:46:01.856346 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 08:46:01.856346 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: warnings.warn(msg) May 03 08:46:01.887521 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: INFO nova.api.openstack.requestlog [None req-f12381ed-3379-443c-8b0c-7d1690f9a8c1 admin admin] 10.222.0.11 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037130 May 03 08:46:01.888231 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: [pid: 109011|app: 0|req: 5/9] 10.222.0.11 () {64 vars in 1335 bytes} [Tue May 3 08:46:01 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:46:04.156038 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi [None req-f76ee824-c07c-4714-bcb1-1c3867dba10e admin admin] Calling method '>' {{(pid=109012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:46:04.157283 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: INFO nova.api.openstack.requestlog [None req-f76ee824-c07c-4714-bcb1-1c3867dba10e admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001723 May 03 08:46:04.157793 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: [pid: 109012|app: 0|req: 5/10] 10.222.0.11 () {54 vars in 930 bytes} [Tue May 3 08:46:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:46:04.220898 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi [None req-cccb6c8a-4111-4ca2-84dd-4ce696288604 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 1024, "id": "d2", "vcpus": 1, "disk": 10}} {{(pid=109011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:46:04.240562 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: INFO nova.api.openstack.requestlog [None req-cccb6c8a-4111-4ca2-84dd-4ce696288604 admin admin] 10.222.0.11 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076892 May 03 08:46:04.241112 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: [pid: 109011|app: 0|req: 6/11] 10.222.0.11 () {64 vars in 1282 bytes} [Tue May 3 08:46:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:46:04.253341 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi [None req-9848969d-1757-4e74-94a3-e283b8524420 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:46:04.285347 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: INFO nova.api.openstack.requestlog [None req-9848969d-1757-4e74-94a3-e283b8524420 admin admin] 10.222.0.11 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036090 May 03 08:46:04.295797 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: [pid: 109012|app: 0|req: 6/12] 10.222.0.11 () {64 vars in 1335 bytes} [Tue May 3 08:46:04 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 08:46:06.557261 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi [None req-cccb6c8a-4111-4ca2-84dd-4ce696288604 admin admin] Calling method '>' {{(pid=109011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:46:06.558283 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: INFO nova.api.openstack.requestlog [None req-cccb6c8a-4111-4ca2-84dd-4ce696288604 admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 May 03 08:46:06.558878 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: [pid: 109011|app: 0|req: 7/13] 10.222.0.11 () {54 vars in 930 bytes} [Tue May 3 08:46:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:46:06.619725 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi [None req-f8318f2a-b711-4528-a01b-af15a51e1af1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048, "vcpus": 2, "id": "d3"}} {{(pid=109012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:46:06.639356 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: INFO nova.api.openstack.requestlog [None req-f8318f2a-b711-4528-a01b-af15a51e1af1 admin admin] 10.222.0.11 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074340 May 03 08:46:06.640138 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: [pid: 109012|app: 0|req: 7/14] 10.222.0.11 () {64 vars in 1282 bytes} [Tue May 3 08:46:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:46:06.651699 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi [None req-35b9c89f-08e3-4bf4-93e2-7814d563f088 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:46:06.676740 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: INFO nova.api.openstack.requestlog [None req-35b9c89f-08e3-4bf4-93e2-7814d563f088 admin admin] 10.222.0.11 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028715 May 03 08:46:06.677730 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: [pid: 109011|app: 0|req: 8/15] 10.222.0.11 () {64 vars in 1335 bytes} [Tue May 3 08:46:06 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:46:08.935458 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi [None req-f8318f2a-b711-4528-a01b-af15a51e1af1 admin admin] Calling method '>' {{(pid=109012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:46:08.936704 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: INFO nova.api.openstack.requestlog [None req-f8318f2a-b711-4528-a01b-af15a51e1af1 admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001786 May 03 08:46:08.939857 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: [pid: 109012|app: 0|req: 8/16] 10.222.0.11 () {54 vars in 930 bytes} [Tue May 3 08:46:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:46:08.996232 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi [None req-023c39d7-a925-457e-952d-d02a9aeb5b41 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "vcpus": 4, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 4096, "name": "ds4G", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=109011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:46:09.015288 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: INFO nova.api.openstack.requestlog [None req-023c39d7-a925-457e-952d-d02a9aeb5b41 admin admin] 10.222.0.11 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071912 May 03 08:46:09.015983 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: [pid: 109011|app: 0|req: 9/17] 10.222.0.11 () {64 vars in 1282 bytes} [Tue May 3 08:46:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:46:09.027924 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi [None req-6a4db7df-c3a6-4591-af87-d4c24810e725 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:46:09.054329 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: INFO nova.api.openstack.requestlog [None req-6a4db7df-c3a6-4591-af87-d4c24810e725 admin admin] 10.222.0.11 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030162 May 03 08:46:09.072823 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: [pid: 109012|app: 0|req: 9/18] 10.222.0.11 () {64 vars in 1335 bytes} [Tue May 3 08:46:09 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:46:11.311456 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi [None req-023c39d7-a925-457e-952d-d02a9aeb5b41 admin admin] Calling method '>' {{(pid=109011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:46:11.313418 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: INFO nova.api.openstack.requestlog [None req-023c39d7-a925-457e-952d-d02a9aeb5b41 admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002328 May 03 08:46:11.313864 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: [pid: 109011|app: 0|req: 10/19] 10.222.0.11 () {54 vars in 930 bytes} [Tue May 3 08:46:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:46:11.377766 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi [None req-01fd7862-5184-4dce-8c9f-84a340f15c70 admin admin] Calling method '>' {{(pid=109012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:46:11.402382 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: INFO nova.api.openstack.requestlog [None req-01fd7862-5184-4dce-8c9f-84a340f15c70 admin admin] 10.222.0.11 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.081290 May 03 08:46:11.402935 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: [pid: 109012|app: 0|req: 10/20] 10.222.0.11 () {60 vars in 1291 bytes} [Tue May 3 08:46:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:46:13.688839 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi [None req-023c39d7-a925-457e-952d-d02a9aeb5b41 admin admin] Calling method '>' {{(pid=109011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:46:13.689854 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: INFO nova.api.openstack.requestlog [None req-023c39d7-a925-457e-952d-d02a9aeb5b41 admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 May 03 08:46:13.690229 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: [pid: 109011|app: 0|req: 11/21] 10.222.0.11 () {54 vars in 930 bytes} [Tue May 3 08:46:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:46:13.756733 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi [None req-654f35ad-06fc-4125-8fe2-db30495e844d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.tiny", "swap": 0, "rxtx_factor": 1.0, "ram": 512, "disk": 1, "id": "1"}} {{(pid=109012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:46:13.775688 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: INFO nova.api.openstack.requestlog [None req-654f35ad-06fc-4125-8fe2-db30495e844d admin admin] 10.222.0.11 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.078334 May 03 08:46:13.776381 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: [pid: 109012|app: 0|req: 11/22] 10.222.0.11 () {64 vars in 1282 bytes} [Tue May 3 08:46:13 2022] POST /compute/v2.1/flavors => generated 402 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:46:13.789700 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi [None req-84331c46-8c73-420b-894f-9879097c0a78 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:46:13.817433 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: INFO nova.api.openstack.requestlog [None req-84331c46-8c73-420b-894f-9879097c0a78 admin admin] 10.222.0.11 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032654 May 03 08:46:13.818204 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: [pid: 109011|app: 0|req: 12/23] 10.222.0.11 () {64 vars in 1332 bytes} [Tue May 3 08:46:13 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 08:46:16.181031 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi [None req-654f35ad-06fc-4125-8fe2-db30495e844d admin admin] Calling method '>' {{(pid=109012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:46:16.182057 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: INFO nova.api.openstack.requestlog [None req-654f35ad-06fc-4125-8fe2-db30495e844d admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 May 03 08:46:16.182454 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: [pid: 109012|app: 0|req: 12/24] 10.222.0.11 () {54 vars in 930 bytes} [Tue May 3 08:46:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 08:46:16.250185 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi [None req-7c0acd09-8eac-4ed5-a290-d6e6151a9b42 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "os-flavor-access:is_public": true, "ram": 2048, "rxtx_factor": 1.0, "id": "2"}} {{(pid=109011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:46:16.268641 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: INFO nova.api.openstack.requestlog [None req-7c0acd09-8eac-4ed5-a290-d6e6151a9b42 admin admin] 10.222.0.11 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.080248 May 03 08:46:16.269210 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: [pid: 109011|app: 0|req: 13/25] 10.222.0.11 () {64 vars in 1282 bytes} [Tue May 3 08:46:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:46:16.282573 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi [None req-448b4694-f85f-40d9-a73d-9d30cab04772 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:46:16.314685 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: INFO nova.api.openstack.requestlog [None req-448b4694-f85f-40d9-a73d-9d30cab04772 admin admin] 10.222.0.11 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037028 May 03 08:46:16.315423 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: [pid: 109012|app: 0|req: 13/26] 10.222.0.11 () {64 vars in 1332 bytes} [Tue May 3 08:46:16 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:46:18.944362 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi [None req-7c0acd09-8eac-4ed5-a290-d6e6151a9b42 admin admin] Calling method '>' {{(pid=109011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:46:18.945893 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: INFO nova.api.openstack.requestlog [None req-7c0acd09-8eac-4ed5-a290-d6e6151a9b42 admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001939 May 03 08:46:18.946791 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: [pid: 109011|app: 0|req: 14/27] 10.222.0.11 () {54 vars in 930 bytes} [Tue May 3 08:46:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:46:19.007019 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi [None req-74dbd119-db68-4c98-a938-3d1aa37cdc37 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 4096, "swap": 0, "vcpus": 2, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "3", "disk": 40}} {{(pid=109012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:46:19.024985 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: INFO nova.api.openstack.requestlog [None req-74dbd119-db68-4c98-a938-3d1aa37cdc37 admin admin] 10.222.0.11 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.071911 May 03 08:46:19.025549 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: [pid: 109012|app: 0|req: 14/28] 10.222.0.11 () {64 vars in 1282 bytes} [Tue May 3 08:46:18 2022] POST /compute/v2.1/flavors => generated 406 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 03 08:46:19.037257 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi [None req-03d42f20-d64b-45a8-bc78-c45edba662df admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:46:19.060503 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: INFO nova.api.openstack.requestlog [None req-03d42f20-d64b-45a8-bc78-c45edba662df admin admin] 10.222.0.11 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026914 May 03 08:46:19.065621 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: [pid: 109011|app: 0|req: 15/29] 10.222.0.11 () {64 vars in 1332 bytes} [Tue May 3 08:46:19 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:46:21.316614 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi [None req-74dbd119-db68-4c98-a938-3d1aa37cdc37 admin admin] Calling method '>' {{(pid=109012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:46:21.317604 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: INFO nova.api.openstack.requestlog [None req-74dbd119-db68-4c98-a938-3d1aa37cdc37 admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 May 03 08:46:21.317997 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: [pid: 109012|app: 0|req: 15/30] 10.222.0.11 () {54 vars in 930 bytes} [Tue May 3 08:46:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:46:21.383467 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi [None req-58b9bbc2-7f39-4ea8-b94c-4e932d96f9bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "id": "4", "os-flavor-access:is_public": true, "vcpus": 4, "name": "m1.large", "rxtx_factor": 1.0, "swap": 0}} {{(pid=109011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:46:21.401665 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: INFO nova.api.openstack.requestlog [None req-58b9bbc2-7f39-4ea8-b94c-4e932d96f9bd admin admin] 10.222.0.11 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.077523 May 03 08:46:21.402162 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: [pid: 109011|app: 0|req: 16/31] 10.222.0.11 () {64 vars in 1282 bytes} [Tue May 3 08:46:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:46:21.414062 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi [None req-77c3d5d8-23d0-4f71-8cbb-6bd331a466df admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:46:21.438699 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: INFO nova.api.openstack.requestlog [None req-77c3d5d8-23d0-4f71-8cbb-6bd331a466df admin admin] 10.222.0.11 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028216 May 03 08:46:21.439282 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: [pid: 109012|app: 0|req: 16/32] 10.222.0.11 () {64 vars in 1332 bytes} [Tue May 3 08:46:21 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 08:46:23.731867 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi [None req-58b9bbc2-7f39-4ea8-b94c-4e932d96f9bd admin admin] Calling method '>' {{(pid=109011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:46:23.732996 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: INFO nova.api.openstack.requestlog [None req-58b9bbc2-7f39-4ea8-b94c-4e932d96f9bd admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 May 03 08:46:23.735785 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: [pid: 109011|app: 0|req: 17/33] 10.222.0.11 () {54 vars in 930 bytes} [Tue May 3 08:46:23 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:46:23.795681 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi [None req-d639dd8d-6da4-4b87-afa2-74d1a225bce2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "vcpus": 8, "swap": 0, "disk": 160, "name": "m1.xlarge", "rxtx_factor": 1.0}} {{(pid=109012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:46:23.815045 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: INFO nova.api.openstack.requestlog [None req-d639dd8d-6da4-4b87-afa2-74d1a225bce2 admin admin] 10.222.0.11 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.073190 May 03 08:46:23.816228 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: [pid: 109012|app: 0|req: 17/34] 10.222.0.11 () {64 vars in 1282 bytes} [Tue May 3 08:46:23 2022] POST /compute/v2.1/flavors => generated 408 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:46:23.829516 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi [None req-8660c049-2a97-4686-b823-03f4bb0210f4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:46:23.933523 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: INFO nova.api.openstack.requestlog [None req-8660c049-2a97-4686-b823-03f4bb0210f4 admin admin] 10.222.0.11 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108227 May 03 08:46:23.935051 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: [pid: 109011|app: 0|req: 18/35] 10.222.0.11 () {64 vars in 1332 bytes} [Tue May 3 08:46:23 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:46:48.709553 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi [None req-d639dd8d-6da4-4b87-afa2-74d1a225bce2 admin admin] Calling method '>' {{(pid=109012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:46:48.710562 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: INFO nova.api.openstack.requestlog [None req-d639dd8d-6da4-4b87-afa2-74d1a225bce2 admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 May 03 08:46:48.710957 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: [pid: 109012|app: 0|req: 18/36] 10.222.0.11 () {54 vars in 930 bytes} [Tue May 3 08:46:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:46:48.779502 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi [None req-5fa1b127-9ca0-448d-89a2-f25bbe75a876 admin admin] Calling method '>' {{(pid=109011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:46:48.796991 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: INFO nova.api.openstack.requestlog [None req-5fa1b127-9ca0-448d-89a2-f25bbe75a876 admin admin] 10.222.0.11 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.080053 May 03 08:46:48.797531 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: [pid: 109011|app: 0|req: 19/37] 10.222.0.11 () {60 vars in 1291 bytes} [Tue May 3 08:46:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:46:50.104103 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi [None req-d639dd8d-6da4-4b87-afa2-74d1a225bce2 admin admin] Calling method '>' {{(pid=109012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:46:50.105117 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: INFO nova.api.openstack.requestlog [None req-d639dd8d-6da4-4b87-afa2-74d1a225bce2 admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 May 03 08:46:50.105832 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: [pid: 109012|app: 0|req: 19/38] 10.222.0.11 () {56 vars in 1074 bytes} [Tue May 3 08:46:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:46:50.322948 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi [None req-541bddab-2997-4d0d-82e5-27194eea9144 admin admin] Calling method '>' {{(pid=109011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:46:50.329057 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: INFO nova.api.openstack.wsgi [None req-541bddab-2997-4d0d-82e5-27194eea9144 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 03 08:46:50.329345 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi [None req-541bddab-2997-4d0d-82e5-27194eea9144 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 08:46:50.330140 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: INFO nova.api.openstack.requestlog [None req-541bddab-2997-4d0d-82e5-27194eea9144 admin admin] 10.222.0.11 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.064513 May 03 08:46:50.330660 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: [pid: 109011|app: 0|req: 20/39] 10.222.0.11 () {60 vars in 1190 bytes} [Tue May 3 08:46:50 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 03 08:46:50.339975 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi [None req-b4f0c3ed-3a27-4490-9eaf-7a045b8edab5 admin admin] Calling method '>' {{(pid=109012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:46:50.361121 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: INFO nova.api.openstack.requestlog [None req-b4f0c3ed-3a27-4490-9eaf-7a045b8edab5 admin admin] 10.222.0.11 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024729 May 03 08:46:50.361650 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: [pid: 109012|app: 0|req: 20/40] 10.222.0.11 () {60 vars in 1210 bytes} [Tue May 3 08:46:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 08:46:50.371309 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi [None req-edf945e2-a19d-4719-b6d4-e69778cb7612 admin admin] Calling method '>' {{(pid=109011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:46:50.392822 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: INFO nova.api.openstack.requestlog [None req-edf945e2-a19d-4719-b6d4-e69778cb7612 admin admin] 10.222.0.11 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025045 May 03 08:46:50.393354 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: [pid: 109011|app: 0|req: 21/41] 10.222.0.11 () {60 vars in 1210 bytes} [Tue May 3 08:46:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:46:50.407434 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi [None req-a18fa023-a99c-42a9-8750-e08e1aabc8bd admin admin] Calling method '>' {{(pid=109012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:46:50.415699 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: INFO nova.api.openstack.wsgi [None req-a18fa023-a99c-42a9-8750-e08e1aabc8bd admin admin] HTTP exception thrown: Flavor 42 could not be found. May 03 08:46:50.416626 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi [None req-a18fa023-a99c-42a9-8750-e08e1aabc8bd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 08:46:50.417811 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: INFO nova.api.openstack.requestlog [None req-a18fa023-a99c-42a9-8750-e08e1aabc8bd admin admin] 10.222.0.11 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015858 May 03 08:46:50.418518 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: [pid: 109012|app: 0|req: 21/42] 10.222.0.11 () {60 vars in 1190 bytes} [Tue May 3 08:46:50 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 03 08:46:51.613760 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi [None req-edf945e2-a19d-4719-b6d4-e69778cb7612 admin admin] Calling method '>' {{(pid=109011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:46:51.614777 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: INFO nova.api.openstack.requestlog [None req-edf945e2-a19d-4719-b6d4-e69778cb7612 admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 May 03 08:46:51.615197 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: [pid: 109011|app: 0|req: 22/43] 10.222.0.11 () {56 vars in 1074 bytes} [Tue May 3 08:46:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:46:51.812504 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi [None req-9111c1b8-9669-4107-ba7f-f4b9911bf9ad admin admin] Calling method '>' {{(pid=109012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:46:51.818677 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: INFO nova.api.openstack.wsgi [None req-9111c1b8-9669-4107-ba7f-f4b9911bf9ad admin admin] HTTP exception thrown: Flavor 84 could not be found. May 03 08:46:51.819174 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi [None req-9111c1b8-9669-4107-ba7f-f4b9911bf9ad admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 08:46:51.820006 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: INFO nova.api.openstack.requestlog [None req-9111c1b8-9669-4107-ba7f-f4b9911bf9ad admin admin] 10.222.0.11 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.070903 May 03 08:46:51.820516 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: [pid: 109012|app: 0|req: 22/44] 10.222.0.11 () {60 vars in 1190 bytes} [Tue May 3 08:46:51 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 03 08:46:51.830000 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi [None req-0f8d573b-0ba8-477c-9daa-b31d7d93d685 admin admin] Calling method '>' {{(pid=109011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:46:51.844017 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: INFO nova.api.openstack.requestlog [None req-0f8d573b-0ba8-477c-9daa-b31d7d93d685 admin admin] 10.222.0.11 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017630 May 03 08:46:51.844551 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: [pid: 109011|app: 0|req: 23/45] 10.222.0.11 () {60 vars in 1210 bytes} [Tue May 3 08:46:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:46:51.854046 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi [None req-ab53ae9f-60e9-4dd6-9e97-2d018248e716 admin admin] Calling method '>' {{(pid=109012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:46:51.868926 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: INFO nova.api.openstack.requestlog [None req-ab53ae9f-60e9-4dd6-9e97-2d018248e716 admin admin] 10.222.0.11 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018262 May 03 08:46:51.869385 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: [pid: 109012|app: 0|req: 23/46] 10.222.0.11 () {60 vars in 1210 bytes} [Tue May 3 08:46:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:46:51.878601 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi [None req-73b6fd84-d110-47ad-9055-aa9162e19285 admin admin] Calling method '>' {{(pid=109011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:46:51.883941 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: INFO nova.api.openstack.wsgi [None req-73b6fd84-d110-47ad-9055-aa9162e19285 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 03 08:46:51.884502 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi [None req-73b6fd84-d110-47ad-9055-aa9162e19285 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 08:46:51.885284 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: INFO nova.api.openstack.requestlog [None req-73b6fd84-d110-47ad-9055-aa9162e19285 admin admin] 10.222.0.11 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010281 May 03 08:46:51.885764 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: [pid: 109011|app: 0|req: 24/47] 10.222.0.11 () {60 vars in 1190 bytes} [Tue May 3 08:46:51 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 03 08:46:53.088061 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi [None req-ab53ae9f-60e9-4dd6-9e97-2d018248e716 admin admin] Calling method '>' {{(pid=109012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:46:53.089076 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: INFO nova.api.openstack.requestlog [None req-ab53ae9f-60e9-4dd6-9e97-2d018248e716 admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 May 03 08:46:53.089477 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: [pid: 109012|app: 0|req: 24/48] 10.222.0.11 () {56 vars in 1074 bytes} [Tue May 3 08:46:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:46:53.286731 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi [None req-d1333588-875a-487b-974c-e31e53e88eac admin admin] Calling method '>' {{(pid=109011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:46:53.293024 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: INFO nova.api.openstack.wsgi [None req-d1333588-875a-487b-974c-e31e53e88eac admin admin] HTTP exception thrown: Flavor 451 could not be found. May 03 08:46:53.293515 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi [None req-d1333588-875a-487b-974c-e31e53e88eac admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 08:46:53.294321 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: INFO nova.api.openstack.requestlog [None req-d1333588-875a-487b-974c-e31e53e88eac admin admin] 10.222.0.11 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.070879 May 03 08:46:53.294820 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: [pid: 109011|app: 0|req: 25/49] 10.222.0.11 () {60 vars in 1193 bytes} [Tue May 3 08:46:53 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 03 08:46:53.307233 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi [None req-3401feb2-a34d-42be-8fbd-46726007a467 admin admin] Calling method '>' {{(pid=109012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:46:53.322768 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: INFO nova.api.openstack.requestlog [None req-3401feb2-a34d-42be-8fbd-46726007a467 admin admin] 10.222.0.11 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021567 May 03 08:46:53.323265 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: [pid: 109012|app: 0|req: 25/50] 10.222.0.11 () {60 vars in 1210 bytes} [Tue May 3 08:46:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:46:53.332744 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi [None req-76e6dd3c-c1c4-4557-89db-ab9a5d512f06 admin admin] Calling method '>' {{(pid=109011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:46:53.346676 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: INFO nova.api.openstack.requestlog [None req-76e6dd3c-c1c4-4557-89db-ab9a5d512f06 admin admin] 10.222.0.11 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017315 May 03 08:46:53.347198 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: [pid: 109011|app: 0|req: 26/51] 10.222.0.11 () {60 vars in 1210 bytes} [Tue May 3 08:46:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 08:46:53.361329 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi [None req-ae45b39f-b326-4223-a3c8-2b3ffb5046b7 admin admin] Calling method '>' {{(pid=109012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:46:53.369430 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: INFO nova.api.openstack.wsgi [None req-ae45b39f-b326-4223-a3c8-2b3ffb5046b7 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 03 08:46:53.370306 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi [None req-ae45b39f-b326-4223-a3c8-2b3ffb5046b7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 08:46:53.371601 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: INFO nova.api.openstack.requestlog [None req-ae45b39f-b326-4223-a3c8-2b3ffb5046b7 admin admin] 10.222.0.11 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.016227 May 03 08:46:53.372398 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: [pid: 109012|app: 0|req: 26/52] 10.222.0.11 () {60 vars in 1193 bytes} [Tue May 3 08:46:53 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 03 08:46:54.580275 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi [None req-76e6dd3c-c1c4-4557-89db-ab9a5d512f06 admin admin] Calling method '>' {{(pid=109011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:46:54.581281 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: INFO nova.api.openstack.requestlog [None req-76e6dd3c-c1c4-4557-89db-ab9a5d512f06 admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 May 03 08:46:54.581676 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: [pid: 109011|app: 0|req: 27/53] 10.222.0.11 () {56 vars in 1074 bytes} [Tue May 3 08:46:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:46:54.781298 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi [None req-23f9e1b5-d733-4c49-99b1-62028e3b19ed admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:46:54.802140 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: INFO nova.api.openstack.requestlog [None req-23f9e1b5-d733-4c49-99b1-62028e3b19ed admin admin] 10.222.0.11 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.086741 May 03 08:46:54.802678 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: [pid: 109012|app: 0|req: 27/54] 10.222.0.11 () {64 vars in 1235 bytes} [Tue May 3 08:46:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:46:55.990117 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi [None req-76e6dd3c-c1c4-4557-89db-ab9a5d512f06 admin admin] Calling method '>' {{(pid=109011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:46:55.991152 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: INFO nova.api.openstack.requestlog [None req-76e6dd3c-c1c4-4557-89db-ab9a5d512f06 admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 May 03 08:46:55.991547 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: [pid: 109011|app: 0|req: 28/55] 10.222.0.11 () {56 vars in 1074 bytes} [Tue May 3 08:46:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:46:56.192468 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi [None req-e3173660-da4e-4932-b529-d1a3212b59d1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:46:56.212176 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: INFO nova.api.openstack.requestlog [None req-e3173660-da4e-4932-b529-d1a3212b59d1 admin admin] 10.222.0.11 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.085521 May 03 08:46:56.212740 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: [pid: 109012|app: 0|req: 28/56] 10.222.0.11 () {64 vars in 1235 bytes} [Tue May 3 08:46:56 2022] POST /compute/v2.1/flavors => generated 405 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:46:57.410490 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi [None req-76e6dd3c-c1c4-4557-89db-ab9a5d512f06 admin admin] Calling method '>' {{(pid=109011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:46:57.411487 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: INFO nova.api.openstack.requestlog [None req-76e6dd3c-c1c4-4557-89db-ab9a5d512f06 admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 May 03 08:46:57.411913 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: [pid: 109011|app: 0|req: 29/57] 10.222.0.11 () {56 vars in 1074 bytes} [Tue May 3 08:46:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:46:57.611591 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi [None req-9757c5d9-6053-4c6d-ad95-d4aea5ea9542 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:46:57.630756 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: INFO nova.api.openstack.requestlog [None req-9757c5d9-6053-4c6d-ad95-d4aea5ea9542 admin admin] 10.222.0.11 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.085939 May 03 08:46:57.631392 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: [pid: 109012|app: 0|req: 29/58] 10.222.0.11 () {64 vars in 1235 bytes} [Tue May 3 08:46:57 2022] POST /compute/v2.1/flavors => generated 407 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:46:58.833682 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi [None req-76e6dd3c-c1c4-4557-89db-ab9a5d512f06 admin admin] Calling method '>' {{(pid=109011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:46:58.834699 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: INFO nova.api.openstack.requestlog [None req-76e6dd3c-c1c4-4557-89db-ab9a5d512f06 admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 May 03 08:46:58.835120 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: [pid: 109011|app: 0|req: 30/59] 10.222.0.11 () {56 vars in 1074 bytes} [Tue May 3 08:46:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:46:59.030645 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi [None req-b9da5710-2aed-4997-ac3b-5869506e140f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:46:59.051138 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: INFO nova.api.openstack.requestlog [None req-b9da5710-2aed-4997-ac3b-5869506e140f admin admin] 10.222.0.11 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.083360 May 03 08:46:59.051613 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: [pid: 109012|app: 0|req: 30/60] 10.222.0.11 () {64 vars in 1235 bytes} [Tue May 3 08:46:58 2022] POST /compute/v2.1/flavors => generated 409 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:47:00.242939 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi [None req-76e6dd3c-c1c4-4557-89db-ab9a5d512f06 admin admin] Calling method '>' {{(pid=109011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:47:00.243975 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: INFO nova.api.openstack.requestlog [None req-76e6dd3c-c1c4-4557-89db-ab9a5d512f06 admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 May 03 08:47:00.244372 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: [pid: 109011|app: 0|req: 31/61] 10.222.0.11 () {56 vars in 1074 bytes} [Tue May 3 08:47:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:47:00.437931 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi [None req-19588983-0d61-4746-afb9-5a8e25263a14 admin admin] Calling method '>' {{(pid=109012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:47:00.457280 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: INFO nova.api.openstack.requestlog [None req-19588983-0d61-4746-afb9-5a8e25263a14 admin admin] 10.222.0.11 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.079633 May 03 08:47:00.457781 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: [pid: 109012|app: 0|req: 31/62] 10.222.0.11 () {60 vars in 1202 bytes} [Tue May 3 08:47:00 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:48:02.589690 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi [None req-76e6dd3c-c1c4-4557-89db-ab9a5d512f06 admin admin] Calling method '>' {{(pid=109011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:48:02.591329 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: INFO nova.api.openstack.requestlog [None req-76e6dd3c-c1c4-4557-89db-ab9a5d512f06 admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002306 May 03 08:48:02.591988 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: [pid: 109011|app: 0|req: 32/63] 10.222.0.11 () {54 vars in 930 bytes} [Tue May 3 08:48:02 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:48:02.657712 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi [None req-c3aaa3ae-f0a9-41eb-a66d-9dd5af875307 admin admin] Calling method '>' {{(pid=109012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:48:02.677068 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: INFO nova.api.openstack.requestlog [None req-c3aaa3ae-f0a9-41eb-a66d-9dd5af875307 admin admin] 10.222.0.11 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.075664 May 03 08:48:02.677605 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: [pid: 109012|app: 0|req: 32/64] 10.222.0.11 () {60 vars in 1291 bytes} [Tue May 3 08:48:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:48:02.708918 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi [None req-d8c0649d-a24a-4bce-8035-538e064595ed admin admin] Calling method '>' {{(pid=109011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:48:02.717001 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: INFO nova.api.openstack.requestlog [None req-d8c0649d-a24a-4bce-8035-538e064595ed admin admin] 10.222.0.11 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012475 May 03 08:48:02.717508 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: [pid: 109011|app: 0|req: 33/65] 10.222.0.11 () {60 vars in 1282 bytes} [Tue May 3 08:48:02 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:48:02.734442 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi [None req-19f0c866-a0fd-43f5-8bd2-767b303966b5 admin admin] Calling method '>' {{(pid=109012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:48:02.743089 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: INFO nova.api.openstack.requestlog [None req-19f0c866-a0fd-43f5-8bd2-767b303966b5 admin admin] 10.222.0.11 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014136 May 03 08:48:02.743624 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: [pid: 109012|app: 0|req: 33/66] 10.222.0.11 () {60 vars in 1285 bytes} [Tue May 3 08:48:02 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:48:02.755149 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi [None req-7ac75f16-f09c-4c3a-beb7-2f950f855940 admin admin] Calling method '>' {{(pid=109011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:48:02.763159 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: INFO nova.api.openstack.requestlog [None req-7ac75f16-f09c-4c3a-beb7-2f950f855940 admin admin] 10.222.0.11 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011580 May 03 08:48:02.763607 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: [pid: 109011|app: 0|req: 34/67] 10.222.0.11 () {60 vars in 1285 bytes} [Tue May 3 08:48:02 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 08:48:02.774817 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi [None req-abf2678f-4b14-405c-bdf5-495bf5a037a6 admin admin] Calling method '>' {{(pid=109012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:48:02.782618 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: INFO nova.api.openstack.requestlog [None req-abf2678f-4b14-405c-bdf5-495bf5a037a6 admin admin] 10.222.0.11 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011303 May 03 08:48:02.783241 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: [pid: 109012|app: 0|req: 34/68] 10.222.0.11 () {60 vars in 1282 bytes} [Tue May 3 08:48:02 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:49:46.413469 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi [None req-0ba85035-239b-4873-9511-f48799c7433e tempest-verify_tempest_config-1876288444 tempest-verify_tempest_config-1876288444-project] Calling method '>' {{(pid=109011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:49:46.415440 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: INFO nova.api.openstack.requestlog [None req-0ba85035-239b-4873-9511-f48799c7433e tempest-verify_tempest_config-1876288444 tempest-verify_tempest_config-1876288444-project] 10.222.0.11 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.112735 May 03 08:49:46.416010 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: [pid: 109011|app: 0|req: 35/69] 10.222.0.11 () {58 vars in 1133 bytes} [Tue May 3 08:49:46 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:51:32.182554 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi [None req-abf2678f-4b14-405c-bdf5-495bf5a037a6 admin admin] Calling method '>' {{(pid=109012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:51:32.183631 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: INFO nova.api.openstack.requestlog [None req-abf2678f-4b14-405c-bdf5-495bf5a037a6 admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 May 03 08:51:32.184201 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: [pid: 109012|app: 0|req: 35/70] 10.222.0.11 () {56 vars in 1074 bytes} [Tue May 3 08:51:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:51:32.448836 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi [None req-d1c22301-c3f3-4259-8be2-790a2b7b7736 admin admin] Calling method '>' {{(pid=109011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:51:32.450156 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 08:51:32.450156 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: warnings.warn(msg) May 03 08:51:32.451382 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG oslo_concurrency.lockutils [None req-d1c22301-c3f3-4259-8be2-790a2b7b7736 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:51:32.451855 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG oslo_concurrency.lockutils [None req-d1c22301-c3f3-4259-8be2-790a2b7b7736 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:51:32.452639 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG oslo_concurrency.lockutils [None req-d1c22301-c3f3-4259-8be2-790a2b7b7736 admin admin] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:51:32.453070 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG oslo_concurrency.lockutils [None req-d1c22301-c3f3-4259-8be2-790a2b7b7736 admin admin] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:51:32.487307 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: INFO nova.api.openstack.requestlog [None req-d1c22301-c3f3-4259-8be2-790a2b7b7736 admin admin] 10.222.0.11 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.163316 May 03 08:51:32.487930 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: [pid: 109011|app: 0|req: 36/71] 10.222.0.11 () {60 vars in 1193 bytes} [Tue May 3 08:51:32 2022] GET /compute/v2.1/os-services => generated 791 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:51:33.715257 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi [None req-abf2678f-4b14-405c-bdf5-495bf5a037a6 admin admin] Calling method '>' {{(pid=109012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:51:33.716300 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: INFO nova.api.openstack.requestlog [None req-abf2678f-4b14-405c-bdf5-495bf5a037a6 admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001649 May 03 08:51:33.716712 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: [pid: 109012|app: 0|req: 36/72] 10.222.0.11 () {56 vars in 1074 bytes} [Tue May 3 08:51:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:51:33.910552 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi [None req-2d2819e8-c6a5-40dd-a433-0905d6579716 admin admin] Calling method '>' {{(pid=109011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:51:33.911720 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 08:51:33.911720 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: warnings.warn(msg) May 03 08:51:33.912968 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG oslo_concurrency.lockutils [None req-2d2819e8-c6a5-40dd-a433-0905d6579716 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:51:33.913400 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG oslo_concurrency.lockutils [None req-2d2819e8-c6a5-40dd-a433-0905d6579716 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:51:33.914182 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG oslo_concurrency.lockutils [None req-2d2819e8-c6a5-40dd-a433-0905d6579716 admin admin] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:51:33.914609 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG oslo_concurrency.lockutils [None req-2d2819e8-c6a5-40dd-a433-0905d6579716 admin admin] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:51:33.933408 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: INFO nova.api.openstack.requestlog [None req-2d2819e8-c6a5-40dd-a433-0905d6579716 admin admin] 10.222.0.11 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.078855 May 03 08:51:33.933887 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: [pid: 109011|app: 0|req: 37/73] 10.222.0.11 () {60 vars in 1193 bytes} [Tue May 3 08:51:33 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:51:45.578039 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi [None req-abf2678f-4b14-405c-bdf5-495bf5a037a6 admin admin] Calling method '>' {{(pid=109012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:51:45.579060 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: INFO nova.api.openstack.requestlog [None req-abf2678f-4b14-405c-bdf5-495bf5a037a6 admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 May 03 08:51:45.579433 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: [pid: 109012|app: 0|req: 37/74] 10.222.0.11 () {56 vars in 1074 bytes} [Tue May 3 08:51:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:51:45.783804 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi [None req-2b7b338b-fb9d-4ff4-b257-c2622017136f admin admin] Calling method '>' {{(pid=109011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:51:45.784983 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 08:51:45.784983 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: warnings.warn(msg) May 03 08:51:45.786227 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG oslo_concurrency.lockutils [None req-2b7b338b-fb9d-4ff4-b257-c2622017136f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:51:45.786600 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG oslo_concurrency.lockutils [None req-2b7b338b-fb9d-4ff4-b257-c2622017136f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:51:45.787372 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG oslo_concurrency.lockutils [None req-2b7b338b-fb9d-4ff4-b257-c2622017136f admin admin] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:51:45.787803 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG oslo_concurrency.lockutils [None req-2b7b338b-fb9d-4ff4-b257-c2622017136f admin admin] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:51:45.811711 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: INFO nova.api.openstack.requestlog [None req-2b7b338b-fb9d-4ff4-b257-c2622017136f admin admin] 10.222.0.11 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.095897 May 03 08:51:45.812266 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: [pid: 109011|app: 0|req: 38/75] 10.222.0.11 () {60 vars in 1193 bytes} [Tue May 3 08:51:45 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:51:47.045646 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: DEBUG nova.api.openstack.wsgi [None req-abf2678f-4b14-405c-bdf5-495bf5a037a6 admin admin] Calling method '>' {{(pid=109012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:51:47.046672 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: INFO nova.api.openstack.requestlog [None req-abf2678f-4b14-405c-bdf5-495bf5a037a6 admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 May 03 08:51:47.047078 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: [pid: 109012|app: 0|req: 38/76] 10.222.0.11 () {56 vars in 1074 bytes} [Tue May 3 08:51:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:51:47.247993 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG nova.api.openstack.wsgi [None req-19ea8a18-b730-4166-ada0-eb256c05e1fc admin admin] Calling method '>' {{(pid=109011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:51:47.249208 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 08:51:47.249208 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: warnings.warn(msg) May 03 08:51:47.250529 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG oslo_concurrency.lockutils [None req-19ea8a18-b730-4166-ada0-eb256c05e1fc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:51:47.250890 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG oslo_concurrency.lockutils [None req-19ea8a18-b730-4166-ada0-eb256c05e1fc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:51:47.251668 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG oslo_concurrency.lockutils [None req-19ea8a18-b730-4166-ada0-eb256c05e1fc admin admin] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:51:47.252116 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: DEBUG oslo_concurrency.lockutils [None req-19ea8a18-b730-4166-ada0-eb256c05e1fc admin admin] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:51:47.275018 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: INFO nova.api.openstack.requestlog [None req-19ea8a18-b730-4166-ada0-eb256c05e1fc admin admin] 10.222.0.11 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.093964 May 03 08:51:47.275578 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: [pid: 109011|app: 0|req: 39/77] 10.222.0.11 () {60 vars in 1193 bytes} [Tue May 3 08:51:47 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:52:45.955356 dv-cinder-840276-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 03 08:52:45.956633 dv-cinder-840276-2-iscsi devstack@n-api.service[109010]: Tue May 3 08:52:45 2022 - graceful shutdown triggered... May 03 08:52:45.957183 dv-cinder-840276-2-iscsi devstack@n-api.service[109012]: Gracefully killing worker 2 (pid: 109012)... May 03 08:52:45.957552 dv-cinder-840276-2-iscsi devstack@n-api.service[109011]: Gracefully killing worker 1 (pid: 109011)... May 03 08:52:46.956933 dv-cinder-840276-2-iscsi devstack@n-api.service[109010]: worker 1 buried after 1 seconds May 03 08:52:46.956933 dv-cinder-840276-2-iscsi devstack@n-api.service[109010]: worker 2 buried after 1 seconds May 03 08:52:46.956933 dv-cinder-840276-2-iscsi devstack@n-api.service[109010]: goodbye to uWSGI. May 03 08:52:46.959379 dv-cinder-840276-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 03 08:52:46.960374 dv-cinder-840276-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 03 08:52:46.964666 dv-cinder-840276-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 03 08:52:46.984020 dv-cinder-840276-2-iscsi devstack@n-api.service[123377]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 03 08:52:46.993956 dv-cinder-840276-2-iscsi devstack@n-api.service[123377]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 3 08:52:46 2022] *** May 03 08:52:46.993956 dv-cinder-840276-2-iscsi devstack@n-api.service[123377]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 03 08:52:46.993956 dv-cinder-840276-2-iscsi devstack@n-api.service[123377]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 03 08:52:46.993956 dv-cinder-840276-2-iscsi devstack@n-api.service[123377]: nodename: dv-cinder-840276-2-iscsi May 03 08:52:46.993956 dv-cinder-840276-2-iscsi devstack@n-api.service[123377]: machine: x86_64 May 03 08:52:46.993956 dv-cinder-840276-2-iscsi devstack@n-api.service[123377]: clock source: unix May 03 08:52:46.993956 dv-cinder-840276-2-iscsi devstack@n-api.service[123377]: pcre jit disabled May 03 08:52:46.993956 dv-cinder-840276-2-iscsi devstack@n-api.service[123377]: detected number of CPU cores: 4 May 03 08:52:46.993956 dv-cinder-840276-2-iscsi devstack@n-api.service[123377]: current working directory: / May 03 08:52:46.993956 dv-cinder-840276-2-iscsi devstack@n-api.service[123377]: detected binary path: /usr/bin/uwsgi-core May 03 08:52:46.993956 dv-cinder-840276-2-iscsi devstack@n-api.service[123377]: your processes number limit is 47680 May 03 08:52:46.993956 dv-cinder-840276-2-iscsi devstack@n-api.service[123377]: your memory page size is 4096 bytes May 03 08:52:46.993956 dv-cinder-840276-2-iscsi devstack@n-api.service[123377]: detected max file descriptor number: 2048 May 03 08:52:46.993956 dv-cinder-840276-2-iscsi devstack@n-api.service[123377]: lock engine: pthread robust mutexes May 03 08:52:46.994986 dv-cinder-840276-2-iscsi devstack@n-api.service[123377]: thunder lock: enabled May 03 08:52:46.994986 dv-cinder-840276-2-iscsi devstack@n-api.service[123377]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 03 08:52:46.994986 dv-cinder-840276-2-iscsi devstack@n-api.service[123377]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 03 08:52:47.040462 dv-cinder-840276-2-iscsi devstack@n-api.service[123377]: Python main interpreter initialized at 0x55917b1589c0 May 03 08:52:47.040462 dv-cinder-840276-2-iscsi devstack@n-api.service[123377]: python threads support enabled May 03 08:52:47.040462 dv-cinder-840276-2-iscsi devstack@n-api.service[123377]: your server socket listen backlog is limited to 100 connections May 03 08:52:47.040462 dv-cinder-840276-2-iscsi devstack@n-api.service[123377]: your mercy for graceful operations on workers is 90 seconds May 03 08:52:47.040932 dv-cinder-840276-2-iscsi devstack@n-api.service[123377]: mapped 403077 bytes (393 KB) for 2 cores May 03 08:52:47.040932 dv-cinder-840276-2-iscsi devstack@n-api.service[123377]: *** Operational MODE: preforking *** May 03 08:52:47.041176 dv-cinder-840276-2-iscsi devstack@n-api.service[123377]: *** uWSGI is running in multiple interpreter mode *** May 03 08:52:47.041176 dv-cinder-840276-2-iscsi devstack@n-api.service[123377]: spawned uWSGI master process (pid: 123377) May 03 08:52:47.041393 dv-cinder-840276-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 03 08:52:47.042055 dv-cinder-840276-2-iscsi devstack@n-api.service[123377]: spawned uWSGI worker 1 (pid: 123391, cores: 1) May 03 08:52:47.042318 dv-cinder-840276-2-iscsi devstack@n-api.service[123377]: spawned uWSGI worker 2 (pid: 123392, cores: 1) May 03 08:52:47.043843 dv-cinder-840276-2-iscsi devstack@n-api.service[123377]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 03 08:52:48.228238 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 03 08:52:48.228819 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 03 08:52:49.008903 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 03 08:52:49.008903 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: from cryptography.utils import int_from_bytes May 03 08:52:49.009295 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 03 08:52:49.009295 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: from cryptography.utils import int_from_bytes May 03 08:52:49.009675 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 03 08:52:49.009675 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: from cryptography.utils import int_from_bytes May 03 08:52:49.009988 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 03 08:52:49.009988 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: from cryptography.utils import int_from_bytes May 03 08:52:51.375339 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 03 08:52:51.376095 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 03 08:52:51.376095 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 03 08:52:51.376494 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 03 08:52:51.376734 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 03 08:52:51.376848 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 03 08:52:51.377201 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 03 08:52:51.377286 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.377467 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.377587 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 03 08:52:51.377743 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.377911 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 03 08:52:51.378070 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.378169 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 03 08:52:51.378393 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.378514 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.378707 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.378804 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.379028 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.379138 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.379348 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.379462 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.379675 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.379876 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.379977 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.380059 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.380261 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.380375 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.380589 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-840276-2-iscsi {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.380689 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.380905 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.381068 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.381211 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.381377 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.381531 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.381680 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.381828 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.381979 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-840276-2-iscsi {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.382126 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.382276 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.382430 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.382579 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.382765 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.382930 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.383127 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.383281 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.383454 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.384689 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.384931 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.385155 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.385402 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.385615 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.385864 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.386081 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.386289 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.386504 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.386705 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.386920 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.387132 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.387344 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.387545 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.387787 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.388014 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.388235 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.388457 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.388672 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.388886 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.389108 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.389317 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-840276-2-iscsi {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.389525 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.389736 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.389951 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.390136 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.390281 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-840276-2-iscsi {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.390463 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.390605 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.390794 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.391526 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.391692 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.391895 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.392049 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.392207 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.392361 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.392875 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.393037 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.393182 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.393324 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.393474 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.393705 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.393981 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.394149 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.394302 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.394451 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.394601 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.394761 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.394912 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.395054 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.395202 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.395345 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.395575 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.395733 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.395911 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.396078 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.396220 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.396371 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.396529 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.396679 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.396679 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.396973 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.397122 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.397264 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.397420 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.397569 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.397569 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.397864 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.398021 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.398173 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.398173 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.398459 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.398607 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.398762 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.398915 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.399073 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.399219 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.399369 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.399369 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.399674 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.399674 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.399978 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.400131 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.400273 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.400414 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.400568 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.400710 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.400857 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.400998 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.401505 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.401773 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.401945 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.402755 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.402877 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.402967 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.403043 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.403121 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.403210 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.403297 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.403370 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.403454 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.403537 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.403616 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.403703 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.403703 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.403875 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.11 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.403875 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.11 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.404023 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.404110 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.404193 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.404273 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.404346 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.11 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.404424 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.404503 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.11 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.404584 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.404664 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.404742 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.404821 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.404899 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.404977 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.404977 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.405129 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.405209 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.405293 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.405376 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.405457 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.405538 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.405616 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.405695 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.405774 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.405852 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.405935 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.406007 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.406077 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.406148 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.406225 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.406304 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.406384 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.406464 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.406542 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.406614 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.406690 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.406773 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.406859 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.406938 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.407009 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.407079 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.407156 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.407236 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.407316 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.407399 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.407471 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.407554 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.407626 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.407711 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.407811 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.407889 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.407993 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.408067 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.408145 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.408230 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.408310 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.408388 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.408467 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.408538 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.409219 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.409341 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.409451 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.409579 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.409691 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.409801 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.409924 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.410045 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.410164 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.410285 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.410406 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.410538 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.410727 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.410852 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.410972 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.411096 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.411229 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.411346 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.411470 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.411589 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.411711 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.411856 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.411971 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.412094 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.412229 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.412629 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.412759 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.412879 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.413002 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.413120 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.413241 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.413354 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.413482 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.413608 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.413731 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.413852 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.413963 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.414152 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.414273 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.415945 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.416142 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.416321 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.416477 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.416623 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.416776 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.416929 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.417079 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.417243 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.417388 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.417531 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.417682 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.417868 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.418022 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.418180 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.418354 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.418501 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.418652 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.418796 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.418953 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.419099 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.419249 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.419400 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.419544 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.419698 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.419879 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.420035 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.420206 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.420361 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.420513 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.420664 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.420822 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.420975 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.421127 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.421279 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:52:51.421433 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.421654 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.421817 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.421962 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.422113 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.422279 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.422432 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.422586 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.422747 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.422993 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.423155 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.423155 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.423430 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.423587 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.423731 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.423935 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.424091 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.424248 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.424400 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.424559 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.424711 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.424863 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.425013 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.425164 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.425324 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.425469 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.426179 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.426344 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.426500 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.426653 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.426819 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.426964 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.427123 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.427268 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.427420 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.427565 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.427708 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.427892 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.428038 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.428181 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.428333 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.428485 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.428636 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.428800 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.428946 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.429098 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.429243 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.429393 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.429537 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.429691 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.429835 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.429985 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.430135 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.430297 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.430448 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.430613 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.430758 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.430901 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.431043 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.431186 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.431338 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.431489 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.431641 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.431832 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.431983 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.432136 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.432293 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.432437 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.432590 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.432745 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.432897 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.433154 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.433316 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.433513 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.433667 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.433819 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.433964 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.434107 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.434260 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.434411 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.434562 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.434717 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.434871 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.435029 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.435175 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.435326 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.435477 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.435621 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.436357 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.436528 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.436682 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.436839 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.436984 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.437136 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.437299 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.437453 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.437605 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.437749 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.437902 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.438047 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.438198 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.438427 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.438575 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.438726 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.438877 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.439023 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.439180 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.439336 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.439479 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.439623 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.439794 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.439945 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.440108 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.440262 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.440414 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.440558 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.440709 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.440854 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.441012 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.441176 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.441330 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.441480 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.441624 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.441767 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.441923 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.442077 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.442230 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.442382 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.442527 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.442684 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.442829 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.442972 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.443231 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.443386 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.443539 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.443696 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.443878 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.444031 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.444176 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.444319 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.444469 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.444623 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.444776 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.444921 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.445076 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.445234 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.445387 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.445541 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.445685 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.446123 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.446557 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.446708 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.446863 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.447008 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.447163 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.447317 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.447461 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.447617 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.447788 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.447949 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.448106 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.448250 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.448395 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.448550 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.448550 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.448841 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.449017 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.449174 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.449345 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.449492 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.449656 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.449809 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.449961 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.450113 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.450274 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.450437 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.450594 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.450739 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.450882 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.451025 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.451168 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.451326 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.451478 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.451633 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.451844 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.451996 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.452152 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.452311 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.452455 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.452600 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.452743 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.452893 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.453873 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.454031 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.454177 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.454177 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.454474 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.454629 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.454788 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.454940 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.455085 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.455230 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.455383 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.455537 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.455682 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.455849 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.456551 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.456822 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.457005 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.457160 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.457313 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.457458 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.457602 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.457756 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.457915 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.458066 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.458222 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.458374 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.458518 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.458671 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.458816 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.458980 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.459133 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.459287 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.459439 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.459593 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.459745 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.459933 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.460077 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.460241 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.460394 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.460548 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.460733 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.460905 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.461053 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.461205 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.461349 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.461502 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.461647 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.461789 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.461947 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.462092 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.462246 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.462390 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.462533 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.462677 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.462830 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.462974 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.463128 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.463272 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.463423 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.463575 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.463726 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.464007 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.464168 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.464313 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.464465 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.464638 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.464833 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.464999 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.465156 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.465308 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.465453 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.465588 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.465715 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.465836 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.465957 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.466089 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.466718 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.466957 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.467082 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.467204 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.467333 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.467458 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.467585 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.467683 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.467793 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.467900 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.467991 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.468076 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.468169 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.468256 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.468387 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.468570 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.468661 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.468746 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.468838 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.468924 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.469018 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.469118 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.469212 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.469306 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.469400 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.469495 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.469597 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.469693 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.469693 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.469865 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.469959 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.470046 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.470140 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.470230 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.470315 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.470399 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.470492 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.470585 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.470685 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.470780 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.470865 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.470949 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.471041 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.471127 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.471224 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.471310 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.471402 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.471495 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.471581 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.471674 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.471759 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.471905 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.472001 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.472095 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.472180 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.472278 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.472363 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.472447 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.472539 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.472630 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.472715 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.472813 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.472906 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.472991 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.473076 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.473168 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.473261 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.473356 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.473450 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.473536 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.473620 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.473719 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.473814 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.473901 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.474010 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.474144 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.474239 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.474326 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.474425 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.474511 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.474595 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.474688 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.474780 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.474874 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.474974 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.475061 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.475145 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.475229 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.475313 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.475397 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.475495 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.475583 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.475667 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.475751 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.475855 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.475941 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.476040 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.476138 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.476232 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.476341 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.476798 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.476911 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.477065 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.477160 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.477261 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.477354 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.477456 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.477552 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.477640 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.477724 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.477818 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.477911 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.478005 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.478099 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.478187 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.478271 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.478271 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.478435 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.478533 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.478626 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.478845 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.478941 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.479154 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.479257 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.479469 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.479572 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.479832 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.479945 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.480168 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.480441 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.480555 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.480780 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.480914 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.481098 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.481225 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.481419 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.481520 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.482081 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.482188 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.482409 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.482512 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.482744 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.482844 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.483048 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.483151 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.483353 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.483454 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.483656 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.483790 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.484023 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.484119 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.484331 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.484433 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.484631 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.484739 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.484936 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.485030 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.485238 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.485332 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.485544 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.485645 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.485845 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.485936 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.486157 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.486258 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.486459 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.486629 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.486901 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.487003 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.487092 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.487217 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.487342 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.487446 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.487658 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.487807 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.487987 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.488102 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.488300 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.488395 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.488608 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.488701 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.488932 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.489025 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.489244 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.489348 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.489551 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.489644 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.489857 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.489957 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.490163 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.490262 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.490484 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.490576 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.490787 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.490885 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.491088 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.491183 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.491391 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.491486 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.491705 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.491858 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.492035 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.492128 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.492347 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.492441 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.492684 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.492798 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.492991 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.493120 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.493297 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.493398 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.493601 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.493706 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.493912 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.494015 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.494222 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.494328 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.494652 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.494775 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.494897 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.495008 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.495119 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.495238 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.495411 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.495538 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.495709 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.495922 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.496050 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.496163 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.496360 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.496487 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.496810 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.497032 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.497032 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.497432 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.497562 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.497675 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.497785 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.497893 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.498010 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.498133 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.498254 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.498365 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.498474 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.498582 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.498698 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.498823 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.498997 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.499114 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.499297 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.499414 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.499693 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.499866 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.499984 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.500110 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.500227 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.500328 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.500533 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.500634 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.500842 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.500990 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.501152 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.501247 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.501455 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.501562 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.501814 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.501989 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.502143 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.502288 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.502445 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.502594 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.502762 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.502914 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.503050 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.503191 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.503339 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.503487 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.503637 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.503739 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.503874 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.503949 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.504157 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.504268 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.504472 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.504576 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.504775 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.504944 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.505084 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.505187 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.505389 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.505492 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.505700 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.505877 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.506032 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.506190 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.506293 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.506388 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.506587 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.506725 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.506888 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.507020 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.507187 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.507322 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.507489 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.507597 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.507809 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.507919 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.508135 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.508237 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.508443 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.508554 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.508749 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.508841 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.509051 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.509146 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.509353 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.509456 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.509691 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.509783 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.509996 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.510100 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.510288 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.510388 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.510598 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.510692 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.510904 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.510997 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.511210 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.511313 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.511536 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.511743 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.511940 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.512119 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.512228 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.512440 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.512532 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.512754 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.512846 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.513062 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.513156 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.513380 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.513474 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.513699 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.513800 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.514003 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.514104 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.514308 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.514400 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.514616 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.514709 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.514930 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.515026 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.515236 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.515336 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.515541 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.515641 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.515867 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.515976 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.516177 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.516270 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.516487 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.516597 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.516797 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.516889 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.517100 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.517240 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.517406 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.517589 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.517731 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.517821 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.518000 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.518103 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.518307 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.518410 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.518615 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.518709 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.518926 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.519026 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.519230 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.519333 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.519532 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.519632 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.519865 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.519962 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.520173 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.520285 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.520474 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.520566 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.520773 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.520873 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.521094 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.521194 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.521397 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.521496 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.521705 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.521807 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.522011 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.522113 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.522329 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.522422 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.522623 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.522716 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.523081 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.523172 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.523271 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.523363 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.523573 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.523684 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.523968 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.524074 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.524281 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.524375 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.524592 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.524699 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.524899 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.525038 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.525200 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.525301 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.525500 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.525602 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.525806 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.525899 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.526128 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.526228 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.526431 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.526538 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.526732 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.526824 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.527030 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.527202 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.527374 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.527470 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.527675 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.527835 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.528015 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.528118 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.528342 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.528466 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.528645 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.528779 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.528948 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.529084 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.529268 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.529478 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.529607 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.529822 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.529940 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.530134 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.530348 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.530468 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.530578 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.530756 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.530883 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.531076 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.531258 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.531378 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.531568 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.531686 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.531904 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.532042 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.532226 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.532360 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.532548 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.532676 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.533001 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.533313 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.533627 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.533908 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.534038 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.534250 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.534351 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.534571 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.534671 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.534881 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.534982 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.535196 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.535294 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.535502 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.535595 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.535875 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.536004 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.536294 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.536622 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.536940 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.537151 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.537294 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.537444 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.537660 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.537765 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.537968 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.538184 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.538289 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.538517 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.538613 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.538824 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.538918 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.539130 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.539223 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.539455 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.539558 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.539758 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.539908 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.540090 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.540193 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.540399 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.540502 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.540706 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.540964 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.541095 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.541272 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.541374 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.541576 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.541677 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.541895 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.541995 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.542197 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.542298 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.542515 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.542622 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.542877 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.542979 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.543184 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.543292 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.543502 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.543592 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.543825 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.543923 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.544148 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.544248 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.544453 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.544544 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.544757 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.544858 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.545058 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.545166 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.545370 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.545475 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.545687 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.545799 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.545989 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.546080 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.546300 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.546391 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.546597 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.546698 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.546904 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.547250 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.547389 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.547596 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.547708 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.547944 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.548042 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.548205 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.548311 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.548533 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.548640 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.548845 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.548946 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.549181 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.549274 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.549491 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.549593 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.549793 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.549887 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.550100 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.550195 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.550404 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.550543 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.550706 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.550806 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.551007 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.551098 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.551313 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.551426 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.551609 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.551711 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.551933 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.552028 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.552233 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.552335 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.552541 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.552656 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.552842 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.552945 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.553146 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.553239 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.553474 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.553601 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.553750 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.553864 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.554054 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.554152 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.554354 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.554454 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.554666 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.554768 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.554971 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.555071 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.555280 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.555381 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.555590 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.555700 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.555932 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.556026 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.556261 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.556363 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.556566 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.556675 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.556888 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.556985 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.557207 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.557299 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.557521 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.557641 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.557839 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.557966 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.558156 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.558303 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.558496 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.558607 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.558812 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.558913 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.559127 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.559219 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.559436 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.559530 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.559752 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.559922 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.560087 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.560181 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.560403 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.560504 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.560714 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.560953 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.561055 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.561282 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.561402 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.561600 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.561703 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.561906 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.562167 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.562275 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.562500 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.562594 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.562813 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.562911 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.563130 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.563276 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.563442 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.563569 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.563759 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.563919 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.564114 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.564223 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.565088 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.565242 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.565366 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.565479 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.565591 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.565754 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.565880 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.566003 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.566115 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.566234 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.566356 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.566477 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.566597 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.566718 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.566840 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.566963 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.567095 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.570632 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.570744 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.570836 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.570923 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.571020 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.571117 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.571250 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.571250 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.571444 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.571532 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.571645 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.571734 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.571940 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.572034 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.572120 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.572215 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.572342 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.572472 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.572562 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.572712 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.572821 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.572926 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.573021 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.573149 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.573269 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.573370 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.573466 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.573466 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.573776 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.573875 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.574002 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.574153 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.574327 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.574420 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.574514 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.574600 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.574692 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.574788 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.574788 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.574963 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.575056 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.575142 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.575223 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.575296 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.575394 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.575487 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.575561 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.575644 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.575729 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.575834 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.575986 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.576077 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.576164 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.576244 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.576324 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.576404 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.576478 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.576549 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.576626 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.576698 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.576776 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.576856 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.576983 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.577079 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.577211 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.577351 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.577522 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.577671 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.577889 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.578017 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.578130 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.578242 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.578438 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.578574 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.578749 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.578843 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.579059 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.579374 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.579552 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.579552 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.580055 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.580055 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.580246 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.580363 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.580562 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.580725 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.580880 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.581039 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.581212 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.581385 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.581584 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.581753 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.581918 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.582057 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.582156 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.582285 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.582457 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.582623 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.582764 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.582969 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.583100 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.583309 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.583417 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.583682 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.583823 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.584021 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.584175 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.584317 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.584535 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.584639 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.584852 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.584974 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.585164 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.585322 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.585473 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.585600 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.585790 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.585942 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.586096 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.586248 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.586428 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.586551 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.586738 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.586845 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.587044 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.587137 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.587363 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.587455 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.587665 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.587891 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.588093 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.588194 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.588282 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.588368 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.588613 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.588760 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.588869 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.588958 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.589183 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.589286 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.589487 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.589588 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.589814 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.589916 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.590120 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.590221 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.590434 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.590548 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.590740 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.590888 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.591032 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.591182 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.591329 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.591477 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.591668 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.591782 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.591958 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.592065 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.592280 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.592392 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.592590 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.592693 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.592898 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.592992 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.593234 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.593341 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.593550 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.593652 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.593861 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.594081 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.594194 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.594418 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.594520 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.594744 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.595033 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.595128 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.595372 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.595498 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.595692 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.595821 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.596025 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.596136 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.596332 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.596434 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.596655 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.596756 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.596961 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.597061 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.597269 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.597370 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.597575 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.597673 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.597885 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.598000 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.598192 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.598302 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.598499 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.598656 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.598821 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.598977 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.599130 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.599282 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.599419 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.599565 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.599703 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.599881 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.600019 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.600121 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.600329 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.600424 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.600632 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.600727 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.600943 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.601045 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.601251 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.601346 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.601566 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.601668 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.601876 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.601970 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.602194 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.602295 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.602504 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.602599 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.602811 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.602904 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.603120 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.603223 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.603429 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.603521 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.603736 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.603932 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.604070 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.604174 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.604378 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.604472 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.604681 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.604775 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.605011 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.605114 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.605440 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.605590 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.605742 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.605848 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.606072 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.606201 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.606427 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.606557 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.607066 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.607166 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.607441 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.607547 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.607708 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.607840 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.608063 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.608159 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.608384 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.608478 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.610644 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.610818 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.610944 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.611139 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.611268 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.611383 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.611495 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.611606 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.611710 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.611836 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.611928 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.612002 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.612073 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.612153 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.612227 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.612307 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.612380 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.612450 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.612528 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.612601 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.612681 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.612754 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.612754 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.612890 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.612970 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.613043 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.613124 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.613197 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.613275 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.613347 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.613417 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.613487 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.613568 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.613650 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.613840 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.613945 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.614103 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.614228 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.614401 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.614537 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.614700 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.614845 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.615001 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.615147 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.615299 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.615453 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.615599 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.615758 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.615946 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.616213 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.616512 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.616812 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.617141 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.617254 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.617343 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.617441 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.617642 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.617748 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.617964 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.618089 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.618284 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.618422 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.618600 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.618705 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.618914 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.619046 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.619224 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.619330 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.619532 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.619626 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.619893 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.620004 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.620212 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.620313 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.620528 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.620629 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.620857 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.620953 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.621193 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.621287 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.621500 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.621602 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.621810 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.621915 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.622121 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.622215 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.622428 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.622529 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.622738 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.622845 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.623046 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.623180 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.623376 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.623479 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.623683 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.623800 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.624025 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.624130 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.624340 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.624433 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.624653 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.624757 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.624964 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.625058 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.625277 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.625378 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.625590 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.625686 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.625920 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.626023 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.626228 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.626320 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.626532 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.626627 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.626847 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.626956 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.627156 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.627249 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.627467 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.627561 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.627871 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.627982 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.628102 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.628205 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.628428 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.628534 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.628735 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.628830 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.629088 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.629243 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.629364 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.629466 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.629681 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.629789 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.629998 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.630107 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.630319 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.630421 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.630645 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.630741 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.630952 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.631057 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.631263 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.631365 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.631565 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.631660 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.631862 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 03 08:52:51.631970 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.632265 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.632610 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.632939 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.633253 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.633570 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.633875 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:52:51.634120 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 03 08:52:51.656326 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_db.sqlalchemy.engines [None req-49ab521b-9dd4-4824-a8cc-af2974401076 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123392) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 03 08:52:51.656909 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_db.sqlalchemy.engines [None req-312c8329-6669-4fa2-bd6c-e47a7c267513 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123391) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 03 08:52:51.724583 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.context [None req-312c8329-6669-4fa2-bd6c-e47a7c267513 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),704ac130-5e75-4d30-aa38-214e2e8ddc38(cell1) {{(pid=123391) load_cells /opt/stack/nova/nova/context.py:464}} May 03 08:52:51.727378 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.context [None req-49ab521b-9dd4-4824-a8cc-af2974401076 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),704ac130-5e75-4d30-aa38-214e2e8ddc38(cell1) {{(pid=123392) load_cells /opt/stack/nova/nova/context.py:464}} May 03 08:52:51.729089 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-312c8329-6669-4fa2-bd6c-e47a7c267513 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:52:51.730941 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-312c8329-6669-4fa2-bd6c-e47a7c267513 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:52:51.732192 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-312c8329-6669-4fa2-bd6c-e47a7c267513 None None] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:52:51.732508 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-49ab521b-9dd4-4824-a8cc-af2974401076 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:52:51.734148 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-49ab521b-9dd4-4824-a8cc-af2974401076 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:52:51.734271 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-312c8329-6669-4fa2-bd6c-e47a7c267513 None None] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:52:51.734968 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-49ab521b-9dd4-4824-a8cc-af2974401076 None None] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:52:51.736978 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-49ab521b-9dd4-4824-a8cc-af2974401076 None None] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:52:51.745980 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_db.sqlalchemy.engines [None req-312c8329-6669-4fa2-bd6c-e47a7c267513 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123391) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 03 08:52:51.746798 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_db.sqlalchemy.engines [None req-312c8329-6669-4fa2-bd6c-e47a7c267513 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123391) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 03 08:52:51.750918 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_db.sqlalchemy.engines [None req-49ab521b-9dd4-4824-a8cc-af2974401076 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123392) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 03 08:52:51.752724 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_db.sqlalchemy.engines [None req-49ab521b-9dd4-4824-a8cc-af2974401076 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123392) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 03 08:52:51.904361 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_db.sqlalchemy.engines [None req-312c8329-6669-4fa2-bd6c-e47a7c267513 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123391) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 03 08:52:51.917655 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_db.sqlalchemy.engines [None req-49ab521b-9dd4-4824-a8cc-af2974401076 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123392) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 03 08:52:52.218824 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: WARNING keystonemiddleware.auth_token [None req-312c8329-6669-4fa2-bd6c-e47a7c267513 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 03 08:52:52.225464 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: WARNING keystonemiddleware.auth_token [None req-312c8329-6669-4fa2-bd6c-e47a7c267513 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 03 08:52:52.235221 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: WARNING keystonemiddleware.auth_token [None req-49ab521b-9dd4-4824-a8cc-af2974401076 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 03 08:52:52.241801 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: WARNING keystonemiddleware.auth_token [None req-49ab521b-9dd4-4824-a8cc-af2974401076 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 03 08:52:52.573525 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: WARNING keystonemiddleware.auth_token [None req-312c8329-6669-4fa2-bd6c-e47a7c267513 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 03 08:52:52.578800 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: WARNING keystonemiddleware.auth_token [None req-312c8329-6669-4fa2-bd6c-e47a7c267513 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 03 08:52:52.584229 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55917b1589c0 pid: 123391 (default app) May 03 08:52:52.593020 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: WARNING keystonemiddleware.auth_token [None req-49ab521b-9dd4-4824-a8cc-af2974401076 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 03 08:52:52.598263 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: WARNING keystonemiddleware.auth_token [None req-49ab521b-9dd4-4824-a8cc-af2974401076 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 03 08:52:52.603658 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55917b1589c0 pid: 123392 (default app) May 03 08:53:35.277771 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ea97c104-d25e-438a-a64e-a39be3739657 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1780588088", "imageRef": "bd46d67a-108d-4c0c-9f0b-cb6d41c82a32", "flavorRef": "452", "networks": [{"uuid": "aaaef746-673a-41ce-aa45-2829e866447d"}]}} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:53:35.413323 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-8c65e9c4-0391-4594-92d3-1d3caf0f2f5a tempest-VolumesSnapshotsTestJSON-1899940610 tempest-VolumesSnapshotsTestJSON-1899940610-project] Action: 'create', calling method: .version_select at 0x7f09d0545940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-866032878"}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:53:36.136215 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.network.neutron [None req-ea97c104-d25e-438a-a64e-a39be3739657 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] validate_networks() for [('aaaef746-673a-41ce-aa45-2829e866447d', None, None, None, None, None)] {{(pid=123391) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 03 08:53:37.244157 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-8c65e9c4-0391-4594-92d3-1d3caf0f2f5a tempest-VolumesSnapshotsTestJSON-1899940610 tempest-VolumesSnapshotsTestJSON-1899940610-project] 10.222.0.11 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.127792 May 03 08:53:37.245349 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1/1] 10.222.0.11 () {60 vars in 1154 bytes} [Tue May 3 08:53:34 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3131 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) May 03 08:53:37.254290 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-bd6bf681-8cf2-4a74-9bc6-48c9650dd695 tempest-VolumesTestJSON-493488182 tempest-VolumesTestJSON-493488182-project] Calling method '.version_select at 0x7f09d034bf70>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:53:37.389116 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-bd6bf681-8cf2-4a74-9bc6-48c9650dd695 tempest-VolumesTestJSON-493488182 tempest-VolumesTestJSON-493488182-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/3de9b8a1-f6ee-4067-91db-40dfee49e2e9" status: 200 len: 351 microversion: 2.1 time: 0.142277 May 03 08:53:37.400160 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 2/2] 10.222.0.11 () {58 vars in 1244 bytes} [Tue May 3 08:53:37 2022] GET /compute/v2.1/os-volumes/3de9b8a1-f6ee-4067-91db-40dfee49e2e9 => generated 351 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:53:37.407845 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-8f0e82ed-c3be-496a-bfe2-73360891cc27 tempest-VolumesSnapshotsTestJSON-1899940610 tempest-VolumesSnapshotsTestJSON-1899940610-project] Calling method '.version_select at 0x7f09d03600d0>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:53:37.513902 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-8f0e82ed-c3be-496a-bfe2-73360891cc27 tempest-VolumesSnapshotsTestJSON-1899940610 tempest-VolumesSnapshotsTestJSON-1899940610-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/e1448e3c-692f-41c9-b514-ec18429b8070" status: 200 len: 344 microversion: 2.1 time: 0.111376 May 03 08:53:37.514859 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 3/3] 10.222.0.11 () {58 vars in 1244 bytes} [Tue May 3 08:53:37 2022] GET /compute/v2.1/os-volumes/e1448e3c-692f-41c9-b514-ec18429b8070 => generated 344 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:53:38.087159 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-ea97c104-d25e-438a-a64e-a39be3739657 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Flavor limits 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 03 08:53:38.088427 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-ea97c104-d25e-438a-a64e-a39be3739657 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Image limits 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 03 08:53:38.089093 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-ea97c104-d25e-438a-a64e-a39be3739657 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Flavor pref 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 03 08:53:38.089808 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-ea97c104-d25e-438a-a64e-a39be3739657 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Image pref 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 03 08:53:38.090388 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-ea97c104-d25e-438a-a64e-a39be3739657 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 03 08:53:38.124563 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ea97c104-d25e-438a-a64e-a39be3739657 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:53:38.125667 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ea97c104-d25e-438a-a64e-a39be3739657 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:53:38.129565 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ea97c104-d25e-438a-a64e-a39be3739657 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:53:38.130024 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ea97c104-d25e-438a-a64e-a39be3739657 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:53:38.185210 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.quota [None req-ea97c104-d25e-438a-a64e-a39be3739657 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Getting quotas for project b9cfd646709540a4a85c64b7aeb5a523. Resources: {'cores', 'ram', 'instances'} {{(pid=123391) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 03 08:53:38.194869 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.quota [None req-ea97c104-d25e-438a-a64e-a39be3739657 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Getting quotas for user f315597388e14d6ca2ffa1397d94fa25 and project b9cfd646709540a4a85c64b7aeb5a523. Resources: {'cores', 'ram', 'instances'} {{(pid=123391) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 03 08:53:38.210422 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ea97c104-d25e-438a-a64e-a39be3739657 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Going to run 1 instances... {{(pid=123391) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 03 08:53:38.222472 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ea97c104-d25e-438a-a64e-a39be3739657 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] [instance: eb1259db-3249-432b-a8a2-f9ed13851671] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd46d67a-108d-4c0c-9f0b-cb6d41c82a32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123391) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 03 08:53:38.363670 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ea97c104-d25e-438a-a64e-a39be3739657 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.765196 May 03 08:53:38.374692 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ec674f0f-5b24-4b0c-ab2f-4f8e98fa02b0 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:53:38.377121 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ec674f0f-5b24-4b0c-ab2f-4f8e98fa02b0 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] [instance: eb1259db-3249-432b-a8a2-f9ed13851671] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:53:38.377918 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1/4] 10.222.0.11 () {60 vars in 1146 bytes} [Tue May 3 08:53:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 4781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 03 08:53:38.527828 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-36ce7117-7ff4-41a5-be56-5918d87700fb tempest-VolumesSnapshotsTestJSON-1899940610 tempest-VolumesSnapshotsTestJSON-1899940610-project] Calling method '.version_select at 0x7f09cfa74f70>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:53:38.740497 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-36ce7117-7ff4-41a5-be56-5918d87700fb tempest-VolumesSnapshotsTestJSON-1899940610 tempest-VolumesSnapshotsTestJSON-1899940610-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/e1448e3c-692f-41c9-b514-ec18429b8070" status: 200 len: 345 microversion: 2.1 time: 0.217608 May 03 08:53:38.741661 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 2/5] 10.222.0.11 () {58 vars in 1244 bytes} [Tue May 3 08:53:38 2022] GET /compute/v2.1/os-volumes/e1448e3c-692f-41c9-b514-ec18429b8070 => generated 345 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:53:38.752929 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-34fee6d6-1e0e-4c31-b070-7a0a0b4a96cb tempest-VolumesSnapshotsTestJSON-1899940610 tempest-VolumesSnapshotsTestJSON-1899940610-project] Action: 'create', calling method: .version_select at 0x7f09cf1ee8b0>, body: {"snapshot": {"volume_id": "e1448e3c-692f-41c9-b514-ec18429b8070", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-978414341"}} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:53:39.241814 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ec674f0f-5b24-4b0c-ab2f-4f8e98fa02b0 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f315597388e14d6ca2ffa1397d94fa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cfd646709540a4a85c64b7aeb5a523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:53:39.277983 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ec674f0f-5b24-4b0c-ab2f-4f8e98fa02b0 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] 10.222.0.11 "GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671" status: 200 len: 1215 microversion: 2.1 time: 0.907009 May 03 08:53:39.285613 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 4/6] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:53:38 2022] GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671 => generated 1215 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 08:53:39.307815 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-563f9990-d6df-47e9-93ec-7d090058e743 tempest-VolumesTestJSON-493488182 tempest-VolumesTestJSON-493488182-project] Calling method '.version_select at 0x7f09d02ef670>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:53:39.385988 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-34fee6d6-1e0e-4c31-b070-7a0a0b4a96cb tempest-VolumesSnapshotsTestJSON-1899940610 tempest-VolumesSnapshotsTestJSON-1899940610-project] 10.222.0.11 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.637446 May 03 08:53:39.386850 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 3/7] 10.222.0.11 () {60 vars in 1161 bytes} [Tue May 3 08:53:38 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 08:53:39.396649 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-220b3729-7455-4d1a-b776-b96fb9feb22e tempest-VolumesSnapshotsTestJSON-1899940610 tempest-VolumesSnapshotsTestJSON-1899940610-project] Calling method '.version_select at 0x7f09cf1ee790>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:53:39.475456 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-220b3729-7455-4d1a-b776-b96fb9feb22e tempest-VolumesSnapshotsTestJSON-1899940610 tempest-VolumesSnapshotsTestJSON-1899940610-project] 10.222.0.11 "GET /compute/v2.1/os-snapshots/10b01c12-f1ff-4997-a808-859943ed0005" status: 200 len: 286 microversion: 2.1 time: 0.082535 May 03 08:53:39.476541 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 4/8] 10.222.0.11 () {58 vars in 1250 bytes} [Tue May 3 08:53:39 2022] GET /compute/v2.1/os-snapshots/10b01c12-f1ff-4997-a808-859943ed0005 => generated 286 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:53:39.483559 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-563f9990-d6df-47e9-93ec-7d090058e743 tempest-VolumesTestJSON-493488182 tempest-VolumesTestJSON-493488182-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/9e32a090-8c79-4847-9664-86f6ff0c1305" status: 200 len: 350 microversion: 2.1 time: 0.196548 May 03 08:53:39.487725 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e193523f-0ab0-4d1b-aa35-d37cf3989aac tempest-VolumesSnapshotsTestJSON-1899940610 tempest-VolumesSnapshotsTestJSON-1899940610-project] Calling method '.version_select at 0x7f09cfa74c10>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:53:39.493977 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 5/9] 10.222.0.11 () {58 vars in 1244 bytes} [Tue May 3 08:53:39 2022] GET /compute/v2.1/os-volumes/9e32a090-8c79-4847-9664-86f6ff0c1305 => generated 350 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:53:39.569713 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e193523f-0ab0-4d1b-aa35-d37cf3989aac tempest-VolumesSnapshotsTestJSON-1899940610 tempest-VolumesSnapshotsTestJSON-1899940610-project] 10.222.0.11 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.086651 May 03 08:53:39.570212 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 5/10] 10.222.0.11 () {58 vars in 1139 bytes} [Tue May 3 08:53:39 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 08:53:39.582141 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-65c8a732-873b-4ec8-9039-b31ec3d0c6da tempest-VolumesSnapshotsTestJSON-1899940610 tempest-VolumesSnapshotsTestJSON-1899940610-project] Calling method '.version_select at 0x7f09d02a5e50>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:53:39.618481 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-65c8a732-873b-4ec8-9039-b31ec3d0c6da tempest-VolumesSnapshotsTestJSON-1899940610 tempest-VolumesSnapshotsTestJSON-1899940610-project] 10.222.0.11 "GET /compute/v2.1/os-snapshots/10b01c12-f1ff-4997-a808-859943ed0005" status: 200 len: 286 microversion: 2.1 time: 0.041302 May 03 08:53:39.619907 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 6/11] 10.222.0.11 () {58 vars in 1250 bytes} [Tue May 3 08:53:39 2022] GET /compute/v2.1/os-snapshots/10b01c12-f1ff-4997-a808-859943ed0005 => generated 286 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:53:40.294523 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-8ad0986e-da38-4bf3-a896-a0057d99edee tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:53:40.295441 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-8ad0986e-da38-4bf3-a896-a0057d99edee tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] [instance: eb1259db-3249-432b-a8a2-f9ed13851671] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:53:40.645419 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-bd043b1b-ad4f-419c-b25c-6bc17dc606c7 tempest-VolumesSnapshotsTestJSON-1899940610 tempest-VolumesSnapshotsTestJSON-1899940610-project] Calling method '.version_select at 0x7f09d02b25e0>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:53:40.803709 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-bd043b1b-ad4f-419c-b25c-6bc17dc606c7 tempest-VolumesSnapshotsTestJSON-1899940610 tempest-VolumesSnapshotsTestJSON-1899940610-project] 10.222.0.11 "GET /compute/v2.1/os-snapshots/10b01c12-f1ff-4997-a808-859943ed0005" status: 200 len: 286 microversion: 2.1 time: 0.165805 May 03 08:53:40.804829 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 7/12] 10.222.0.11 () {58 vars in 1250 bytes} [Tue May 3 08:53:40 2022] GET /compute/v2.1/os-snapshots/10b01c12-f1ff-4997-a808-859943ed0005 => generated 286 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:53:41.054053 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-8ad0986e-da38-4bf3-a896-a0057d99edee tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f315597388e14d6ca2ffa1397d94fa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cfd646709540a4a85c64b7aeb5a523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:53:41.088696 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-8ad0986e-da38-4bf3-a896-a0057d99edee tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] 10.222.0.11 "GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671" status: 200 len: 1215 microversion: 2.1 time: 0.798086 May 03 08:53:41.094384 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 6/13] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:53:40 2022] GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671 => generated 1215 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:53:41.820871 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2692678f-31bf-4626-a9f0-6f852d00ed72 tempest-VolumesSnapshotsTestJSON-1899940610 tempest-VolumesSnapshotsTestJSON-1899940610-project] Calling method '.version_select at 0x7f09d02a5ca0>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:53:41.914257 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-2692678f-31bf-4626-a9f0-6f852d00ed72 tempest-VolumesSnapshotsTestJSON-1899940610 tempest-VolumesSnapshotsTestJSON-1899940610-project] 10.222.0.11 "GET /compute/v2.1/os-snapshots/10b01c12-f1ff-4997-a808-859943ed0005" status: 200 len: 286 microversion: 2.1 time: 0.097581 May 03 08:53:41.919606 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 8/14] 10.222.0.11 () {58 vars in 1250 bytes} [Tue May 3 08:53:41 2022] GET /compute/v2.1/os-snapshots/10b01c12-f1ff-4997-a808-859943ed0005 => generated 286 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:53:42.108723 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f0578ffe-cda6-4bd7-af6a-95340af0fcf6 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:53:42.109338 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f0578ffe-cda6-4bd7-af6a-95340af0fcf6 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] [instance: eb1259db-3249-432b-a8a2-f9ed13851671] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:53:42.134178 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f0578ffe-cda6-4bd7-af6a-95340af0fcf6 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:53:42.145797 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f0578ffe-cda6-4bd7-af6a-95340af0fcf6 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:53:42.146652 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f0578ffe-cda6-4bd7-af6a-95340af0fcf6 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:53:42.149432 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f0578ffe-cda6-4bd7-af6a-95340af0fcf6 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:53:42.534184 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f0578ffe-cda6-4bd7-af6a-95340af0fcf6 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f315597388e14d6ca2ffa1397d94fa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cfd646709540a4a85c64b7aeb5a523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:53:42.551124 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f0578ffe-cda6-4bd7-af6a-95340af0fcf6 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] 10.222.0.11 "GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671" status: 200 len: 1219 microversion: 2.1 time: 0.448127 May 03 08:53:42.557556 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 7/15] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:53:42 2022] GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671 => generated 1219 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:53:42.929130 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-034d8b30-5674-4242-9455-70c72fc4813b tempest-VolumesSnapshotsTestJSON-1899940610 tempest-VolumesSnapshotsTestJSON-1899940610-project] Calling method '.version_select at 0x7f09d034bdc0>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:53:42.983391 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-034d8b30-5674-4242-9455-70c72fc4813b tempest-VolumesSnapshotsTestJSON-1899940610 tempest-VolumesSnapshotsTestJSON-1899940610-project] 10.222.0.11 "GET /compute/v2.1/os-snapshots/10b01c12-f1ff-4997-a808-859943ed0005" status: 200 len: 287 microversion: 2.1 time: 0.060360 May 03 08:53:42.984164 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 9/16] 10.222.0.11 () {58 vars in 1250 bytes} [Tue May 3 08:53:42 2022] GET /compute/v2.1/os-snapshots/10b01c12-f1ff-4997-a808-859943ed0005 => generated 287 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:53:42.994725 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-94712f2f-bb3d-4d58-89b1-083505f9a050 tempest-VolumesSnapshotsTestJSON-1899940610 tempest-VolumesSnapshotsTestJSON-1899940610-project] Calling method '.version_select at 0x7f09cf199d30>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:53:43.115865 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-94712f2f-bb3d-4d58-89b1-083505f9a050 tempest-VolumesSnapshotsTestJSON-1899940610 tempest-VolumesSnapshotsTestJSON-1899940610-project] 10.222.0.11 "DELETE /compute/v2.1/os-snapshots/10b01c12-f1ff-4997-a808-859943ed0005" status: 202 len: 0 microversion: 2.1 time: 0.124992 May 03 08:53:43.116427 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 8/17] 10.222.0.11 () {58 vars in 1253 bytes} [Tue May 3 08:53:42 2022] DELETE /compute/v2.1/os-snapshots/10b01c12-f1ff-4997-a808-859943ed0005 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 08:53:43.126412 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-82ed8296-3901-405b-a792-4d2d07efd4bc tempest-VolumesSnapshotsTestJSON-1899940610 tempest-VolumesSnapshotsTestJSON-1899940610-project] Calling method '.version_select at 0x7f09cf123040>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:53:43.177311 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-82ed8296-3901-405b-a792-4d2d07efd4bc tempest-VolumesSnapshotsTestJSON-1899940610 tempest-VolumesSnapshotsTestJSON-1899940610-project] 10.222.0.11 "GET /compute/v2.1/os-snapshots/10b01c12-f1ff-4997-a808-859943ed0005" status: 200 len: 286 microversion: 2.1 time: 0.055932 May 03 08:53:43.178478 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 9/18] 10.222.0.11 () {58 vars in 1250 bytes} [Tue May 3 08:53:43 2022] GET /compute/v2.1/os-snapshots/10b01c12-f1ff-4997-a808-859943ed0005 => generated 286 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:53:43.443490 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2c774335-978d-4f10-b57c-941828db1b57 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Action: 'create', calling method: .version_select at 0x7f09d02b2280>, body: {"keypair": {"name": "tempest-keypair-1925447370"}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:53:43.489042 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-2c774335-978d-4f10-b57c-941828db1b57 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Getting quotas for project d9159d65c5ca43edadaa60281f20c2ae. Resources: {'key_pairs'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 03 08:53:43.496316 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-2c774335-978d-4f10-b57c-941828db1b57 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Getting quotas for user 027eeadca01b4c4f93b892ef0fbcb195 and project d9159d65c5ca43edadaa60281f20c2ae. Resources: {'key_pairs'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 03 08:53:43.572741 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d82e0930-316f-418f-83fb-ba6b7bcbe65e tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:53:43.573217 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d82e0930-316f-418f-83fb-ba6b7bcbe65e tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] [instance: eb1259db-3249-432b-a8a2-f9ed13851671] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:53:43.582517 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d82e0930-316f-418f-83fb-ba6b7bcbe65e tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:53:43.582962 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d82e0930-316f-418f-83fb-ba6b7bcbe65e tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:53:43.583740 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d82e0930-316f-418f-83fb-ba6b7bcbe65e tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:53:43.584198 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d82e0930-316f-418f-83fb-ba6b7bcbe65e tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:53:43.620118 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-2c774335-978d-4f10-b57c-941828db1b57 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Getting quotas for project d9159d65c5ca43edadaa60281f20c2ae. Resources: {'key_pairs'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 03 08:53:43.628520 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-2c774335-978d-4f10-b57c-941828db1b57 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Getting quotas for user 027eeadca01b4c4f93b892ef0fbcb195 and project d9159d65c5ca43edadaa60281f20c2ae. Resources: {'key_pairs'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 03 08:53:43.646662 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-2c774335-978d-4f10-b57c-941828db1b57 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.617670 May 03 08:53:43.647858 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 10/19] 10.222.0.11 () {60 vars in 1157 bytes} [Tue May 3 08:53:43 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:53:43.798439 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d82e0930-316f-418f-83fb-ba6b7bcbe65e tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f315597388e14d6ca2ffa1397d94fa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cfd646709540a4a85c64b7aeb5a523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:53:43.809684 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d82e0930-316f-418f-83fb-ba6b7bcbe65e tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] 10.222.0.11 "GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671" status: 200 len: 1211 microversion: 2.1 time: 0.240918 May 03 08:53:43.812263 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 10/20] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:53:43 2022] GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671 => generated 1211 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 08:53:44.191219 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b4cd57f3-c75d-4ae7-a59c-adde145b1369 tempest-VolumesSnapshotsTestJSON-1899940610 tempest-VolumesSnapshotsTestJSON-1899940610-project] Calling method '.version_select at 0x7f09d028ac10>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:53:44.262323 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b4cd57f3-c75d-4ae7-a59c-adde145b1369 tempest-VolumesSnapshotsTestJSON-1899940610 tempest-VolumesSnapshotsTestJSON-1899940610-project] 10.222.0.11 "GET /compute/v2.1/os-snapshots/10b01c12-f1ff-4997-a808-859943ed0005" status: 200 len: 286 microversion: 2.1 time: 0.076433 May 03 08:53:44.263442 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 11/21] 10.222.0.11 () {58 vars in 1250 bytes} [Tue May 3 08:53:44 2022] GET /compute/v2.1/os-snapshots/10b01c12-f1ff-4997-a808-859943ed0005 => generated 286 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:53:44.833246 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-89ebda50-0784-439f-afd0-53d806862507 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:53:44.838830 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-89ebda50-0784-439f-afd0-53d806862507 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] [instance: eb1259db-3249-432b-a8a2-f9ed13851671] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:53:44.852883 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-89ebda50-0784-439f-afd0-53d806862507 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:53:44.857744 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-89ebda50-0784-439f-afd0-53d806862507 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:53:44.858802 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-89ebda50-0784-439f-afd0-53d806862507 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:53:44.859431 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-89ebda50-0784-439f-afd0-53d806862507 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:53:45.026459 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-89ebda50-0784-439f-afd0-53d806862507 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f315597388e14d6ca2ffa1397d94fa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cfd646709540a4a85c64b7aeb5a523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:53:45.036097 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-89ebda50-0784-439f-afd0-53d806862507 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] 10.222.0.11 "GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671" status: 200 len: 1211 microversion: 2.1 time: 0.209975 May 03 08:53:45.039098 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 11/22] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:53:44 2022] GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671 => generated 1211 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:53:45.275379 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-af641e17-7973-4e10-96db-87b02a4a966d tempest-VolumesSnapshotsTestJSON-1899940610 tempest-VolumesSnapshotsTestJSON-1899940610-project] Calling method '.version_select at 0x7f09cfa42310>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:53:45.318621 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-af641e17-7973-4e10-96db-87b02a4a966d tempest-VolumesSnapshotsTestJSON-1899940610 tempest-VolumesSnapshotsTestJSON-1899940610-project] 10.222.0.11 "GET /compute/v2.1/os-snapshots/10b01c12-f1ff-4997-a808-859943ed0005" status: 200 len: 286 microversion: 2.1 time: 0.047844 May 03 08:53:45.322454 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 12/23] 10.222.0.11 () {58 vars in 1250 bytes} [Tue May 3 08:53:45 2022] GET /compute/v2.1/os-snapshots/10b01c12-f1ff-4997-a808-859943ed0005 => generated 286 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:53:46.056364 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-54497fc4-12fc-4cb5-9535-ffe1ac9dfbde tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:53:46.057060 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-54497fc4-12fc-4cb5-9535-ffe1ac9dfbde tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] [instance: eb1259db-3249-432b-a8a2-f9ed13851671] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:53:46.078266 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-54497fc4-12fc-4cb5-9535-ffe1ac9dfbde tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:53:46.084311 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-54497fc4-12fc-4cb5-9535-ffe1ac9dfbde tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:53:46.085474 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-54497fc4-12fc-4cb5-9535-ffe1ac9dfbde tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:53:46.086067 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-54497fc4-12fc-4cb5-9535-ffe1ac9dfbde tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:53:46.223520 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-54497fc4-12fc-4cb5-9535-ffe1ac9dfbde tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f315597388e14d6ca2ffa1397d94fa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cfd646709540a4a85c64b7aeb5a523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:53:46.238297 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-54497fc4-12fc-4cb5-9535-ffe1ac9dfbde tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] 10.222.0.11 "GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671" status: 200 len: 1267 microversion: 2.1 time: 0.187182 May 03 08:53:46.247524 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 12/24] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:53:46 2022] GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671 => generated 1267 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:53:46.336031 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-da36f8d7-bd2d-495c-8457-2ed6af67f073 tempest-VolumesSnapshotsTestJSON-1899940610 tempest-VolumesSnapshotsTestJSON-1899940610-project] Calling method '.version_select at 0x7f09cfa429d0>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:53:46.392257 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-da36f8d7-bd2d-495c-8457-2ed6af67f073 tempest-VolumesSnapshotsTestJSON-1899940610 tempest-VolumesSnapshotsTestJSON-1899940610-project] HTTP exception thrown: Snapshot 10b01c12-f1ff-4997-a808-859943ed0005 could not be found. May 03 08:53:46.393170 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-da36f8d7-bd2d-495c-8457-2ed6af67f073 tempest-VolumesSnapshotsTestJSON-1899940610 tempest-VolumesSnapshotsTestJSON-1899940610-project] Returning 404 to user: Snapshot 10b01c12-f1ff-4997-a808-859943ed0005 could not be found. {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 08:53:46.394374 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-da36f8d7-bd2d-495c-8457-2ed6af67f073 tempest-VolumesSnapshotsTestJSON-1899940610 tempest-VolumesSnapshotsTestJSON-1899940610-project] 10.222.0.11 "GET /compute/v2.1/os-snapshots/10b01c12-f1ff-4997-a808-859943ed0005" status: 404 len: 111 microversion: 2.1 time: 0.062868 May 03 08:53:46.395119 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 13/25] 10.222.0.11 () {58 vars in 1250 bytes} [Tue May 3 08:53:46 2022] GET /compute/v2.1/os-snapshots/10b01c12-f1ff-4997-a808-859943ed0005 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 08:53:46.404504 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d52c5873-1fd1-4e96-acf2-8c36f9488e13 tempest-VolumesSnapshotsTestJSON-1899940610 tempest-VolumesSnapshotsTestJSON-1899940610-project] Calling method '.version_select at 0x7f09cf137160>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:53:46.581531 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d52c5873-1fd1-4e96-acf2-8c36f9488e13 tempest-VolumesSnapshotsTestJSON-1899940610 tempest-VolumesSnapshotsTestJSON-1899940610-project] 10.222.0.11 "DELETE /compute/v2.1/os-volumes/e1448e3c-692f-41c9-b514-ec18429b8070" status: 202 len: 0 microversion: 2.1 time: 0.181737 May 03 08:53:46.582362 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 13/26] 10.222.0.11 () {58 vars in 1247 bytes} [Tue May 3 08:53:46 2022] DELETE /compute/v2.1/os-volumes/e1448e3c-692f-41c9-b514-ec18429b8070 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 08:53:46.592514 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-1725442b-f64a-41de-86a3-3369eeabd700 tempest-VolumesSnapshotsTestJSON-1899940610 tempest-VolumesSnapshotsTestJSON-1899940610-project] Calling method '.version_select at 0x7f09d02b2820>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:53:46.717977 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ed3cc4a1-55ba-4c52-a1f9-c781a2669ace tempest-VolumesTestJSON-493488182 tempest-VolumesTestJSON-493488182-project] Calling method '.version_select at 0x7f09cf147ee0>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:53:46.784551 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-1725442b-f64a-41de-86a3-3369eeabd700 tempest-VolumesSnapshotsTestJSON-1899940610 tempest-VolumesSnapshotsTestJSON-1899940610-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/e1448e3c-692f-41c9-b514-ec18429b8070" status: 200 len: 344 microversion: 2.1 time: 0.197347 May 03 08:53:46.788366 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 14/27] 10.222.0.11 () {58 vars in 1244 bytes} [Tue May 3 08:53:46 2022] GET /compute/v2.1/os-volumes/e1448e3c-692f-41c9-b514-ec18429b8070 => generated 344 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:53:46.861408 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b274406f-8828-4b61-a69d-2cafdc459c16 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1410363166", "imageRef": "bd46d67a-108d-4c0c-9f0b-cb6d41c82a32", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d58d27bc-7779-478c-8f00-2b48ab956e47"}], "security_groups": [{"name": "tempest-securitygroup--1984425025"}], "key_name": "tempest-keypair-1925447370", "user_data": "}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:53:46.889710 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ed3cc4a1-55ba-4c52-a1f9-c781a2669ace tempest-VolumesTestJSON-493488182 tempest-VolumesTestJSON-493488182-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/5f5bc902-01fe-4e18-a73c-9dac43cdc836" status: 200 len: 350 microversion: 2.1 time: 0.176406 May 03 08:53:46.890277 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 14/28] 10.222.0.11 () {58 vars in 1244 bytes} [Tue May 3 08:53:46 2022] GET /compute/v2.1/os-volumes/5f5bc902-01fe-4e18-a73c-9dac43cdc836 => generated 350 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 08:53:46.905518 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ff2aa86b-055f-484b-817e-491c39d553e9 tempest-VolumesTestJSON-493488182 tempest-VolumesTestJSON-493488182-project] Calling method '.version_select at 0x7f09cf0f2e50>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:53:47.215095 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ff2aa86b-055f-484b-817e-491c39d553e9 tempest-VolumesTestJSON-493488182 tempest-VolumesTestJSON-493488182-project] 10.222.0.11 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.312914 May 03 08:53:47.215840 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 15/29] 10.222.0.11 () {58 vars in 1133 bytes} [Tue May 3 08:53:46 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:53:47.229588 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e77c63a8-60f6-4302-948c-aacf60964f59 tempest-VolumesTestJSON-493488182 tempest-VolumesTestJSON-493488182-project] Calling method '.version_select at 0x7f09cf0f2af0>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:53:47.388802 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e77c63a8-60f6-4302-948c-aacf60964f59 tempest-VolumesTestJSON-493488182 tempest-VolumesTestJSON-493488182-project] 10.222.0.11 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.164114 May 03 08:53:47.391402 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 16/30] 10.222.0.11 () {58 vars in 1148 bytes} [Tue May 3 08:53:47 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 08:53:47.406451 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-bd647844-8949-49e7-8164-426f2a008e86 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:53:47.407107 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-bd647844-8949-49e7-8164-426f2a008e86 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] [instance: eb1259db-3249-432b-a8a2-f9ed13851671] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:53:47.428498 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bd647844-8949-49e7-8164-426f2a008e86 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:53:47.431305 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bd647844-8949-49e7-8164-426f2a008e86 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:53:47.433608 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bd647844-8949-49e7-8164-426f2a008e86 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:53:47.436674 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bd647844-8949-49e7-8164-426f2a008e86 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:53:47.870631 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-bd647844-8949-49e7-8164-426f2a008e86 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f315597388e14d6ca2ffa1397d94fa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cfd646709540a4a85c64b7aeb5a523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:53:47.883700 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-bd647844-8949-49e7-8164-426f2a008e86 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] 10.222.0.11 "GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671" status: 200 len: 1273 microversion: 2.1 time: 0.483757 May 03 08:53:47.887593 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 17/31] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:53:47 2022] GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671 => generated 1273 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:53:47.897429 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e34b9e96-e1ff-4257-822d-bc73b03b705f tempest-VolumesTestJSON-493488182 tempest-VolumesTestJSON-493488182-project] Calling method '.version_select at 0x7f09d03dad30>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:53:48.050486 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e34b9e96-e1ff-4257-822d-bc73b03b705f tempest-VolumesTestJSON-493488182 tempest-VolumesTestJSON-493488182-project] 10.222.0.11 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.161371 May 03 08:53:48.058368 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 18/32] 10.222.0.11 () {58 vars in 1133 bytes} [Tue May 3 08:53:47 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:53:48.063532 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3d38182f-5c46-43d9-80f0-6cad3ce689a7 tempest-VolumesSnapshotsTestJSON-1899940610 tempest-VolumesSnapshotsTestJSON-1899940610-project] Calling method '.version_select at 0x7f09cf1fdee0>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:53:48.104077 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.network.neutron [None req-b274406f-8828-4b61-a69d-2cafdc459c16 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] validate_networks() for [('d58d27bc-7779-478c-8f00-2b48ab956e47', None, None, None, None, None)] {{(pid=123392) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 03 08:53:48.206988 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.wsgi [None req-3d38182f-5c46-43d9-80f0-6cad3ce689a7 tempest-VolumesSnapshotsTestJSON-1899940610 tempest-VolumesSnapshotsTestJSON-1899940610-project] HTTP exception thrown: Volume e1448e3c-692f-41c9-b514-ec18429b8070 could not be found. May 03 08:53:48.207835 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3d38182f-5c46-43d9-80f0-6cad3ce689a7 tempest-VolumesSnapshotsTestJSON-1899940610 tempest-VolumesSnapshotsTestJSON-1899940610-project] Returning 404 to user: Volume e1448e3c-692f-41c9-b514-ec18429b8070 could not be found. {{(pid=123391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 08:53:48.208995 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-3d38182f-5c46-43d9-80f0-6cad3ce689a7 tempest-VolumesSnapshotsTestJSON-1899940610 tempest-VolumesSnapshotsTestJSON-1899940610-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/e1448e3c-692f-41c9-b514-ec18429b8070" status: 404 len: 109 microversion: 2.1 time: 0.149442 May 03 08:53:48.210136 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 19/33] 10.222.0.11 () {58 vars in 1244 bytes} [Tue May 3 08:53:48 2022] GET /compute/v2.1/os-volumes/e1448e3c-692f-41c9-b514-ec18429b8070 => generated 109 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 08:53:48.220968 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-abc8cb4f-4ceb-4682-bde1-0527f7226c17 tempest-VolumesTestJSON-493488182 tempest-VolumesTestJSON-493488182-project] Calling method '.version_select at 0x7f09cf0f2550>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:53:48.409851 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-abc8cb4f-4ceb-4682-bde1-0527f7226c17 tempest-VolumesTestJSON-493488182 tempest-VolumesTestJSON-493488182-project] 10.222.0.11 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.198169 May 03 08:53:48.411001 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 20/34] 10.222.0.11 () {58 vars in 1166 bytes} [Tue May 3 08:53:48 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:53:48.425651 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c732ca22-bd96-47d7-9d1f-b95795492a98 tempest-VolumesSnapshotsTestJSON-1899940610 tempest-VolumesSnapshotsTestJSON-1899940610-project] Calling method '.version_select at 0x7f09cf199d30>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:53:48.539321 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.wsgi [None req-c732ca22-bd96-47d7-9d1f-b95795492a98 tempest-VolumesSnapshotsTestJSON-1899940610 tempest-VolumesSnapshotsTestJSON-1899940610-project] HTTP exception thrown: Volume e1448e3c-692f-41c9-b514-ec18429b8070 could not be found. May 03 08:53:48.539982 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c732ca22-bd96-47d7-9d1f-b95795492a98 tempest-VolumesSnapshotsTestJSON-1899940610 tempest-VolumesSnapshotsTestJSON-1899940610-project] Returning 404 to user: Volume e1448e3c-692f-41c9-b514-ec18429b8070 could not be found. {{(pid=123391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 08:53:48.541009 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c732ca22-bd96-47d7-9d1f-b95795492a98 tempest-VolumesSnapshotsTestJSON-1899940610 tempest-VolumesSnapshotsTestJSON-1899940610-project] 10.222.0.11 "DELETE /compute/v2.1/os-volumes/e1448e3c-692f-41c9-b514-ec18429b8070" status: 404 len: 109 microversion: 2.1 time: 0.120492 May 03 08:53:48.541859 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 21/35] 10.222.0.11 () {58 vars in 1247 bytes} [Tue May 3 08:53:48 2022] DELETE /compute/v2.1/os-volumes/e1448e3c-692f-41c9-b514-ec18429b8070 => generated 109 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 08:53:48.548068 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-16732462-415d-468a-a696-82f09303832e tempest-VolumesTestJSON-493488182 tempest-VolumesTestJSON-493488182-project] Calling method '.version_select at 0x7f09cf21d310>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:53:48.734891 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-16732462-415d-468a-a696-82f09303832e tempest-VolumesTestJSON-493488182 tempest-VolumesTestJSON-493488182-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.190961 May 03 08:53:48.735792 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 22/36] 10.222.0.11 () {58 vars in 1169 bytes} [Tue May 3 08:53:48 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:53:48.740529 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d5fd4664-c02a-44f8-ac1f-3b39b7a0c16e tempest-VolumesSnapshotsTestJSON-1899940610 tempest-VolumesSnapshotsTestJSON-1899940610-project] Calling method '.version_select at 0x7f09cf199e50>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:53:48.834881 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.wsgi [None req-d5fd4664-c02a-44f8-ac1f-3b39b7a0c16e tempest-VolumesSnapshotsTestJSON-1899940610 tempest-VolumesSnapshotsTestJSON-1899940610-project] HTTP exception thrown: Volume e1448e3c-692f-41c9-b514-ec18429b8070 could not be found. May 03 08:53:48.835707 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d5fd4664-c02a-44f8-ac1f-3b39b7a0c16e tempest-VolumesSnapshotsTestJSON-1899940610 tempest-VolumesSnapshotsTestJSON-1899940610-project] Returning 404 to user: Volume e1448e3c-692f-41c9-b514-ec18429b8070 could not be found. {{(pid=123391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 08:53:48.836903 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d5fd4664-c02a-44f8-ac1f-3b39b7a0c16e tempest-VolumesSnapshotsTestJSON-1899940610 tempest-VolumesSnapshotsTestJSON-1899940610-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/e1448e3c-692f-41c9-b514-ec18429b8070" status: 404 len: 109 microversion: 2.1 time: 0.100033 May 03 08:53:48.844471 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 23/37] 10.222.0.11 () {58 vars in 1244 bytes} [Tue May 3 08:53:48 2022] GET /compute/v2.1/os-volumes/e1448e3c-692f-41c9-b514-ec18429b8070 => generated 109 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 08:53:48.860404 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-22af4a44-b370-4bf4-a18b-f19b1816f261 tempest-VolumesTestJSON-493488182 tempest-VolumesTestJSON-493488182-project] Calling method '.version_select at 0x7f09cf199b80>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:53:49.071453 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-22af4a44-b370-4bf4-a18b-f19b1816f261 tempest-VolumesTestJSON-493488182 tempest-VolumesTestJSON-493488182-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.225293 May 03 08:53:49.079796 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 24/38] 10.222.0.11 () {58 vars in 1154 bytes} [Tue May 3 08:53:48 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:53:49.099683 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c66e4ead-de54-4d5f-942a-47c271581efe tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:53:49.100595 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c66e4ead-de54-4d5f-942a-47c271581efe tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] [instance: eb1259db-3249-432b-a8a2-f9ed13851671] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:53:49.113178 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c66e4ead-de54-4d5f-942a-47c271581efe tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:53:49.115939 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c66e4ead-de54-4d5f-942a-47c271581efe tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:53:49.131390 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c66e4ead-de54-4d5f-942a-47c271581efe tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:53:49.133429 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c66e4ead-de54-4d5f-942a-47c271581efe tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:53:50.538924 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c66e4ead-de54-4d5f-942a-47c271581efe tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f315597388e14d6ca2ffa1397d94fa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cfd646709540a4a85c64b7aeb5a523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:53:50.580380 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c66e4ead-de54-4d5f-942a-47c271581efe tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] 10.222.0.11 "GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671" status: 200 len: 1273 microversion: 2.1 time: 1.481606 May 03 08:53:50.582690 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 25/39] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:53:49 2022] GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671 => generated 1273 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:53:50.600751 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-8ae7d3e5-8d97-4b09-afa3-8a2019b5ca92 tempest-VolumesTestJSON-493488182 tempest-VolumesTestJSON-493488182-project] Calling method '.version_select at 0x7f09cf114a60>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:53:50.819469 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-8ae7d3e5-8d97-4b09-afa3-8a2019b5ca92 tempest-VolumesTestJSON-493488182 tempest-VolumesTestJSON-493488182-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.224485 May 03 08:53:50.820862 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 26/40] 10.222.0.11 () {58 vars in 1187 bytes} [Tue May 3 08:53:50 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:53:50.834836 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-eb50cf3d-0361-4f65-a153-41600a87234f tempest-VolumesTestJSON-493488182 tempest-VolumesTestJSON-493488182-project] Calling method '.version_select at 0x7f09cf1fd8b0>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:53:51.101912 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-eb50cf3d-0361-4f65-a153-41600a87234f tempest-VolumesTestJSON-493488182 tempest-VolumesTestJSON-493488182-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.270951 May 03 08:53:51.110982 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 27/41] 10.222.0.11 () {58 vars in 1154 bytes} [Tue May 3 08:53:50 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:53:51.604760 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-580c1a3e-7043-4461-9435-467cb2dc829a tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:53:51.606126 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-580c1a3e-7043-4461-9435-467cb2dc829a tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] [instance: eb1259db-3249-432b-a8a2-f9ed13851671] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:53:51.639857 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-580c1a3e-7043-4461-9435-467cb2dc829a tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:53:51.640699 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-580c1a3e-7043-4461-9435-467cb2dc829a tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:53:51.641506 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-580c1a3e-7043-4461-9435-467cb2dc829a tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:53:51.644940 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-580c1a3e-7043-4461-9435-467cb2dc829a tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:53:52.326403 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-580c1a3e-7043-4461-9435-467cb2dc829a tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f315597388e14d6ca2ffa1397d94fa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cfd646709540a4a85c64b7aeb5a523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:53:52.346999 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-580c1a3e-7043-4461-9435-467cb2dc829a tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] 10.222.0.11 "GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671" status: 200 len: 1273 microversion: 2.1 time: 0.749646 May 03 08:53:52.351678 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 28/42] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:53:51 2022] GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671 => generated 1273 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:53:53.371397 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-eff9d78c-247a-4d32-93d2-e44166299b3b tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:53:53.372123 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-eff9d78c-247a-4d32-93d2-e44166299b3b tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] [instance: eb1259db-3249-432b-a8a2-f9ed13851671] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:53:53.383758 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-eff9d78c-247a-4d32-93d2-e44166299b3b tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:53:53.396864 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-eff9d78c-247a-4d32-93d2-e44166299b3b tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:53:53.402927 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-eff9d78c-247a-4d32-93d2-e44166299b3b tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:53:53.403604 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-eff9d78c-247a-4d32-93d2-e44166299b3b tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:53:55.234832 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-eff9d78c-247a-4d32-93d2-e44166299b3b tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f315597388e14d6ca2ffa1397d94fa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cfd646709540a4a85c64b7aeb5a523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:53:55.245688 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-eff9d78c-247a-4d32-93d2-e44166299b3b tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] 10.222.0.11 "GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671" status: 200 len: 1315 microversion: 2.1 time: 1.882955 May 03 08:53:55.256105 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 29/43] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:53:53 2022] GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671 => generated 1315 bytes in 1894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:53:55.282232 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-b274406f-8828-4b61-a69d-2cafdc459c16 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Flavor limits 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 03 08:53:55.284884 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-b274406f-8828-4b61-a69d-2cafdc459c16 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Image limits 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 03 08:53:55.286912 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-b274406f-8828-4b61-a69d-2cafdc459c16 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Flavor pref 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 03 08:53:55.287632 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-b274406f-8828-4b61-a69d-2cafdc459c16 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Image pref 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 03 08:53:55.288224 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-b274406f-8828-4b61-a69d-2cafdc459c16 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 03 08:53:55.323242 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b274406f-8828-4b61-a69d-2cafdc459c16 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:53:55.326778 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b274406f-8828-4b61-a69d-2cafdc459c16 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:53:55.342608 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b274406f-8828-4b61-a69d-2cafdc459c16 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:53:55.342608 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b274406f-8828-4b61-a69d-2cafdc459c16 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:53:55.436735 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-b274406f-8828-4b61-a69d-2cafdc459c16 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Getting quotas for project d9159d65c5ca43edadaa60281f20c2ae. Resources: {'cores', 'ram', 'instances'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 03 08:53:55.456080 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-b274406f-8828-4b61-a69d-2cafdc459c16 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Getting quotas for user 027eeadca01b4c4f93b892ef0fbcb195 and project d9159d65c5ca43edadaa60281f20c2ae. Resources: {'cores', 'ram', 'instances'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 03 08:53:55.505690 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b274406f-8828-4b61-a69d-2cafdc459c16 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Going to run 1 instances... {{(pid=123392) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 03 08:53:55.539507 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b274406f-8828-4b61-a69d-2cafdc459c16 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd46d67a-108d-4c0c-9f0b-cb6d41c82a32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 03 08:53:55.763502 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b274406f-8828-4b61-a69d-2cafdc459c16 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 8.905143 May 03 08:53:55.774694 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 15/44] 10.222.0.11 () {60 vars in 1146 bytes} [Tue May 3 08:53:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 8919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 03 08:53:55.779891 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-28eb6f90-d96a-4d9b-a8a4-7a2b8e491379 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:53:55.780637 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-28eb6f90-d96a-4d9b-a8a4-7a2b8e491379 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:53:55.893091 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-28eb6f90-d96a-4d9b-a8a4-7a2b8e491379 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:53:55.900555 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-28eb6f90-d96a-4d9b-a8a4-7a2b8e491379 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1238 microversion: 2.1 time: 0.125293 May 03 08:53:55.903877 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 30/45] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:53:55 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1238 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 08:53:56.272615 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e983acbc-420f-4b6c-a1bb-be6437f6c7f0 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:53:56.273236 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e983acbc-420f-4b6c-a1bb-be6437f6c7f0 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] [instance: eb1259db-3249-432b-a8a2-f9ed13851671] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:53:56.282770 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e983acbc-420f-4b6c-a1bb-be6437f6c7f0 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:53:56.284162 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e983acbc-420f-4b6c-a1bb-be6437f6c7f0 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:53:56.285304 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e983acbc-420f-4b6c-a1bb-be6437f6c7f0 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:53:56.288913 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e983acbc-420f-4b6c-a1bb-be6437f6c7f0 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:53:56.616304 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e983acbc-420f-4b6c-a1bb-be6437f6c7f0 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f315597388e14d6ca2ffa1397d94fa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cfd646709540a4a85c64b7aeb5a523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:53:56.636822 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e983acbc-420f-4b6c-a1bb-be6437f6c7f0 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] 10.222.0.11 "GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671" status: 200 len: 1315 microversion: 2.1 time: 0.371603 May 03 08:53:56.644638 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 31/46] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:53:56 2022] GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671 => generated 1315 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 08:53:57.180591 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e4cf9cfe-fea6-4193-a8a8-5d108970c4b1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Action: 'create', calling method: .version_select at 0x7f09cf9d1d30>, body: {"keypair": {"name": "tempest-keypair-682169449"}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:53:57.277783 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-e4cf9cfe-fea6-4193-a8a8-5d108970c4b1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Getting quotas for project fe13f4f312b145cbb904daebc75026d2. Resources: {'key_pairs'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 03 08:53:57.308588 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-e4cf9cfe-fea6-4193-a8a8-5d108970c4b1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Getting quotas for user 65620fcd12544f7094440d60b094cfb1 and project fe13f4f312b145cbb904daebc75026d2. Resources: {'key_pairs'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 03 08:53:57.565190 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-e4cf9cfe-fea6-4193-a8a8-5d108970c4b1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Getting quotas for project fe13f4f312b145cbb904daebc75026d2. Resources: {'key_pairs'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 03 08:53:57.570471 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-e4cf9cfe-fea6-4193-a8a8-5d108970c4b1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Getting quotas for user 65620fcd12544f7094440d60b094cfb1 and project fe13f4f312b145cbb904daebc75026d2. Resources: {'key_pairs'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 03 08:53:57.611046 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e4cf9cfe-fea6-4193-a8a8-5d108970c4b1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 1.499261 May 03 08:53:57.613139 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 16/47] 10.222.0.11 () {62 vars in 1198 bytes} [Tue May 3 08:53:56 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1504 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) May 03 08:53:57.638060 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d0f5fcd3-3dba-499e-89e4-6ad909e3f804 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:53:57.639012 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d0f5fcd3-3dba-499e-89e4-6ad909e3f804 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:53:57.899724 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d0f5fcd3-3dba-499e-89e4-6ad909e3f804 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:53:57.909673 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d0f5fcd3-3dba-499e-89e4-6ad909e3f804 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1238 microversion: 2.1 time: 0.294671 May 03 08:53:57.912601 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ca5c57ab-95a7-410b-b561-9eebfc86e3fe tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-223868294", "imageRef": "bd46d67a-108d-4c0c-9f0b-cb6d41c82a32", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:53:57.919107 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 17/48] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:53:57 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1238 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:53:57.936868 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c7e2eab6-2a33-40da-abce-656fc4112507 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:53:57.937492 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c7e2eab6-2a33-40da-abce-656fc4112507 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] [instance: eb1259db-3249-432b-a8a2-f9ed13851671] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:53:57.965326 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c7e2eab6-2a33-40da-abce-656fc4112507 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:53:57.965789 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c7e2eab6-2a33-40da-abce-656fc4112507 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:53:57.966580 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c7e2eab6-2a33-40da-abce-656fc4112507 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:53:57.967017 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c7e2eab6-2a33-40da-abce-656fc4112507 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:53:58.092833 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.network.neutron [None req-ca5c57ab-95a7-410b-b561-9eebfc86e3fe tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] validate_networks() for [('bab20d28-0c5b-4bd0-a0b2-15a55898853a', None, None, None, None, None)] {{(pid=123391) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 03 08:53:59.213688 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c7e2eab6-2a33-40da-abce-656fc4112507 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f315597388e14d6ca2ffa1397d94fa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cfd646709540a4a85c64b7aeb5a523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:53:59.232221 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c7e2eab6-2a33-40da-abce-656fc4112507 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] 10.222.0.11 "GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671" status: 200 len: 1315 microversion: 2.1 time: 1.309782 May 03 08:53:59.239025 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 18/49] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:53:57 2022] GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671 => generated 1315 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:53:59.242679 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-dfeeb700-c064-453a-b549-7c150806da43 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:53:59.249799 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-dfeeb700-c064-453a-b549-7c150806da43 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:53:59.297526 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dfeeb700-c064-453a-b549-7c150806da43 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:53:59.300161 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dfeeb700-c064-453a-b549-7c150806da43 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:53:59.304807 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dfeeb700-c064-453a-b549-7c150806da43 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:53:59.306316 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dfeeb700-c064-453a-b549-7c150806da43 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:53:59.645083 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-dfeeb700-c064-453a-b549-7c150806da43 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:53:59.663664 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-dfeeb700-c064-453a-b549-7c150806da43 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1290 microversion: 2.1 time: 0.424743 May 03 08:53:59.665494 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 19/50] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:53:59 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1290 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:00.251129 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-afa9b781-c34e-484f-9263-edc7146077e3 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:00.252351 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-afa9b781-c34e-484f-9263-edc7146077e3 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] [instance: eb1259db-3249-432b-a8a2-f9ed13851671] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:00.278943 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-afa9b781-c34e-484f-9263-edc7146077e3 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:00.281590 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-afa9b781-c34e-484f-9263-edc7146077e3 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:00.282728 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-afa9b781-c34e-484f-9263-edc7146077e3 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:00.286170 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-afa9b781-c34e-484f-9263-edc7146077e3 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:01.636144 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-ca5c57ab-95a7-410b-b561-9eebfc86e3fe tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Flavor limits 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 03 08:54:01.637378 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-ca5c57ab-95a7-410b-b561-9eebfc86e3fe tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Image limits 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 03 08:54:01.638122 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-ca5c57ab-95a7-410b-b561-9eebfc86e3fe tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Flavor pref 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 03 08:54:01.638747 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-ca5c57ab-95a7-410b-b561-9eebfc86e3fe tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Image pref 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 03 08:54:01.639356 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-ca5c57ab-95a7-410b-b561-9eebfc86e3fe tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 03 08:54:01.659949 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ca5c57ab-95a7-410b-b561-9eebfc86e3fe tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:01.665121 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ca5c57ab-95a7-410b-b561-9eebfc86e3fe tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:01.670584 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ca5c57ab-95a7-410b-b561-9eebfc86e3fe tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:01.674733 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ca5c57ab-95a7-410b-b561-9eebfc86e3fe tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:01.755614 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.quota [None req-ca5c57ab-95a7-410b-b561-9eebfc86e3fe tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Getting quotas for project d3ce599e490e457385310fcbca709c84. Resources: {'cores', 'ram', 'instances'} {{(pid=123391) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 03 08:54:01.791166 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.quota [None req-ca5c57ab-95a7-410b-b561-9eebfc86e3fe tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Getting quotas for user e6d1a1b1c3754f0d856df4ca7a8e0269 and project d3ce599e490e457385310fcbca709c84. Resources: {'cores', 'ram', 'instances'} {{(pid=123391) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 03 08:54:01.827707 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ca5c57ab-95a7-410b-b561-9eebfc86e3fe tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Going to run 1 instances... {{(pid=123391) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 03 08:54:01.835231 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ca5c57ab-95a7-410b-b561-9eebfc86e3fe tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: a5e0d581-50da-4cfd-a5da-d35a632c7874] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd46d67a-108d-4c0c-9f0b-cb6d41c82a32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123391) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 03 08:54:02.009446 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ca5c57ab-95a7-410b-b561-9eebfc86e3fe tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.356147 May 03 08:54:02.012317 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 32/51] 10.222.0.11 () {60 vars in 1146 bytes} [Tue May 3 08:53:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 5367 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 03 08:54:02.027917 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f6c87bef-0cb1-4664-bec7-1592fc9f5910 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:02.033806 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f6c87bef-0cb1-4664-bec7-1592fc9f5910 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:02.060461 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f6c87bef-0cb1-4664-bec7-1592fc9f5910 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:02.062824 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f6c87bef-0cb1-4664-bec7-1592fc9f5910 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:02.067443 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f6c87bef-0cb1-4664-bec7-1592fc9f5910 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:02.068079 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f6c87bef-0cb1-4664-bec7-1592fc9f5910 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:02.115140 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-afa9b781-c34e-484f-9263-edc7146077e3 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f315597388e14d6ca2ffa1397d94fa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cfd646709540a4a85c64b7aeb5a523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:02.137056 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-afa9b781-c34e-484f-9263-edc7146077e3 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] 10.222.0.11 "GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671" status: 200 len: 1315 microversion: 2.1 time: 1.890231 May 03 08:54:02.149959 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 20/52] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:00 2022] GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671 => generated 1315 bytes in 1904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 08:54:02.389289 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-10aae799-32c3-467c-880c-45eb684d8965 req-755e92bb-4504-4ee6-9dfb-675b4b9e508c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb1259db-3249-432b-a8a2-f9ed13851671", "tag": "04da02f0-8439-4fde-b108-b007aeba8b59"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:54:02.410907 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-10aae799-32c3-467c-880c-45eb684d8965 req-755e92bb-4504-4ee6-9dfb-675b4b9e508c service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:02.411607 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-10aae799-32c3-467c-880c-45eb684d8965 req-755e92bb-4504-4ee6-9dfb-675b4b9e508c service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:02.465786 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-10aae799-32c3-467c-880c-45eb684d8965 req-755e92bb-4504-4ee6-9dfb-675b4b9e508c service nova] Creating event network-changed:04da02f0-8439-4fde-b108-b007aeba8b59 for instance eb1259db-3249-432b-a8a2-f9ed13851671 on hv-cinder-84027 May 03 08:54:02.466598 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-10aae799-32c3-467c-880c-45eb684d8965 req-755e92bb-4504-4ee6-9dfb-675b4b9e508c service nova] Acquired lock "compute-rpcapi-router" {{(pid=123392) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 03 08:54:02.469218 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0a8f030d-f932-4f97-a7af-85e9fbae1ad9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:02.469864 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0a8f030d-f932-4f97-a7af-85e9fbae1ad9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:02.470948 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0a8f030d-f932-4f97-a7af-85e9fbae1ad9 None None] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:02.471727 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0a8f030d-f932-4f97-a7af-85e9fbae1ad9 None None] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:02.497528 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.compute.rpcapi [None req-0a8f030d-f932-4f97-a7af-85e9fbae1ad9 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 03 08:54:02.498962 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0a8f030d-f932-4f97-a7af-85e9fbae1ad9 None None] Releasing lock "compute-rpcapi-router" {{(pid=123392) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 03 08:54:02.538145 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0a8f030d-f932-4f97-a7af-85e9fbae1ad9 None None] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.386632 May 03 08:54:02.539086 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 21/53] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 08:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:54:02.556909 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b9dcf835-85e9-4bc2-85da-c3c150ed8ab3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:02.557661 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b9dcf835-85e9-4bc2-85da-c3c150ed8ab3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: a5e0d581-50da-4cfd-a5da-d35a632c7874] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:02.624657 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f6c87bef-0cb1-4664-bec7-1592fc9f5910 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:02.639355 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f6c87bef-0cb1-4664-bec7-1592fc9f5910 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1296 microversion: 2.1 time: 0.625212 May 03 08:54:02.640195 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 33/54] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:02 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1296 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:02.688681 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b9dcf835-85e9-4bc2-85da-c3c150ed8ab3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:02.697310 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b9dcf835-85e9-4bc2-85da-c3c150ed8ab3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874" status: 200 len: 1221 microversion: 2.1 time: 0.155536 May 03 08:54:02.699959 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 22/55] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:02 2022] GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874 => generated 1221 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:02.767301 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-62177b16-903e-4434-9156-227c1abc5a41 tempest-VolumesNegativeTest-1962468400 tempest-VolumesNegativeTest-1962468400-project] Action: 'create', calling method: .version_select at 0x7f09cf1148b0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1584099839", "metadata": {"Type": "work"}}} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:54:02.769166 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-62177b16-903e-4434-9156-227c1abc5a41 tempest-VolumesNegativeTest-1962468400 tempest-VolumesNegativeTest-1962468400-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 08:54:02.770158 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-62177b16-903e-4434-9156-227c1abc5a41 tempest-VolumesNegativeTest-1962468400 tempest-VolumesNegativeTest-1962468400-project] 10.222.0.11 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.128879 May 03 08:54:02.771450 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 34/56] 10.222.0.11 () {60 vars in 1155 bytes} [Tue May 3 08:54:02 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 131 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 03 08:54:02.782258 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6927fb8c-0532-4b5e-9993-80f45c7d9e3f tempest-VolumesNegativeTest-1962468400 tempest-VolumesNegativeTest-1962468400-project] Action: 'create', calling method: .version_select at 0x7f09ce95c160>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-963977996", "metadata": {"Type": "work"}}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:54:02.784222 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6927fb8c-0532-4b5e-9993-80f45c7d9e3f tempest-VolumesNegativeTest-1962468400 tempest-VolumesNegativeTest-1962468400-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 08:54:02.785407 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6927fb8c-0532-4b5e-9993-80f45c7d9e3f tempest-VolumesNegativeTest-1962468400 tempest-VolumesNegativeTest-1962468400-project] 10.222.0.11 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008958 May 03 08:54:02.786780 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 23/57] 10.222.0.11 () {60 vars in 1155 bytes} [Tue May 3 08:54:02 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 03 08:54:02.797880 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-08afc189-d7e4-4d3d-b0fd-98e5eae0b70c tempest-VolumesNegativeTest-1962468400 tempest-VolumesNegativeTest-1962468400-project] Action: 'create', calling method: .version_select at 0x7f09cf11ddc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-383775615", "metadata": {"Type": "work"}}} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:54:02.801174 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-08afc189-d7e4-4d3d-b0fd-98e5eae0b70c tempest-VolumesNegativeTest-1962468400 tempest-VolumesNegativeTest-1962468400-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 08:54:02.804881 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-08afc189-d7e4-4d3d-b0fd-98e5eae0b70c tempest-VolumesNegativeTest-1962468400 tempest-VolumesNegativeTest-1962468400-project] 10.222.0.11 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011473 May 03 08:54:02.805846 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 35/58] 10.222.0.11 () {60 vars in 1155 bytes} [Tue May 3 08:54:02 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 03 08:54:02.817587 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-284fb287-6631-4156-ba96-dc1e25e2415b tempest-VolumesNegativeTest-1962468400 tempest-VolumesNegativeTest-1962468400-project] Calling method '.version_select at 0x7f09ce8a5c10>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:02.873026 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-284fb287-6631-4156-ba96-dc1e25e2415b tempest-VolumesNegativeTest-1962468400 tempest-VolumesNegativeTest-1962468400-project] HTTP exception thrown: Volume tempest-invalid-1172858499 could not be found. May 03 08:54:02.873605 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-284fb287-6631-4156-ba96-dc1e25e2415b tempest-VolumesNegativeTest-1962468400 tempest-VolumesNegativeTest-1962468400-project] Returning 404 to user: Volume tempest-invalid-1172858499 could not be found. {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 08:54:02.874413 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-284fb287-6631-4156-ba96-dc1e25e2415b tempest-VolumesNegativeTest-1962468400 tempest-VolumesNegativeTest-1962468400-project] 10.222.0.11 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1172858499" status: 404 len: 99 microversion: 2.1 time: 0.061763 May 03 08:54:02.875716 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 24/59] 10.222.0.11 () {58 vars in 1217 bytes} [Tue May 3 08:54:02 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1172858499 => generated 99 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 03 08:54:02.888279 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-4a873b9c-002e-4c62-8fef-fb9ebe5e4394 tempest-VolumesNegativeTest-1962468400 tempest-VolumesNegativeTest-1962468400-project] 10.222.0.11 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005627 May 03 08:54:02.898227 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 36/60] 10.222.0.11 () {58 vars in 1139 bytes} [Tue May 3 08:54:02 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 03 08:54:02.902059 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-34ccc298-4e68-4ec0-bac6-1bca5d56aa88 tempest-VolumesNegativeTest-1962468400 tempest-VolumesNegativeTest-1962468400-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004379 May 03 08:54:02.904803 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 25/61] 10.222.0.11 () {58 vars in 1136 bytes} [Tue May 3 08:54:02 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 03 08:54:02.919482 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f6b1506a-f8db-43cc-9947-f1dc4c550e8a tempest-VolumesNegativeTest-1962468400 tempest-VolumesNegativeTest-1962468400-project] Calling method '.version_select at 0x7f09cf0f2c10>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:02.939434 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-20331491-7c71-4cd8-8e2c-f4a6a358e485 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1128466172", "imageRef": "bd46d67a-108d-4c0c-9f0b-cb6d41c82a32", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:54:02.983837 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.wsgi [None req-f6b1506a-f8db-43cc-9947-f1dc4c550e8a tempest-VolumesNegativeTest-1962468400 tempest-VolumesNegativeTest-1962468400-project] HTTP exception thrown: Volume 129189ab-02d4-430c-8768-b1a2ad30cd66 could not be found. May 03 08:54:02.984433 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f6b1506a-f8db-43cc-9947-f1dc4c550e8a tempest-VolumesNegativeTest-1962468400 tempest-VolumesNegativeTest-1962468400-project] Returning 404 to user: Volume 129189ab-02d4-430c-8768-b1a2ad30cd66 could not be found. {{(pid=123391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 08:54:02.985743 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f6b1506a-f8db-43cc-9947-f1dc4c550e8a tempest-VolumesNegativeTest-1962468400 tempest-VolumesNegativeTest-1962468400-project] 10.222.0.11 "DELETE /compute/v2.1/os-volumes/129189ab-02d4-430c-8768-b1a2ad30cd66" status: 404 len: 109 microversion: 2.1 time: 0.070899 May 03 08:54:02.992545 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 37/62] 10.222.0.11 () {58 vars in 1247 bytes} [Tue May 3 08:54:02 2022] DELETE /compute/v2.1/os-volumes/129189ab-02d4-430c-8768-b1a2ad30cd66 => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 08:54:02.999052 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f146d748-e0eb-48b5-b51d-d68afebc1800 tempest-VolumesNegativeTest-1962468400 tempest-VolumesNegativeTest-1962468400-project] Calling method '.version_select at 0x7f09cf114f70>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:03.075236 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.wsgi [None req-f146d748-e0eb-48b5-b51d-d68afebc1800 tempest-VolumesNegativeTest-1962468400 tempest-VolumesNegativeTest-1962468400-project] HTTP exception thrown: Volume a81a9467-166e-4711-8144-8a3cfd99c345 could not be found. May 03 08:54:03.076106 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f146d748-e0eb-48b5-b51d-d68afebc1800 tempest-VolumesNegativeTest-1962468400 tempest-VolumesNegativeTest-1962468400-project] Returning 404 to user: Volume a81a9467-166e-4711-8144-8a3cfd99c345 could not be found. {{(pid=123391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 08:54:03.077354 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f146d748-e0eb-48b5-b51d-d68afebc1800 tempest-VolumesNegativeTest-1962468400 tempest-VolumesNegativeTest-1962468400-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/a81a9467-166e-4711-8144-8a3cfd99c345" status: 404 len: 109 microversion: 2.1 time: 0.082703 May 03 08:54:03.093572 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 38/63] 10.222.0.11 () {58 vars in 1244 bytes} [Tue May 3 08:54:02 2022] GET /compute/v2.1/os-volumes/a81a9467-166e-4711-8144-8a3cfd99c345 => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 08:54:03.109107 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.network.neutron [None req-20331491-7c71-4cd8-8e2c-f4a6a358e485 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] validate_networks() for [('bab20d28-0c5b-4bd0-a0b2-15a55898853a', None, None, None, None, None)] {{(pid=123392) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 03 08:54:03.156916 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d7a3fcbd-43a4-440b-a00f-8e8fc674579d tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:03.157949 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d7a3fcbd-43a4-440b-a00f-8e8fc674579d tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] [instance: eb1259db-3249-432b-a8a2-f9ed13851671] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:03.168893 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d7a3fcbd-43a4-440b-a00f-8e8fc674579d tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:03.169761 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d7a3fcbd-43a4-440b-a00f-8e8fc674579d tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:03.176444 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d7a3fcbd-43a4-440b-a00f-8e8fc674579d tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:03.177206 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d7a3fcbd-43a4-440b-a00f-8e8fc674579d tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:03.958127 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d7a3fcbd-43a4-440b-a00f-8e8fc674579d tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f315597388e14d6ca2ffa1397d94fa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cfd646709540a4a85c64b7aeb5a523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:03.969415 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d7a3fcbd-43a4-440b-a00f-8e8fc674579d tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] 10.222.0.11 "GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671" status: 200 len: 1315 microversion: 2.1 time: 0.816935 May 03 08:54:03.980918 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 39/64] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:03 2022] GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671 => generated 1315 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 08:54:03.981684 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-da899f78-78ec-4f56-bbd0-3b7f7bf2a9c3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:03.982303 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-da899f78-78ec-4f56-bbd0-3b7f7bf2a9c3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:04.000243 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-da899f78-78ec-4f56-bbd0-3b7f7bf2a9c3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:04.000707 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-da899f78-78ec-4f56-bbd0-3b7f7bf2a9c3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:04.001489 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-da899f78-78ec-4f56-bbd0-3b7f7bf2a9c3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:04.001918 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-da899f78-78ec-4f56-bbd0-3b7f7bf2a9c3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:04.140570 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-da899f78-78ec-4f56-bbd0-3b7f7bf2a9c3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:04.148860 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-da899f78-78ec-4f56-bbd0-3b7f7bf2a9c3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1296 microversion: 2.1 time: 0.175729 May 03 08:54:04.149555 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 40/65] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:03 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1296 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:04.436690 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-20331491-7c71-4cd8-8e2c-f4a6a358e485 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Flavor limits 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 03 08:54:04.437207 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-20331491-7c71-4cd8-8e2c-f4a6a358e485 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Image limits 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 03 08:54:04.437581 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-20331491-7c71-4cd8-8e2c-f4a6a358e485 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Flavor pref 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 03 08:54:04.437991 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-20331491-7c71-4cd8-8e2c-f4a6a358e485 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Image pref 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 03 08:54:04.438404 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-20331491-7c71-4cd8-8e2c-f4a6a358e485 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 03 08:54:04.492619 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-20331491-7c71-4cd8-8e2c-f4a6a358e485 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:04.493135 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-20331491-7c71-4cd8-8e2c-f4a6a358e485 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:04.494560 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-20331491-7c71-4cd8-8e2c-f4a6a358e485 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:04.495010 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-20331491-7c71-4cd8-8e2c-f4a6a358e485 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:04.536108 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-20331491-7c71-4cd8-8e2c-f4a6a358e485 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Getting quotas for project d3ce599e490e457385310fcbca709c84. Resources: {'cores', 'ram', 'instances'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 03 08:54:04.547179 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-20331491-7c71-4cd8-8e2c-f4a6a358e485 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Getting quotas for user e6d1a1b1c3754f0d856df4ca7a8e0269 and project d3ce599e490e457385310fcbca709c84. Resources: {'cores', 'ram', 'instances'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 03 08:54:04.571405 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-cef4bcd4-450a-4566-950d-e73eb86aa54d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-759768782", "imageRef": "bd46d67a-108d-4c0c-9f0b-cb6d41c82a32", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fde0bcc1-b261-4b01-8a8d-d9324b6fc096"}], "security_groups": [{"name": "tempest-securitygroup--1646026349"}], "key_name": "tempest-keypair-682169449", "user_data": "}} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:54:04.573243 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-20331491-7c71-4cd8-8e2c-f4a6a358e485 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Going to run 1 instances... {{(pid=123392) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 03 08:54:04.575744 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-20331491-7c71-4cd8-8e2c-f4a6a358e485 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd46d67a-108d-4c0c-9f0b-cb6d41c82a32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 03 08:54:04.651975 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-20331491-7c71-4cd8-8e2c-f4a6a358e485 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.722227 May 03 08:54:04.653419 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 26/66] 10.222.0.11 () {60 vars in 1146 bytes} [Tue May 3 08:54:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 1724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 03 08:54:04.663360 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-14ad2e5e-1b24-4955-bd49-870380d58d4a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:04.664367 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-14ad2e5e-1b24-4955-bd49-870380d58d4a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:04.959942 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-14ad2e5e-1b24-4955-bd49-870380d58d4a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:04.969435 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-14ad2e5e-1b24-4955-bd49-870380d58d4a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1222 microversion: 2.1 time: 0.310325 May 03 08:54:04.970026 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 27/67] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:04 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1222 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 08:54:04.991580 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-93e983dc-f372-4272-9d03-d80e764f2e94 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:04.992833 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-93e983dc-f372-4272-9d03-d80e764f2e94 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] [instance: eb1259db-3249-432b-a8a2-f9ed13851671] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:05.002525 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-93e983dc-f372-4272-9d03-d80e764f2e94 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:05.003188 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-93e983dc-f372-4272-9d03-d80e764f2e94 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:05.004504 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-93e983dc-f372-4272-9d03-d80e764f2e94 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:05.005110 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-93e983dc-f372-4272-9d03-d80e764f2e94 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:05.032265 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.network.neutron [None req-cef4bcd4-450a-4566-950d-e73eb86aa54d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] validate_networks() for [('fde0bcc1-b261-4b01-8a8d-d9324b6fc096', None, None, None, None, None)] {{(pid=123391) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 03 08:54:05.356332 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-93e983dc-f372-4272-9d03-d80e764f2e94 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f315597388e14d6ca2ffa1397d94fa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cfd646709540a4a85c64b7aeb5a523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:05.365409 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-93e983dc-f372-4272-9d03-d80e764f2e94 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] 10.222.0.11 "GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671" status: 200 len: 1315 microversion: 2.1 time: 0.380254 May 03 08:54:05.374259 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 28/68] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:04 2022] GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671 => generated 1315 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:05.390680 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-81eeecca-5e01-46a2-bc17-12a8266b23c3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:05.394558 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-81eeecca-5e01-46a2-bc17-12a8266b23c3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:05.404525 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-81eeecca-5e01-46a2-bc17-12a8266b23c3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:05.405223 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-81eeecca-5e01-46a2-bc17-12a8266b23c3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:05.406321 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-81eeecca-5e01-46a2-bc17-12a8266b23c3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:05.411226 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-81eeecca-5e01-46a2-bc17-12a8266b23c3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:05.668111 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-81eeecca-5e01-46a2-bc17-12a8266b23c3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:05.675160 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-81eeecca-5e01-46a2-bc17-12a8266b23c3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1364 microversion: 2.1 time: 0.299822 May 03 08:54:05.677539 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 29/69] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:05 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1364 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:05.759461 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-cef4bcd4-450a-4566-950d-e73eb86aa54d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Flavor limits 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 03 08:54:05.759461 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-cef4bcd4-450a-4566-950d-e73eb86aa54d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Image limits 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 03 08:54:05.759461 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-cef4bcd4-450a-4566-950d-e73eb86aa54d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Flavor pref 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 03 08:54:05.759461 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-cef4bcd4-450a-4566-950d-e73eb86aa54d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Image pref 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 03 08:54:05.759461 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-cef4bcd4-450a-4566-950d-e73eb86aa54d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 03 08:54:05.771695 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cef4bcd4-450a-4566-950d-e73eb86aa54d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:05.772293 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cef4bcd4-450a-4566-950d-e73eb86aa54d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:05.772961 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cef4bcd4-450a-4566-950d-e73eb86aa54d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:05.773546 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cef4bcd4-450a-4566-950d-e73eb86aa54d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:05.793601 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.quota [None req-cef4bcd4-450a-4566-950d-e73eb86aa54d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Getting quotas for project fe13f4f312b145cbb904daebc75026d2. Resources: {'cores', 'ram', 'instances'} {{(pid=123391) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 03 08:54:05.797461 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.quota [None req-cef4bcd4-450a-4566-950d-e73eb86aa54d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Getting quotas for user 65620fcd12544f7094440d60b094cfb1 and project fe13f4f312b145cbb904daebc75026d2. Resources: {'cores', 'ram', 'instances'} {{(pid=123391) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 03 08:54:05.808740 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-cef4bcd4-450a-4566-950d-e73eb86aa54d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Going to run 1 instances... {{(pid=123391) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 03 08:54:05.810870 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-cef4bcd4-450a-4566-950d-e73eb86aa54d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd46d67a-108d-4c0c-9f0b-cb6d41c82a32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123391) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 03 08:54:05.871252 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-cef4bcd4-450a-4566-950d-e73eb86aa54d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.304875 May 03 08:54:05.876931 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 41/70] 10.222.0.11 () {62 vars in 1187 bytes} [Tue May 3 08:54:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 1311 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 03 08:54:05.887478 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-3a78c583-127b-4b4f-891d-97e662afb17c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:05.888305 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-3a78c583-127b-4b4f-891d-97e662afb17c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:05.957896 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-3a78c583-127b-4b4f-891d-97e662afb17c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:05.966265 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-3a78c583-127b-4b4f-891d-97e662afb17c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:05.969704 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-3a78c583-127b-4b4f-891d-97e662afb17c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:05.971006 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-3a78c583-127b-4b4f-891d-97e662afb17c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1280 microversion: 2.20 time: 0.087571 May 03 08:54:05.983534 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 30/71] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:54:05 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1280 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:54:05.987703 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ee216a2e-b16f-41ba-9553-16b1ff897686 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:05.988758 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ee216a2e-b16f-41ba-9553-16b1ff897686 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:06.004816 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ee216a2e-b16f-41ba-9553-16b1ff897686 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:06.005655 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ee216a2e-b16f-41ba-9553-16b1ff897686 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:06.009191 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ee216a2e-b16f-41ba-9553-16b1ff897686 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:06.009749 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ee216a2e-b16f-41ba-9553-16b1ff897686 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:06.098434 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ee216a2e-b16f-41ba-9553-16b1ff897686 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:06.108651 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ee216a2e-b16f-41ba-9553-16b1ff897686 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1226 microversion: 2.1 time: 0.124818 May 03 08:54:06.108651 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 42/72] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:05 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1226 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:06.382916 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5534492a-3298-4f6a-a82e-51fb7c0bc852 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:06.383663 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5534492a-3298-4f6a-a82e-51fb7c0bc852 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] [instance: eb1259db-3249-432b-a8a2-f9ed13851671] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:06.393836 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5534492a-3298-4f6a-a82e-51fb7c0bc852 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:06.394330 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5534492a-3298-4f6a-a82e-51fb7c0bc852 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:06.395138 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5534492a-3298-4f6a-a82e-51fb7c0bc852 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:06.395579 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5534492a-3298-4f6a-a82e-51fb7c0bc852 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:06.567957 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5534492a-3298-4f6a-a82e-51fb7c0bc852 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f315597388e14d6ca2ffa1397d94fa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cfd646709540a4a85c64b7aeb5a523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:06.576042 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5534492a-3298-4f6a-a82e-51fb7c0bc852 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] 10.222.0.11 "GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671" status: 200 len: 1315 microversion: 2.1 time: 0.197196 May 03 08:54:06.577179 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 31/73] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:06 2022] GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:06.702373 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a9b64560-451a-4b4a-ad9a-b5f579aeceff tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:06.703384 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a9b64560-451a-4b4a-ad9a-b5f579aeceff tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:06.709561 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a9b64560-451a-4b4a-ad9a-b5f579aeceff tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:06.710118 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a9b64560-451a-4b4a-ad9a-b5f579aeceff tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:06.711052 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a9b64560-451a-4b4a-ad9a-b5f579aeceff tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:06.711604 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a9b64560-451a-4b4a-ad9a-b5f579aeceff tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:06.842820 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a9b64560-451a-4b4a-ad9a-b5f579aeceff tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:06.850429 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a9b64560-451a-4b4a-ad9a-b5f579aeceff tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1364 microversion: 2.1 time: 0.152033 May 03 08:54:06.864794 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 43/74] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:06 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:06.994250 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a53324db-5ae6-473e-b3ed-8e4ecbf96704 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:06.994843 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a53324db-5ae6-473e-b3ed-8e4ecbf96704 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:07.003128 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a53324db-5ae6-473e-b3ed-8e4ecbf96704 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:07.004245 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a53324db-5ae6-473e-b3ed-8e4ecbf96704 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:07.005048 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a53324db-5ae6-473e-b3ed-8e4ecbf96704 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:07.005491 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a53324db-5ae6-473e-b3ed-8e4ecbf96704 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:07.075222 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a53324db-5ae6-473e-b3ed-8e4ecbf96704 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:07.084566 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a53324db-5ae6-473e-b3ed-8e4ecbf96704 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:07.086393 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a53324db-5ae6-473e-b3ed-8e4ecbf96704 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:07.087537 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a53324db-5ae6-473e-b3ed-8e4ecbf96704 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1284 microversion: 2.20 time: 0.097362 May 03 08:54:07.088121 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 32/75] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:54:06 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:54:07.127414 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-6ec0a149-84fc-4f8d-9ceb-c5264b89a431 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:07.128751 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-6ec0a149-84fc-4f8d-9ceb-c5264b89a431 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:07.135468 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6ec0a149-84fc-4f8d-9ceb-c5264b89a431 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:07.135953 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6ec0a149-84fc-4f8d-9ceb-c5264b89a431 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:07.136722 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6ec0a149-84fc-4f8d-9ceb-c5264b89a431 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:07.137154 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6ec0a149-84fc-4f8d-9ceb-c5264b89a431 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:07.217525 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-6ec0a149-84fc-4f8d-9ceb-c5264b89a431 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:07.225749 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-6ec0a149-84fc-4f8d-9ceb-c5264b89a431 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1226 microversion: 2.1 time: 0.104323 May 03 08:54:07.226863 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 44/76] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:07 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1226 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:07.593877 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c160541a-b11c-4da0-866d-b7a198f83567 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:07.594493 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c160541a-b11c-4da0-866d-b7a198f83567 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] [instance: eb1259db-3249-432b-a8a2-f9ed13851671] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:07.600325 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c160541a-b11c-4da0-866d-b7a198f83567 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:07.600944 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c160541a-b11c-4da0-866d-b7a198f83567 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:07.601947 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c160541a-b11c-4da0-866d-b7a198f83567 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:07.602530 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c160541a-b11c-4da0-866d-b7a198f83567 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:07.771966 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c160541a-b11c-4da0-866d-b7a198f83567 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f315597388e14d6ca2ffa1397d94fa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cfd646709540a4a85c64b7aeb5a523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:07.780229 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c160541a-b11c-4da0-866d-b7a198f83567 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] 10.222.0.11 "GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671" status: 200 len: 1315 microversion: 2.1 time: 0.190233 May 03 08:54:07.781148 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 33/77] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:07 2022] GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:07.872054 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-eae9ffbf-bafb-4ccc-ac3c-a3feae85cd87 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:07.872887 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-eae9ffbf-bafb-4ccc-ac3c-a3feae85cd87 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:07.880903 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-eae9ffbf-bafb-4ccc-ac3c-a3feae85cd87 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:07.881556 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-eae9ffbf-bafb-4ccc-ac3c-a3feae85cd87 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:07.882667 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-eae9ffbf-bafb-4ccc-ac3c-a3feae85cd87 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:07.883126 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-eae9ffbf-bafb-4ccc-ac3c-a3feae85cd87 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:08.048819 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-eae9ffbf-bafb-4ccc-ac3c-a3feae85cd87 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:08.057456 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-eae9ffbf-bafb-4ccc-ac3c-a3feae85cd87 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1364 microversion: 2.1 time: 0.189463 May 03 08:54:08.058027 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 45/78] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:07 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1364 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:08.106106 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-eeaf98d1-d2fd-4362-8125-df99b4b33758 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:08.106711 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-eeaf98d1-d2fd-4362-8125-df99b4b33758 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:08.113158 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-eeaf98d1-d2fd-4362-8125-df99b4b33758 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:08.113877 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-eeaf98d1-d2fd-4362-8125-df99b4b33758 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:08.114899 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-eeaf98d1-d2fd-4362-8125-df99b4b33758 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:08.115560 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-eeaf98d1-d2fd-4362-8125-df99b4b33758 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:08.180724 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-eeaf98d1-d2fd-4362-8125-df99b4b33758 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:08.188454 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-eeaf98d1-d2fd-4362-8125-df99b4b33758 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:08.189968 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-eeaf98d1-d2fd-4362-8125-df99b4b33758 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:08.191077 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-eeaf98d1-d2fd-4362-8125-df99b4b33758 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1284 microversion: 2.20 time: 0.089452 May 03 08:54:08.199312 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 34/79] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:54:08 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 08:54:08.242564 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-14939b6d-6eda-4e91-9d11-93af82643a58 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:08.243256 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-14939b6d-6eda-4e91-9d11-93af82643a58 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:08.250032 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-14939b6d-6eda-4e91-9d11-93af82643a58 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:08.250514 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-14939b6d-6eda-4e91-9d11-93af82643a58 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:08.251413 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-14939b6d-6eda-4e91-9d11-93af82643a58 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:08.251884 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-14939b6d-6eda-4e91-9d11-93af82643a58 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:08.312187 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-14939b6d-6eda-4e91-9d11-93af82643a58 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:08.319710 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-14939b6d-6eda-4e91-9d11-93af82643a58 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1226 microversion: 2.1 time: 0.081052 May 03 08:54:08.320430 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 46/80] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:08 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:08.798343 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-04307570-3b2a-4042-8128-c90eee5b417d tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:08.798998 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-04307570-3b2a-4042-8128-c90eee5b417d tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] [instance: eb1259db-3249-432b-a8a2-f9ed13851671] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:08.805861 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-04307570-3b2a-4042-8128-c90eee5b417d tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:08.806320 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-04307570-3b2a-4042-8128-c90eee5b417d tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:08.807094 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-04307570-3b2a-4042-8128-c90eee5b417d tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:08.807524 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-04307570-3b2a-4042-8128-c90eee5b417d tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:08.939335 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-04307570-3b2a-4042-8128-c90eee5b417d tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f315597388e14d6ca2ffa1397d94fa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cfd646709540a4a85c64b7aeb5a523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:08.946794 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-04307570-3b2a-4042-8128-c90eee5b417d tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] 10.222.0.11 "GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671" status: 200 len: 1315 microversion: 2.1 time: 0.152384 May 03 08:54:08.947354 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 35/81] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:08 2022] GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:09.074270 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ed6539e1-fe2f-42f5-a24d-7f2b568abcf5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:09.074941 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ed6539e1-fe2f-42f5-a24d-7f2b568abcf5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:09.085536 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ed6539e1-fe2f-42f5-a24d-7f2b568abcf5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:09.086261 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ed6539e1-fe2f-42f5-a24d-7f2b568abcf5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:09.087119 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ed6539e1-fe2f-42f5-a24d-7f2b568abcf5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:09.087464 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ed6539e1-fe2f-42f5-a24d-7f2b568abcf5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:09.215863 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-12b45845-f962-482e-994e-765436cca544 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:09.216483 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-12b45845-f962-482e-994e-765436cca544 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:09.222672 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-12b45845-f962-482e-994e-765436cca544 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:09.223307 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-12b45845-f962-482e-994e-765436cca544 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:09.224107 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-12b45845-f962-482e-994e-765436cca544 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:09.224529 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-12b45845-f962-482e-994e-765436cca544 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:09.242451 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ed6539e1-fe2f-42f5-a24d-7f2b568abcf5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:09.249588 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ed6539e1-fe2f-42f5-a24d-7f2b568abcf5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1364 microversion: 2.1 time: 0.179293 May 03 08:54:09.250142 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 47/82] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:09 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1364 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:09.284834 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-12b45845-f962-482e-994e-765436cca544 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:09.292805 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-12b45845-f962-482e-994e-765436cca544 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:09.294313 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-12b45845-f962-482e-994e-765436cca544 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:09.295405 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-12b45845-f962-482e-994e-765436cca544 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1284 microversion: 2.20 time: 0.089946 May 03 08:54:09.296167 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 36/83] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:54:09 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:54:09.335635 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-91c54e88-ca40-4fc6-908e-0e6ca797cda1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:09.336421 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-91c54e88-ca40-4fc6-908e-0e6ca797cda1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:09.342560 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-91c54e88-ca40-4fc6-908e-0e6ca797cda1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:09.343006 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-91c54e88-ca40-4fc6-908e-0e6ca797cda1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:09.343756 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-91c54e88-ca40-4fc6-908e-0e6ca797cda1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:09.344219 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-91c54e88-ca40-4fc6-908e-0e6ca797cda1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:09.403705 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-91c54e88-ca40-4fc6-908e-0e6ca797cda1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:09.411394 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-91c54e88-ca40-4fc6-908e-0e6ca797cda1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1226 microversion: 2.1 time: 0.079602 May 03 08:54:09.411982 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 48/84] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:09 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:09.963857 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c6bf4f21-f679-42e6-95d6-a77fadb691ee tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:09.964539 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c6bf4f21-f679-42e6-95d6-a77fadb691ee tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] [instance: eb1259db-3249-432b-a8a2-f9ed13851671] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:09.971609 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c6bf4f21-f679-42e6-95d6-a77fadb691ee tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:09.972204 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c6bf4f21-f679-42e6-95d6-a77fadb691ee tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:09.973146 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c6bf4f21-f679-42e6-95d6-a77fadb691ee tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:09.973516 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c6bf4f21-f679-42e6-95d6-a77fadb691ee tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:10.266084 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-09da7e2e-6a3a-43a2-ba75-255ccb330f6e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:10.266705 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-09da7e2e-6a3a-43a2-ba75-255ccb330f6e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:10.275907 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-09da7e2e-6a3a-43a2-ba75-255ccb330f6e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:10.282860 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-09da7e2e-6a3a-43a2-ba75-255ccb330f6e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:10.284468 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-09da7e2e-6a3a-43a2-ba75-255ccb330f6e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:10.285064 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-09da7e2e-6a3a-43a2-ba75-255ccb330f6e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:10.597841 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c6bf4f21-f679-42e6-95d6-a77fadb691ee tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f315597388e14d6ca2ffa1397d94fa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cfd646709540a4a85c64b7aeb5a523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:10.602365 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c6bf4f21-f679-42e6-95d6-a77fadb691ee tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] 10.222.0.11 "GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671" status: 200 len: 1315 microversion: 2.1 time: 0.642411 May 03 08:54:10.602948 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 37/85] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:09 2022] GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671 => generated 1315 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:10.615861 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-aeedda82-6dc4-4d35-be6c-054e4057e817 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:10.620798 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-aeedda82-6dc4-4d35-be6c-054e4057e817 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:10.627348 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aeedda82-6dc4-4d35-be6c-054e4057e817 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:10.628049 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aeedda82-6dc4-4d35-be6c-054e4057e817 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:10.630388 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aeedda82-6dc4-4d35-be6c-054e4057e817 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:10.630988 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aeedda82-6dc4-4d35-be6c-054e4057e817 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:10.703701 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-09da7e2e-6a3a-43a2-ba75-255ccb330f6e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:10.715509 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-09da7e2e-6a3a-43a2-ba75-255ccb330f6e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1364 microversion: 2.1 time: 0.453832 May 03 08:54:10.726842 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 49/86] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:10 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1364 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 08:54:10.733099 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a4a85261-a0e1-4366-8f1f-d4ea053029fc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:10.733958 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a4a85261-a0e1-4366-8f1f-d4ea053029fc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:10.748313 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a4a85261-a0e1-4366-8f1f-d4ea053029fc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:10.748769 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a4a85261-a0e1-4366-8f1f-d4ea053029fc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:10.749541 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a4a85261-a0e1-4366-8f1f-d4ea053029fc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:10.749967 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a4a85261-a0e1-4366-8f1f-d4ea053029fc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:10.759751 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-aeedda82-6dc4-4d35-be6c-054e4057e817 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:10.767730 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-aeedda82-6dc4-4d35-be6c-054e4057e817 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:10.772033 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-aeedda82-6dc4-4d35-be6c-054e4057e817 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:10.773162 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-aeedda82-6dc4-4d35-be6c-054e4057e817 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1332 microversion: 2.20 time: 0.169319 May 03 08:54:10.774059 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 38/87] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:54:10 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1332 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:54:10.864183 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a4a85261-a0e1-4366-8f1f-d4ea053029fc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:10.872477 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a4a85261-a0e1-4366-8f1f-d4ea053029fc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1274 microversion: 2.1 time: 0.143831 May 03 08:54:10.882660 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 50/88] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:10 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1274 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:11.288760 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-78b9465f-0d74-4b4e-bfd9-9cd43f9174c6 req-050fd792-8ce2-4257-b11a-19251a45db9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "309e7477-cc5c-4422-ac1e-46d32bc3991b", "tag": "a1780ecc-31ca-4cfd-88ae-8e55c35791d7"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:54:11.305182 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-78b9465f-0d74-4b4e-bfd9-9cd43f9174c6 req-050fd792-8ce2-4257-b11a-19251a45db9f service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:11.305858 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-78b9465f-0d74-4b4e-bfd9-9cd43f9174c6 req-050fd792-8ce2-4257-b11a-19251a45db9f service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:11.324200 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-78b9465f-0d74-4b4e-bfd9-9cd43f9174c6 req-050fd792-8ce2-4257-b11a-19251a45db9f service nova] Creating event network-changed:a1780ecc-31ca-4cfd-88ae-8e55c35791d7 for instance 309e7477-cc5c-4422-ac1e-46d32bc3991b on hv-cinder-84027 May 03 08:54:11.329546 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-78b9465f-0d74-4b4e-bfd9-9cd43f9174c6 req-050fd792-8ce2-4257-b11a-19251a45db9f service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044440 May 03 08:54:11.330261 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 39/89] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 08:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:54:11.618451 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3763f6b5-908e-4fb3-80ee-604094f49160 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:11.619066 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-3763f6b5-908e-4fb3-80ee-604094f49160 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] [instance: eb1259db-3249-432b-a8a2-f9ed13851671] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:11.625380 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3763f6b5-908e-4fb3-80ee-604094f49160 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:11.625829 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3763f6b5-908e-4fb3-80ee-604094f49160 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:11.626587 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3763f6b5-908e-4fb3-80ee-604094f49160 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:11.627013 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3763f6b5-908e-4fb3-80ee-604094f49160 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:11.733114 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-facd6f50-4ada-4d2d-aef4-3d996ca12a06 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:11.733946 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-facd6f50-4ada-4d2d-aef4-3d996ca12a06 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:11.740464 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-facd6f50-4ada-4d2d-aef4-3d996ca12a06 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:11.741003 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-facd6f50-4ada-4d2d-aef4-3d996ca12a06 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:11.741839 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-facd6f50-4ada-4d2d-aef4-3d996ca12a06 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:11.742334 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-facd6f50-4ada-4d2d-aef4-3d996ca12a06 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:11.756078 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-3763f6b5-908e-4fb3-80ee-604094f49160 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f315597388e14d6ca2ffa1397d94fa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cfd646709540a4a85c64b7aeb5a523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:11.764080 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-3763f6b5-908e-4fb3-80ee-604094f49160 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] 10.222.0.11 "GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671" status: 200 len: 1315 microversion: 2.1 time: 0.149451 May 03 08:54:11.764755 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 51/90] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:11 2022] GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:11.795224 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-06117f24-04ce-40f0-8e0b-ed5752ee8799 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:11.795955 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-06117f24-04ce-40f0-8e0b-ed5752ee8799 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:11.802522 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-06117f24-04ce-40f0-8e0b-ed5752ee8799 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:11.803260 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-06117f24-04ce-40f0-8e0b-ed5752ee8799 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:11.804241 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-06117f24-04ce-40f0-8e0b-ed5752ee8799 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:11.804870 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-06117f24-04ce-40f0-8e0b-ed5752ee8799 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:11.879413 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-06117f24-04ce-40f0-8e0b-ed5752ee8799 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:11.887977 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-06117f24-04ce-40f0-8e0b-ed5752ee8799 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:11.889471 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-06117f24-04ce-40f0-8e0b-ed5752ee8799 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:11.890625 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-06117f24-04ce-40f0-8e0b-ed5752ee8799 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1332 microversion: 2.20 time: 0.099327 May 03 08:54:11.891167 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 52/91] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:54:11 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1332 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 08:54:11.895483 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5e98f1fa-d664-47cb-830d-ea34194f3248 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:11.896113 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5e98f1fa-d664-47cb-830d-ea34194f3248 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:11.900418 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-facd6f50-4ada-4d2d-aef4-3d996ca12a06 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:11.902854 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5e98f1fa-d664-47cb-830d-ea34194f3248 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:11.903301 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5e98f1fa-d664-47cb-830d-ea34194f3248 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:11.904062 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5e98f1fa-d664-47cb-830d-ea34194f3248 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:11.904518 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5e98f1fa-d664-47cb-830d-ea34194f3248 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:11.908202 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-facd6f50-4ada-4d2d-aef4-3d996ca12a06 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1364 microversion: 2.1 time: 0.179573 May 03 08:54:11.908673 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 40/92] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:11 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1364 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:11.973580 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5e98f1fa-d664-47cb-830d-ea34194f3248 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:11.983040 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5e98f1fa-d664-47cb-830d-ea34194f3248 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1274 microversion: 2.1 time: 0.090705 May 03 08:54:11.983921 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 53/93] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:11 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1274 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:12.785204 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c9b52dc4-cb8c-4d19-94dd-c571a0897012 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:12.786206 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c9b52dc4-cb8c-4d19-94dd-c571a0897012 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] [instance: eb1259db-3249-432b-a8a2-f9ed13851671] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:12.794662 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c9b52dc4-cb8c-4d19-94dd-c571a0897012 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:12.795139 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c9b52dc4-cb8c-4d19-94dd-c571a0897012 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:12.796247 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c9b52dc4-cb8c-4d19-94dd-c571a0897012 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:12.796680 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c9b52dc4-cb8c-4d19-94dd-c571a0897012 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:12.908738 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-7c3b0b67-b550-432c-9550-f23dc0621996 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:12.909244 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-7c3b0b67-b550-432c-9550-f23dc0621996 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:12.915293 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7c3b0b67-b550-432c-9550-f23dc0621996 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:12.915740 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7c3b0b67-b550-432c-9550-f23dc0621996 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:12.916576 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7c3b0b67-b550-432c-9550-f23dc0621996 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:12.916987 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7c3b0b67-b550-432c-9550-f23dc0621996 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:12.932688 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c9b52dc4-cb8c-4d19-94dd-c571a0897012 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f315597388e14d6ca2ffa1397d94fa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cfd646709540a4a85c64b7aeb5a523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:12.940317 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c9b52dc4-cb8c-4d19-94dd-c571a0897012 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] 10.222.0.11 "GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671" status: 200 len: 1315 microversion: 2.1 time: 0.161690 May 03 08:54:12.940891 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 41/94] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:12 2022] GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:12.945439 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c9b06eb7-d31a-4d59-a3d8-0f2ca59c3be6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:12.946195 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c9b06eb7-d31a-4d59-a3d8-0f2ca59c3be6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:12.952391 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c9b06eb7-d31a-4d59-a3d8-0f2ca59c3be6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:12.952841 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c9b06eb7-d31a-4d59-a3d8-0f2ca59c3be6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:12.953924 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c9b06eb7-d31a-4d59-a3d8-0f2ca59c3be6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:12.954011 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c9b06eb7-d31a-4d59-a3d8-0f2ca59c3be6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:12.978704 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7c3b0b67-b550-432c-9550-f23dc0621996 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:13.012980 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7c3b0b67-b550-432c-9550-f23dc0621996 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:13.018710 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7c3b0b67-b550-432c-9550-f23dc0621996 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:13.020008 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-7c3b0b67-b550-432c-9550-f23dc0621996 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1332 microversion: 2.20 time: 0.115290 May 03 08:54:13.020935 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 54/95] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:54:12 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1332 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:54:13.025670 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c086edbd-862e-429c-97c4-24864d3355e8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:13.026275 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c086edbd-862e-429c-97c4-24864d3355e8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:13.032187 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c086edbd-862e-429c-97c4-24864d3355e8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:13.032639 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c086edbd-862e-429c-97c4-24864d3355e8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:13.033399 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c086edbd-862e-429c-97c4-24864d3355e8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:13.033879 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c086edbd-862e-429c-97c4-24864d3355e8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:13.111051 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c086edbd-862e-429c-97c4-24864d3355e8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:13.118890 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c086edbd-862e-429c-97c4-24864d3355e8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1274 microversion: 2.1 time: 0.096785 May 03 08:54:13.119516 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 55/96] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:13 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1274 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:13.124524 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c9b06eb7-d31a-4d59-a3d8-0f2ca59c3be6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:13.132129 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c9b06eb7-d31a-4d59-a3d8-0f2ca59c3be6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1364 microversion: 2.1 time: 0.190155 May 03 08:54:13.132843 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 42/97] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:12 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1364 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:13.958548 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-697e5ffd-a29c-4ac0-b534-9473542aa776 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:13.959544 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-697e5ffd-a29c-4ac0-b534-9473542aa776 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] [instance: eb1259db-3249-432b-a8a2-f9ed13851671] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:13.971044 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-697e5ffd-a29c-4ac0-b534-9473542aa776 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:13.971044 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-697e5ffd-a29c-4ac0-b534-9473542aa776 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:13.971044 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-697e5ffd-a29c-4ac0-b534-9473542aa776 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:13.971044 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-697e5ffd-a29c-4ac0-b534-9473542aa776 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:14.038853 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6020fbb5-3b6c-455a-91df-af801395c5c5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:14.039534 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6020fbb5-3b6c-455a-91df-af801395c5c5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:14.049425 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6020fbb5-3b6c-455a-91df-af801395c5c5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:14.049821 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6020fbb5-3b6c-455a-91df-af801395c5c5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:14.050607 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6020fbb5-3b6c-455a-91df-af801395c5c5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:14.051044 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6020fbb5-3b6c-455a-91df-af801395c5c5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:14.601955 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6020fbb5-3b6c-455a-91df-af801395c5c5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:14.610689 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6020fbb5-3b6c-455a-91df-af801395c5c5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:14.617726 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6020fbb5-3b6c-455a-91df-af801395c5c5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:14.618882 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6020fbb5-3b6c-455a-91df-af801395c5c5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1338 microversion: 2.20 time: 0.584595 May 03 08:54:14.619447 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 43/98] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:54:14 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1338 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 08:54:14.640634 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9b65e7b7-2613-467b-bce7-0213c1fba48b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:14.647594 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9b65e7b7-2613-467b-bce7-0213c1fba48b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:14.671728 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9b65e7b7-2613-467b-bce7-0213c1fba48b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:14.672526 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9b65e7b7-2613-467b-bce7-0213c1fba48b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:14.673531 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9b65e7b7-2613-467b-bce7-0213c1fba48b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:14.676416 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9b65e7b7-2613-467b-bce7-0213c1fba48b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:14.955911 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9b65e7b7-2613-467b-bce7-0213c1fba48b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:14.966411 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9b65e7b7-2613-467b-bce7-0213c1fba48b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1280 microversion: 2.1 time: 0.329508 May 03 08:54:14.966991 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 44/99] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:14 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1280 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:14.973138 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-787de690-c4aa-4fd0-ae83-6166bd96e658 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:14.974268 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-787de690-c4aa-4fd0-ae83-6166bd96e658 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:14.981615 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-787de690-c4aa-4fd0-ae83-6166bd96e658 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:14.982278 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-787de690-c4aa-4fd0-ae83-6166bd96e658 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:14.983368 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-787de690-c4aa-4fd0-ae83-6166bd96e658 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:14.984010 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-787de690-c4aa-4fd0-ae83-6166bd96e658 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:15.346960 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-697e5ffd-a29c-4ac0-b534-9473542aa776 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f315597388e14d6ca2ffa1397d94fa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cfd646709540a4a85c64b7aeb5a523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:15.357743 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-697e5ffd-a29c-4ac0-b534-9473542aa776 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] 10.222.0.11 "GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671" status: 200 len: 1315 microversion: 2.1 time: 1.402750 May 03 08:54:15.359550 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 56/100] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:13 2022] GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671 => generated 1315 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:15.428064 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [req-bd4eef30-b1c5-4a2f-ad23-fdaf62d3d720 req-1b42d884-e018-4ba8-a33f-e5a4f0a274cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5e0d581-50da-4cfd-a5da-d35a632c7874", "tag": "f4117f51-d987-48d6-86d6-80e550eb84f6"}]} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:54:15.439746 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-bd4eef30-b1c5-4a2f-ad23-fdaf62d3d720 req-1b42d884-e018-4ba8-a33f-e5a4f0a274cf service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:15.440212 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-bd4eef30-b1c5-4a2f-ad23-fdaf62d3d720 req-1b42d884-e018-4ba8-a33f-e5a4f0a274cf service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:15.460935 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.compute.server_external_events [req-bd4eef30-b1c5-4a2f-ad23-fdaf62d3d720 req-1b42d884-e018-4ba8-a33f-e5a4f0a274cf service nova] Creating event network-changed:f4117f51-d987-48d6-86d6-80e550eb84f6 for instance a5e0d581-50da-4cfd-a5da-d35a632c7874 on hv-cinder-84027 May 03 08:54:15.461473 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-bd4eef30-b1c5-4a2f-ad23-fdaf62d3d720 req-1b42d884-e018-4ba8-a33f-e5a4f0a274cf service nova] Acquired lock "compute-rpcapi-router" {{(pid=123391) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 03 08:54:15.462567 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ce8ae4eb-d31b-45bb-b735-05dadd60c3fc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:15.462996 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ce8ae4eb-d31b-45bb-b735-05dadd60c3fc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:15.463825 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ce8ae4eb-d31b-45bb-b735-05dadd60c3fc None None] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:15.464250 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ce8ae4eb-d31b-45bb-b735-05dadd60c3fc None None] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:15.473132 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.compute.rpcapi [None req-ce8ae4eb-d31b-45bb-b735-05dadd60c3fc None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 03 08:54:15.473939 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ce8ae4eb-d31b-45bb-b735-05dadd60c3fc None None] Releasing lock "compute-rpcapi-router" {{(pid=123391) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 03 08:54:15.491018 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ce8ae4eb-d31b-45bb-b735-05dadd60c3fc None None] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129364 May 03 08:54:15.492085 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 57/101] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 08:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:54:15.545348 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [req-5d9e046f-8616-4b42-977d-c080fb701d26 req-b0f11d11-7bdb-43de-ba89-3470bb88b78a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb1259db-3249-432b-a8a2-f9ed13851671", "name": "network-vif-plugged", "status": "completed", "tag": "04da02f0-8439-4fde-b108-b007aeba8b59"}]} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:54:15.553373 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-5d9e046f-8616-4b42-977d-c080fb701d26 req-b0f11d11-7bdb-43de-ba89-3470bb88b78a service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:15.553809 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-5d9e046f-8616-4b42-977d-c080fb701d26 req-b0f11d11-7bdb-43de-ba89-3470bb88b78a service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:15.565369 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.compute.server_external_events [req-5d9e046f-8616-4b42-977d-c080fb701d26 req-b0f11d11-7bdb-43de-ba89-3470bb88b78a service nova] Creating event network-vif-plugged:04da02f0-8439-4fde-b108-b007aeba8b59 for instance eb1259db-3249-432b-a8a2-f9ed13851671 on hv-cinder-84027 May 03 08:54:15.570947 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [req-5d9e046f-8616-4b42-977d-c080fb701d26 req-b0f11d11-7bdb-43de-ba89-3470bb88b78a service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077229 May 03 08:54:15.571590 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 58/102] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 08:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:54:15.578691 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-787de690-c4aa-4fd0-ae83-6166bd96e658 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:15.586341 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-787de690-c4aa-4fd0-ae83-6166bd96e658 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1364 microversion: 2.1 time: 0.618199 May 03 08:54:15.587030 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 45/103] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:14 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1364 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:15.637670 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-93a60f1f-8ab3-468c-a06b-dbc4ad198e54 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:15.638372 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-93a60f1f-8ab3-468c-a06b-dbc4ad198e54 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:15.646602 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-93a60f1f-8ab3-468c-a06b-dbc4ad198e54 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:15.647035 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-93a60f1f-8ab3-468c-a06b-dbc4ad198e54 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:15.647898 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-93a60f1f-8ab3-468c-a06b-dbc4ad198e54 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:15.648845 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-93a60f1f-8ab3-468c-a06b-dbc4ad198e54 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:15.800179 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-93a60f1f-8ab3-468c-a06b-dbc4ad198e54 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:15.812504 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-93a60f1f-8ab3-468c-a06b-dbc4ad198e54 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:15.814204 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-93a60f1f-8ab3-468c-a06b-dbc4ad198e54 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:15.816019 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-93a60f1f-8ab3-468c-a06b-dbc4ad198e54 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1338 microversion: 2.20 time: 0.182481 May 03 08:54:15.836509 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 59/104] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:54:15 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1338 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:54:15.983567 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b87eafe9-706f-4122-a5ab-a950485a92fa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:15.984212 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b87eafe9-706f-4122-a5ab-a950485a92fa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:16.001118 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b87eafe9-706f-4122-a5ab-a950485a92fa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:16.001563 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b87eafe9-706f-4122-a5ab-a950485a92fa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:16.002835 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b87eafe9-706f-4122-a5ab-a950485a92fa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:16.002835 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b87eafe9-706f-4122-a5ab-a950485a92fa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:16.247093 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b87eafe9-706f-4122-a5ab-a950485a92fa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:16.257746 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b87eafe9-706f-4122-a5ab-a950485a92fa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1280 microversion: 2.1 time: 0.278012 May 03 08:54:16.260013 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 46/105] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:15 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1280 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:16.376313 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a1372d1a-224d-47aa-b35a-be44fd3c620d tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:16.377099 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a1372d1a-224d-47aa-b35a-be44fd3c620d tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] [instance: eb1259db-3249-432b-a8a2-f9ed13851671] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:16.388729 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a1372d1a-224d-47aa-b35a-be44fd3c620d tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:16.391314 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a1372d1a-224d-47aa-b35a-be44fd3c620d tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:16.393488 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a1372d1a-224d-47aa-b35a-be44fd3c620d tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:16.394714 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a1372d1a-224d-47aa-b35a-be44fd3c620d tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:16.603063 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e255bbe7-9e0b-4166-9095-65c84aca7513 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:16.603735 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e255bbe7-9e0b-4166-9095-65c84aca7513 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:16.612552 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e255bbe7-9e0b-4166-9095-65c84aca7513 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:16.613384 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e255bbe7-9e0b-4166-9095-65c84aca7513 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:16.614898 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e255bbe7-9e0b-4166-9095-65c84aca7513 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:16.616149 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e255bbe7-9e0b-4166-9095-65c84aca7513 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:17.239479 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a1372d1a-224d-47aa-b35a-be44fd3c620d tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f315597388e14d6ca2ffa1397d94fa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cfd646709540a4a85c64b7aeb5a523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:17.256443 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a1372d1a-224d-47aa-b35a-be44fd3c620d tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] 10.222.0.11 "GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671" status: 200 len: 1315 microversion: 2.1 time: 0.884709 May 03 08:54:17.257663 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 60/106] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:16 2022] GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671 => generated 1315 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:17.262391 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-445a5f22-56c9-417e-b831-b5524200d2ac tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:17.262993 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-445a5f22-56c9-417e-b831-b5524200d2ac tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:17.279967 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-445a5f22-56c9-417e-b831-b5524200d2ac tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:17.280455 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-445a5f22-56c9-417e-b831-b5524200d2ac tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:17.281239 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-445a5f22-56c9-417e-b831-b5524200d2ac tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:17.281701 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-445a5f22-56c9-417e-b831-b5524200d2ac tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:17.496198 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e255bbe7-9e0b-4166-9095-65c84aca7513 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:17.523646 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e255bbe7-9e0b-4166-9095-65c84aca7513 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1364 microversion: 2.1 time: 0.919716 May 03 08:54:17.524546 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 47/107] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:16 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1364 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:17.532088 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-460fc2bd-ea5e-4a1b-9179-a0c908ed59e8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:17.532894 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-460fc2bd-ea5e-4a1b-9179-a0c908ed59e8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:17.541836 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-460fc2bd-ea5e-4a1b-9179-a0c908ed59e8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:17.542473 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-460fc2bd-ea5e-4a1b-9179-a0c908ed59e8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:17.543890 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-460fc2bd-ea5e-4a1b-9179-a0c908ed59e8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:17.545067 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-460fc2bd-ea5e-4a1b-9179-a0c908ed59e8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:18.137942 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-445a5f22-56c9-417e-b831-b5524200d2ac tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:18.146776 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-445a5f22-56c9-417e-b831-b5524200d2ac tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:18.154832 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-445a5f22-56c9-417e-b831-b5524200d2ac tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:18.156408 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-445a5f22-56c9-417e-b831-b5524200d2ac tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1406 microversion: 2.20 time: 0.897432 May 03 08:54:18.157110 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 61/108] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:54:17 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1406 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:54:18.276930 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-2a7696e3-81fb-45ab-9881-12cd42470596 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:18.277847 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-2a7696e3-81fb-45ab-9881-12cd42470596 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] [instance: eb1259db-3249-432b-a8a2-f9ed13851671] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:18.290462 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2a7696e3-81fb-45ab-9881-12cd42470596 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:18.291117 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2a7696e3-81fb-45ab-9881-12cd42470596 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:18.292593 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2a7696e3-81fb-45ab-9881-12cd42470596 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:18.293587 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2a7696e3-81fb-45ab-9881-12cd42470596 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:18.318981 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-460fc2bd-ea5e-4a1b-9179-a0c908ed59e8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:18.329130 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-460fc2bd-ea5e-4a1b-9179-a0c908ed59e8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1322 microversion: 2.1 time: 0.803363 May 03 08:54:18.339652 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 48/109] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:17 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1322 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:18.541729 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7bd0778c-7964-4db2-b387-2282ec61fb22 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:18.542583 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7bd0778c-7964-4db2-b387-2282ec61fb22 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:18.550052 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7bd0778c-7964-4db2-b387-2282ec61fb22 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:18.550783 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7bd0778c-7964-4db2-b387-2282ec61fb22 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:18.551992 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7bd0778c-7964-4db2-b387-2282ec61fb22 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:18.553054 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7bd0778c-7964-4db2-b387-2282ec61fb22 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:18.627974 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-2a7696e3-81fb-45ab-9881-12cd42470596 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f315597388e14d6ca2ffa1397d94fa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cfd646709540a4a85c64b7aeb5a523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:18.638096 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-2a7696e3-81fb-45ab-9881-12cd42470596 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] 10.222.0.11 "GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671" status: 200 len: 1315 microversion: 2.1 time: 0.367941 May 03 08:54:18.641260 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 62/110] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:18 2022] GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671 => generated 1315 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 08:54:19.101799 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7bd0778c-7964-4db2-b387-2282ec61fb22 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:19.118362 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7bd0778c-7964-4db2-b387-2282ec61fb22 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1364 microversion: 2.1 time: 0.580972 May 03 08:54:19.134319 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 49/111] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:18 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1364 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 08:54:19.175341 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ab1fb6a0-7b5b-4f1c-9593-d58deb4c193f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:19.176054 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ab1fb6a0-7b5b-4f1c-9593-d58deb4c193f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:19.187976 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ab1fb6a0-7b5b-4f1c-9593-d58deb4c193f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:19.188422 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ab1fb6a0-7b5b-4f1c-9593-d58deb4c193f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:19.189338 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ab1fb6a0-7b5b-4f1c-9593-d58deb4c193f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:19.189776 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ab1fb6a0-7b5b-4f1c-9593-d58deb4c193f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:19.346203 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-374c7b74-29d9-426c-aeac-287cce81fd20 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:19.346974 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-374c7b74-29d9-426c-aeac-287cce81fd20 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:19.358885 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-374c7b74-29d9-426c-aeac-287cce81fd20 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:19.359338 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-374c7b74-29d9-426c-aeac-287cce81fd20 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:19.360165 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-374c7b74-29d9-426c-aeac-287cce81fd20 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:19.367413 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-374c7b74-29d9-426c-aeac-287cce81fd20 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:19.977014 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ab1fb6a0-7b5b-4f1c-9593-d58deb4c193f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:19.986940 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ab1fb6a0-7b5b-4f1c-9593-d58deb4c193f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:19.991014 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-374c7b74-29d9-426c-aeac-287cce81fd20 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:19.991508 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ab1fb6a0-7b5b-4f1c-9593-d58deb4c193f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:20.001123 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-374c7b74-29d9-426c-aeac-287cce81fd20 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1322 microversion: 2.1 time: 0.659185 May 03 08:54:20.002007 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 50/112] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:19 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1322 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:20.005760 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ab1fb6a0-7b5b-4f1c-9593-d58deb4c193f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1406 microversion: 2.20 time: 0.823842 May 03 08:54:20.006406 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 63/113] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:54:19 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1406 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:54:20.007601 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-ab78527a-59f9-4667-a0fe-f39f8e58702b req-beb9e5e2-c6cd-4ebd-aa4a-bc7b0db2171a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5e0d581-50da-4cfd-a5da-d35a632c7874", "name": "network-vif-plugged", "status": "completed", "tag": "f4117f51-d987-48d6-86d6-80e550eb84f6"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:54:20.016643 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-ab78527a-59f9-4667-a0fe-f39f8e58702b req-beb9e5e2-c6cd-4ebd-aa4a-bc7b0db2171a service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:20.017285 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-ab78527a-59f9-4667-a0fe-f39f8e58702b req-beb9e5e2-c6cd-4ebd-aa4a-bc7b0db2171a service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:20.019625 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-54566769-8cf4-4ad9-abc6-20e971bceea6 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:20.022353 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-54566769-8cf4-4ad9-abc6-20e971bceea6 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] [instance: eb1259db-3249-432b-a8a2-f9ed13851671] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:20.030059 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-ab78527a-59f9-4667-a0fe-f39f8e58702b req-beb9e5e2-c6cd-4ebd-aa4a-bc7b0db2171a service nova] Creating event network-vif-plugged:f4117f51-d987-48d6-86d6-80e550eb84f6 for instance a5e0d581-50da-4cfd-a5da-d35a632c7874 on hv-cinder-84027 May 03 08:54:20.032866 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-54566769-8cf4-4ad9-abc6-20e971bceea6 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:20.033315 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-54566769-8cf4-4ad9-abc6-20e971bceea6 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:20.034086 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-54566769-8cf4-4ad9-abc6-20e971bceea6 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:20.034515 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-54566769-8cf4-4ad9-abc6-20e971bceea6 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:20.044222 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-ab78527a-59f9-4667-a0fe-f39f8e58702b req-beb9e5e2-c6cd-4ebd-aa4a-bc7b0db2171a service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040493 May 03 08:54:20.047879 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 51/114] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 08:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:54:20.138961 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4dafef52-ceb8-4778-81f9-f87fb9ddb726 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:20.140045 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4dafef52-ceb8-4778-81f9-f87fb9ddb726 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:20.149278 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4dafef52-ceb8-4778-81f9-f87fb9ddb726 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:20.150270 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4dafef52-ceb8-4778-81f9-f87fb9ddb726 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:20.151695 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4dafef52-ceb8-4778-81f9-f87fb9ddb726 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:20.152536 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4dafef52-ceb8-4778-81f9-f87fb9ddb726 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:20.660276 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-54566769-8cf4-4ad9-abc6-20e971bceea6 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f315597388e14d6ca2ffa1397d94fa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cfd646709540a4a85c64b7aeb5a523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:20.670434 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-4dafef52-ceb8-4778-81f9-f87fb9ddb726 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:20.675715 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-54566769-8cf4-4ad9-abc6-20e971bceea6 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] 10.222.0.11 "GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671" status: 200 len: 1502 microversion: 2.1 time: 0.667919 May 03 08:54:20.677240 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 64/115] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:20 2022] GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671 => generated 1502 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:20.691989 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-4dafef52-ceb8-4778-81f9-f87fb9ddb726 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1364 microversion: 2.1 time: 0.560252 May 03 08:54:20.701258 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 52/116] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:20 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1364 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 08:54:20.703026 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [req-56bebcdf-827d-4222-9092-ad1ac8cd49cb req-f39ed6a3-6917-40a7-9483-5ca9bbd183a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e33ce07e-908a-4708-8aef-351bd3e02368", "tag": "97dddf0c-2099-4aca-9f5f-d7bb688d0d06"}]} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:54:20.713509 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-56bebcdf-827d-4222-9092-ad1ac8cd49cb req-f39ed6a3-6917-40a7-9483-5ca9bbd183a6 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:20.716338 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-56bebcdf-827d-4222-9092-ad1ac8cd49cb req-f39ed6a3-6917-40a7-9483-5ca9bbd183a6 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:20.732811 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.compute.server_external_events [req-56bebcdf-827d-4222-9092-ad1ac8cd49cb req-f39ed6a3-6917-40a7-9483-5ca9bbd183a6 service nova] Creating event network-changed:97dddf0c-2099-4aca-9f5f-d7bb688d0d06 for instance e33ce07e-908a-4708-8aef-351bd3e02368 on hv-cinder-84027 May 03 08:54:20.743136 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [req-56bebcdf-827d-4222-9092-ad1ac8cd49cb req-f39ed6a3-6917-40a7-9483-5ca9bbd183a6 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063030 May 03 08:54:20.743920 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 65/117] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 08:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:54:21.025304 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f16ffd84-cba0-46c8-a19b-53fdcc2e6b5a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:21.027481 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a7947e69-1e5d-4f00-8fc2-ee813df12922 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:21.028249 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f16ffd84-cba0-46c8-a19b-53fdcc2e6b5a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:21.029199 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a7947e69-1e5d-4f00-8fc2-ee813df12922 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:21.040771 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a7947e69-1e5d-4f00-8fc2-ee813df12922 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:21.042658 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f16ffd84-cba0-46c8-a19b-53fdcc2e6b5a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:21.043306 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f16ffd84-cba0-46c8-a19b-53fdcc2e6b5a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:21.044113 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f16ffd84-cba0-46c8-a19b-53fdcc2e6b5a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:21.044542 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f16ffd84-cba0-46c8-a19b-53fdcc2e6b5a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:21.046753 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a7947e69-1e5d-4f00-8fc2-ee813df12922 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:21.047548 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a7947e69-1e5d-4f00-8fc2-ee813df12922 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:21.048011 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a7947e69-1e5d-4f00-8fc2-ee813df12922 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:21.294429 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a7947e69-1e5d-4f00-8fc2-ee813df12922 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:21.297771 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f16ffd84-cba0-46c8-a19b-53fdcc2e6b5a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:21.303077 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a7947e69-1e5d-4f00-8fc2-ee813df12922 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:21.304753 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a7947e69-1e5d-4f00-8fc2-ee813df12922 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:21.305689 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f16ffd84-cba0-46c8-a19b-53fdcc2e6b5a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1322 microversion: 2.1 time: 0.291950 May 03 08:54:21.306269 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 53/118] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:21 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1322 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:21.306412 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a7947e69-1e5d-4f00-8fc2-ee813df12922 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1406 microversion: 2.20 time: 0.285616 May 03 08:54:21.306818 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 66/119] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:54:21 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1406 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 08:54:21.712965 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-73a31681-fba1-4b1c-851b-5e89190a9e77 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:21.714011 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-73a31681-fba1-4b1c-851b-5e89190a9e77 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:21.724123 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-73a31681-fba1-4b1c-851b-5e89190a9e77 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:21.724873 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-73a31681-fba1-4b1c-851b-5e89190a9e77 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:21.726194 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-73a31681-fba1-4b1c-851b-5e89190a9e77 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:21.726645 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-73a31681-fba1-4b1c-851b-5e89190a9e77 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:21.875346 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-73a31681-fba1-4b1c-851b-5e89190a9e77 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:21.883379 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-73a31681-fba1-4b1c-851b-5e89190a9e77 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1364 microversion: 2.1 time: 0.176966 May 03 08:54:21.884005 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 54/120] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:21 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:22.322577 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-2c763368-b8e0-4f28-9a79-d0f6d26dd38d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:22.323098 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-2c763368-b8e0-4f28-9a79-d0f6d26dd38d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:22.324001 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-01f7b5cf-0e0b-40a9-a7fa-bc67fd79e65d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:22.324615 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-01f7b5cf-0e0b-40a9-a7fa-bc67fd79e65d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:22.329542 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2c763368-b8e0-4f28-9a79-d0f6d26dd38d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:22.329985 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2c763368-b8e0-4f28-9a79-d0f6d26dd38d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:22.330761 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2c763368-b8e0-4f28-9a79-d0f6d26dd38d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:22.330944 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-01f7b5cf-0e0b-40a9-a7fa-bc67fd79e65d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:22.331185 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2c763368-b8e0-4f28-9a79-d0f6d26dd38d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:22.331331 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-01f7b5cf-0e0b-40a9-a7fa-bc67fd79e65d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:22.331995 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-01f7b5cf-0e0b-40a9-a7fa-bc67fd79e65d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:22.332429 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-01f7b5cf-0e0b-40a9-a7fa-bc67fd79e65d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:22.520113 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-2c763368-b8e0-4f28-9a79-d0f6d26dd38d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:22.523227 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-01f7b5cf-0e0b-40a9-a7fa-bc67fd79e65d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:22.530039 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-2c763368-b8e0-4f28-9a79-d0f6d26dd38d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1322 microversion: 2.1 time: 0.211121 May 03 08:54:22.532382 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-01f7b5cf-0e0b-40a9-a7fa-bc67fd79e65d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:22.534603 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-01f7b5cf-0e0b-40a9-a7fa-bc67fd79e65d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:22.536686 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-01f7b5cf-0e0b-40a9-a7fa-bc67fd79e65d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1406 microversion: 2.20 time: 0.216650 May 03 08:54:22.538127 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 55/121] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:54:22 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1406 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:54:22.541211 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 67/122] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:22 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:22.792419 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-1682b1f4-2860-4158-ac74-d5abe66564f2 req-af229b9f-13fa-446b-ae5a-33e27ef01c18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b68d79a3-e9c5-46b6-b8c0-a9d6017f388f", "tag": "c0a78137-d132-441d-8bd5-1d74354f3e67"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:54:22.805060 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-1682b1f4-2860-4158-ac74-d5abe66564f2 req-af229b9f-13fa-446b-ae5a-33e27ef01c18 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:22.805768 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-1682b1f4-2860-4158-ac74-d5abe66564f2 req-af229b9f-13fa-446b-ae5a-33e27ef01c18 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:22.817580 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-1682b1f4-2860-4158-ac74-d5abe66564f2 req-af229b9f-13fa-446b-ae5a-33e27ef01c18 service nova] Creating event network-changed:c0a78137-d132-441d-8bd5-1d74354f3e67 for instance b68d79a3-e9c5-46b6-b8c0-a9d6017f388f on hv-cinder-84027 May 03 08:54:22.822815 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-1682b1f4-2860-4158-ac74-d5abe66564f2 req-af229b9f-13fa-446b-ae5a-33e27ef01c18 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034278 May 03 08:54:22.823486 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 56/123] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 08:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:54:22.900494 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-0fe1eb12-b010-4808-b496-7c5a25bc4a2a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:22.901096 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-0fe1eb12-b010-4808-b496-7c5a25bc4a2a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:22.909391 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0fe1eb12-b010-4808-b496-7c5a25bc4a2a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:22.909833 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0fe1eb12-b010-4808-b496-7c5a25bc4a2a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:22.910938 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0fe1eb12-b010-4808-b496-7c5a25bc4a2a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:22.911520 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0fe1eb12-b010-4808-b496-7c5a25bc4a2a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:23.189663 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-0fe1eb12-b010-4808-b496-7c5a25bc4a2a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:23.197228 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-0fe1eb12-b010-4808-b496-7c5a25bc4a2a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1364 microversion: 2.1 time: 0.300886 May 03 08:54:23.197793 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 68/124] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:22 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1364 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:23.376986 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9cd7485a-5555-4045-86e6-111088a5ef38 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8dc8d5dc-0edc-438e-b378-d71fae47815b"}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:54:23.378136 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9cd7485a-5555-4045-86e6-111088a5ef38 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] [instance: eb1259db-3249-432b-a8a2-f9ed13851671] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:23.387629 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9cd7485a-5555-4045-86e6-111088a5ef38 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:23.388269 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9cd7485a-5555-4045-86e6-111088a5ef38 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:23.391625 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9cd7485a-5555-4045-86e6-111088a5ef38 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:23.391625 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9cd7485a-5555-4045-86e6-111088a5ef38 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:23.548269 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5cf49213-a077-4057-b18e-90efbbd7f2f5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:23.548929 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5cf49213-a077-4057-b18e-90efbbd7f2f5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:23.555173 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5cf49213-a077-4057-b18e-90efbbd7f2f5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:23.555626 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5cf49213-a077-4057-b18e-90efbbd7f2f5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:23.556441 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5cf49213-a077-4057-b18e-90efbbd7f2f5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:23.556877 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5cf49213-a077-4057-b18e-90efbbd7f2f5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:23.717136 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5cf49213-a077-4057-b18e-90efbbd7f2f5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:23.725010 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5cf49213-a077-4057-b18e-90efbbd7f2f5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1322 microversion: 2.1 time: 0.180682 May 03 08:54:23.735075 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 69/125] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:23 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 08:54:23.740078 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5c70ed73-6b55-48f5-8110-638c13225174 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:23.740750 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5c70ed73-6b55-48f5-8110-638c13225174 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:23.746940 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5c70ed73-6b55-48f5-8110-638c13225174 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:23.747437 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5c70ed73-6b55-48f5-8110-638c13225174 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:23.748333 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5c70ed73-6b55-48f5-8110-638c13225174 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:23.748769 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5c70ed73-6b55-48f5-8110-638c13225174 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:24.035161 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9cd7485a-5555-4045-86e6-111088a5ef38 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] 10.222.0.11 "POST /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.663388 May 03 08:54:24.041055 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 57/126] 10.222.0.11 () {60 vars in 1322 bytes} [Tue May 3 08:54:23 2022] POST /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671/os-volume_attachments => generated 194 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:54:24.075706 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5c70ed73-6b55-48f5-8110-638c13225174 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:24.093374 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5c70ed73-6b55-48f5-8110-638c13225174 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:24.095372 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5c70ed73-6b55-48f5-8110-638c13225174 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:24.096803 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5c70ed73-6b55-48f5-8110-638c13225174 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1406 microversion: 2.20 time: 0.360495 May 03 08:54:24.098450 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 70/127] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:54:23 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1406 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:54:24.216543 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-69440677-e04b-4b72-bb8e-c3b5c301c7ac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:24.217287 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-69440677-e04b-4b72-bb8e-c3b5c301c7ac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:24.223906 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-69440677-e04b-4b72-bb8e-c3b5c301c7ac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:24.224352 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-69440677-e04b-4b72-bb8e-c3b5c301c7ac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:24.225120 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-69440677-e04b-4b72-bb8e-c3b5c301c7ac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:24.225579 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-69440677-e04b-4b72-bb8e-c3b5c301c7ac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:24.359374 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-69440677-e04b-4b72-bb8e-c3b5c301c7ac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:24.367407 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-69440677-e04b-4b72-bb8e-c3b5c301c7ac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1364 microversion: 2.1 time: 0.155299 May 03 08:54:24.368005 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 58/128] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:24 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:24.631243 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [req-8c7ef976-7974-4b9e-bb55-a2f4d938104a req-0ef5159b-718f-440b-8d31-3e4fde114e46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "309e7477-cc5c-4422-ac1e-46d32bc3991b", "name": "network-vif-plugged", "status": "completed", "tag": "a1780ecc-31ca-4cfd-88ae-8e55c35791d7"}]} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:54:24.639910 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-8c7ef976-7974-4b9e-bb55-a2f4d938104a req-0ef5159b-718f-440b-8d31-3e4fde114e46 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:24.641117 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-8c7ef976-7974-4b9e-bb55-a2f4d938104a req-0ef5159b-718f-440b-8d31-3e4fde114e46 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:24.653909 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.compute.server_external_events [req-8c7ef976-7974-4b9e-bb55-a2f4d938104a req-0ef5159b-718f-440b-8d31-3e4fde114e46 service nova] Creating event network-vif-plugged:a1780ecc-31ca-4cfd-88ae-8e55c35791d7 for instance 309e7477-cc5c-4422-ac1e-46d32bc3991b on hv-cinder-84027 May 03 08:54:24.659090 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [req-8c7ef976-7974-4b9e-bb55-a2f4d938104a req-0ef5159b-718f-440b-8d31-3e4fde114e46 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031502 May 03 08:54:24.659884 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 71/129] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 08:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:54:24.742778 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-33bbd953-1afa-4d0a-bf03-01b56d885731 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:24.743396 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-33bbd953-1afa-4d0a-bf03-01b56d885731 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:24.750275 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-33bbd953-1afa-4d0a-bf03-01b56d885731 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:24.750726 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-33bbd953-1afa-4d0a-bf03-01b56d885731 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:24.751509 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-33bbd953-1afa-4d0a-bf03-01b56d885731 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:24.751970 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-33bbd953-1afa-4d0a-bf03-01b56d885731 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:24.885034 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-33bbd953-1afa-4d0a-bf03-01b56d885731 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:24.892231 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-33bbd953-1afa-4d0a-bf03-01b56d885731 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1322 microversion: 2.1 time: 0.153601 May 03 08:54:24.892810 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 59/130] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:24 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:25.117376 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-98be6c6d-5a01-434a-8311-39b2c301fd3f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:25.118090 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-98be6c6d-5a01-434a-8311-39b2c301fd3f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:25.124339 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-98be6c6d-5a01-434a-8311-39b2c301fd3f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:25.124794 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-98be6c6d-5a01-434a-8311-39b2c301fd3f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:25.125667 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-98be6c6d-5a01-434a-8311-39b2c301fd3f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:25.126368 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-98be6c6d-5a01-434a-8311-39b2c301fd3f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:25.261546 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-98be6c6d-5a01-434a-8311-39b2c301fd3f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:25.269624 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-98be6c6d-5a01-434a-8311-39b2c301fd3f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:25.271136 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-98be6c6d-5a01-434a-8311-39b2c301fd3f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:25.272273 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-98be6c6d-5a01-434a-8311-39b2c301fd3f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1406 microversion: 2.20 time: 0.161205 May 03 08:54:25.272865 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 72/131] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:54:25 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:54:25.388487 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b23f9538-a350-467a-a234-947ded9dbf25 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:25.388487 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b23f9538-a350-467a-a234-947ded9dbf25 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:25.401677 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b23f9538-a350-467a-a234-947ded9dbf25 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:25.401905 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b23f9538-a350-467a-a234-947ded9dbf25 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:25.402698 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b23f9538-a350-467a-a234-947ded9dbf25 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:25.403128 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b23f9538-a350-467a-a234-947ded9dbf25 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:25.687451 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b23f9538-a350-467a-a234-947ded9dbf25 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:25.696122 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b23f9538-a350-467a-a234-947ded9dbf25 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1364 microversion: 2.1 time: 0.314498 May 03 08:54:25.697090 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 60/132] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:25 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1364 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:25.909744 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-db3a5d23-1838-4041-ac61-5c48d2926ad8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:25.910510 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-db3a5d23-1838-4041-ac61-5c48d2926ad8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:25.917280 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-db3a5d23-1838-4041-ac61-5c48d2926ad8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:25.917280 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-db3a5d23-1838-4041-ac61-5c48d2926ad8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:25.917280 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-db3a5d23-1838-4041-ac61-5c48d2926ad8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:25.917280 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-db3a5d23-1838-4041-ac61-5c48d2926ad8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:26.082183 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-db3a5d23-1838-4041-ac61-5c48d2926ad8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:26.090944 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-db3a5d23-1838-4041-ac61-5c48d2926ad8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1322 microversion: 2.1 time: 0.185434 May 03 08:54:26.092112 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 73/133] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:25 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:26.290304 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6471ca0f-35b6-4bfd-a339-abc59ee33ec7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:26.292326 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6471ca0f-35b6-4bfd-a339-abc59ee33ec7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:26.298486 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6471ca0f-35b6-4bfd-a339-abc59ee33ec7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:26.299006 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6471ca0f-35b6-4bfd-a339-abc59ee33ec7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:26.300049 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6471ca0f-35b6-4bfd-a339-abc59ee33ec7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:26.300869 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6471ca0f-35b6-4bfd-a339-abc59ee33ec7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:26.449444 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6471ca0f-35b6-4bfd-a339-abc59ee33ec7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:26.458588 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6471ca0f-35b6-4bfd-a339-abc59ee33ec7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:26.461059 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6471ca0f-35b6-4bfd-a339-abc59ee33ec7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:26.461315 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6471ca0f-35b6-4bfd-a339-abc59ee33ec7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1406 microversion: 2.20 time: 0.175623 May 03 08:54:26.462002 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 61/134] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:54:26 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:54:26.712766 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-39c1dd34-4d79-40b8-ada9-2c8aa54b126e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:26.713911 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-39c1dd34-4d79-40b8-ada9-2c8aa54b126e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:26.720711 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-39c1dd34-4d79-40b8-ada9-2c8aa54b126e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:26.721267 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-39c1dd34-4d79-40b8-ada9-2c8aa54b126e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:26.722126 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-39c1dd34-4d79-40b8-ada9-2c8aa54b126e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:26.722645 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-39c1dd34-4d79-40b8-ada9-2c8aa54b126e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:27.061803 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-39c1dd34-4d79-40b8-ada9-2c8aa54b126e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:27.069592 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-39c1dd34-4d79-40b8-ada9-2c8aa54b126e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1364 microversion: 2.1 time: 0.360836 May 03 08:54:27.070836 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 74/135] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:26 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1364 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:27.108578 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0c1558dc-2bcf-439f-ab12-a0d1ca42bd9f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:27.109185 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0c1558dc-2bcf-439f-ab12-a0d1ca42bd9f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:27.116320 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0c1558dc-2bcf-439f-ab12-a0d1ca42bd9f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:27.116657 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0c1558dc-2bcf-439f-ab12-a0d1ca42bd9f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:27.117420 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0c1558dc-2bcf-439f-ab12-a0d1ca42bd9f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:27.117849 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0c1558dc-2bcf-439f-ab12-a0d1ca42bd9f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:27.362641 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0c1558dc-2bcf-439f-ab12-a0d1ca42bd9f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:27.388242 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0c1558dc-2bcf-439f-ab12-a0d1ca42bd9f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1322 microversion: 2.1 time: 0.280811 May 03 08:54:27.391485 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 62/136] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:27 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1322 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:27.480646 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5c791870-f0ac-4ebf-8fd1-968f4d81ff5e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:27.482639 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5c791870-f0ac-4ebf-8fd1-968f4d81ff5e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:27.495480 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5c791870-f0ac-4ebf-8fd1-968f4d81ff5e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:27.497166 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5c791870-f0ac-4ebf-8fd1-968f4d81ff5e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:27.500317 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5c791870-f0ac-4ebf-8fd1-968f4d81ff5e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:27.500784 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5c791870-f0ac-4ebf-8fd1-968f4d81ff5e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:27.763360 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5c791870-f0ac-4ebf-8fd1-968f4d81ff5e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:27.775464 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5c791870-f0ac-4ebf-8fd1-968f4d81ff5e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:27.776896 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5c791870-f0ac-4ebf-8fd1-968f4d81ff5e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:27.784468 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5c791870-f0ac-4ebf-8fd1-968f4d81ff5e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1406 microversion: 2.20 time: 0.308442 May 03 08:54:27.787930 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 75/137] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:54:27 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1406 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:54:28.092283 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-50dcc224-9b81-4edf-80aa-29385a1541c6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:28.094005 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-50dcc224-9b81-4edf-80aa-29385a1541c6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:28.113442 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-50dcc224-9b81-4edf-80aa-29385a1541c6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:28.113997 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-50dcc224-9b81-4edf-80aa-29385a1541c6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:28.115026 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-50dcc224-9b81-4edf-80aa-29385a1541c6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:28.115706 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-50dcc224-9b81-4edf-80aa-29385a1541c6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:28.285686 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-50dcc224-9b81-4edf-80aa-29385a1541c6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:28.294807 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-50dcc224-9b81-4edf-80aa-29385a1541c6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1364 microversion: 2.1 time: 0.211684 May 03 08:54:28.303932 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 63/138] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:28 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1364 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:28.405185 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-14f16179-9556-4d66-b999-12e961e21120 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:28.406465 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-14f16179-9556-4d66-b999-12e961e21120 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:28.413498 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-14f16179-9556-4d66-b999-12e961e21120 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:28.414255 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-14f16179-9556-4d66-b999-12e961e21120 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:28.415559 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-14f16179-9556-4d66-b999-12e961e21120 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:28.416432 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-14f16179-9556-4d66-b999-12e961e21120 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:28.642213 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-14f16179-9556-4d66-b999-12e961e21120 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:28.657291 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-14f16179-9556-4d66-b999-12e961e21120 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1322 microversion: 2.1 time: 0.256146 May 03 08:54:28.660569 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 76/139] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:28 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1322 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:28.804757 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ef0abf19-2ed5-43d6-a79b-7b9b74206496 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:28.806199 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ef0abf19-2ed5-43d6-a79b-7b9b74206496 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:28.812497 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ef0abf19-2ed5-43d6-a79b-7b9b74206496 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:28.813157 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ef0abf19-2ed5-43d6-a79b-7b9b74206496 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:28.814293 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ef0abf19-2ed5-43d6-a79b-7b9b74206496 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:28.814875 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ef0abf19-2ed5-43d6-a79b-7b9b74206496 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:28.980224 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ef0abf19-2ed5-43d6-a79b-7b9b74206496 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:28.990661 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ef0abf19-2ed5-43d6-a79b-7b9b74206496 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:28.992705 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ef0abf19-2ed5-43d6-a79b-7b9b74206496 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:28.995250 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ef0abf19-2ed5-43d6-a79b-7b9b74206496 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1406 microversion: 2.20 time: 0.194669 May 03 08:54:28.996488 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 64/140] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:54:28 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1406 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:54:29.319527 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-583b667b-e3e8-42a2-84b4-662a7da51fd9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:29.320358 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-583b667b-e3e8-42a2-84b4-662a7da51fd9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:29.337881 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-583b667b-e3e8-42a2-84b4-662a7da51fd9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:29.338328 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-583b667b-e3e8-42a2-84b4-662a7da51fd9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:29.339107 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-583b667b-e3e8-42a2-84b4-662a7da51fd9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:29.339537 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-583b667b-e3e8-42a2-84b4-662a7da51fd9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:29.536787 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-583b667b-e3e8-42a2-84b4-662a7da51fd9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:29.549131 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-583b667b-e3e8-42a2-84b4-662a7da51fd9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1550 microversion: 2.1 time: 0.240120 May 03 08:54:29.549726 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 77/141] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:29 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1550 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:29.569119 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7f3ca2ee-164c-414d-a372-a2d5b03404e1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:29.570283 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7f3ca2ee-164c-414d-a372-a2d5b03404e1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:29.578188 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7f3ca2ee-164c-414d-a372-a2d5b03404e1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:29.579054 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7f3ca2ee-164c-414d-a372-a2d5b03404e1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:29.579929 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7f3ca2ee-164c-414d-a372-a2d5b03404e1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:29.580507 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7f3ca2ee-164c-414d-a372-a2d5b03404e1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:29.677080 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-fb16a264-73ff-4e67-bcc2-28e0eacdc3ba tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:29.677730 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-fb16a264-73ff-4e67-bcc2-28e0eacdc3ba tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:29.686595 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fb16a264-73ff-4e67-bcc2-28e0eacdc3ba tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:29.689643 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fb16a264-73ff-4e67-bcc2-28e0eacdc3ba tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:29.690480 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fb16a264-73ff-4e67-bcc2-28e0eacdc3ba tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:29.691256 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fb16a264-73ff-4e67-bcc2-28e0eacdc3ba tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:29.706059 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7f3ca2ee-164c-414d-a372-a2d5b03404e1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.143112 May 03 08:54:29.707299 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 65/142] 10.222.0.11 () {58 vars in 1274 bytes} [Tue May 3 08:54:29 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-interface => generated 285 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:54:30.014701 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-83e301df-6fa2-4e96-89ab-b615030b402e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:30.015685 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-83e301df-6fa2-4e96-89ab-b615030b402e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:30.021858 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-83e301df-6fa2-4e96-89ab-b615030b402e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:30.022548 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-83e301df-6fa2-4e96-89ab-b615030b402e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:30.023328 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-83e301df-6fa2-4e96-89ab-b615030b402e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:30.023957 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-83e301df-6fa2-4e96-89ab-b615030b402e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:30.220660 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-fb16a264-73ff-4e67-bcc2-28e0eacdc3ba tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:30.235744 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-fb16a264-73ff-4e67-bcc2-28e0eacdc3ba tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1322 microversion: 2.1 time: 0.558146 May 03 08:54:30.238928 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 78/143] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:29 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1322 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 08:54:30.314852 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-83e301df-6fa2-4e96-89ab-b615030b402e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:30.330840 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-83e301df-6fa2-4e96-89ab-b615030b402e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:30.335348 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-83e301df-6fa2-4e96-89ab-b615030b402e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:30.338826 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-83e301df-6fa2-4e96-89ab-b615030b402e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1406 microversion: 2.20 time: 0.326262 May 03 08:54:30.340520 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 66/144] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:54:30 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1406 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 08:54:31.255331 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-0a900883-47d2-4f6f-9ea4-c5aa257dd147 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:31.255974 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-0a900883-47d2-4f6f-9ea4-c5aa257dd147 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:31.271806 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0a900883-47d2-4f6f-9ea4-c5aa257dd147 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:31.273987 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0a900883-47d2-4f6f-9ea4-c5aa257dd147 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:31.275200 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0a900883-47d2-4f6f-9ea4-c5aa257dd147 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:31.276365 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0a900883-47d2-4f6f-9ea4-c5aa257dd147 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:31.276732 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-1017eda1-d513-404f-9fe0-4851e59d1a72 req-d022b050-6495-42cf-ad38-4282c17e9608 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b68d79a3-e9c5-46b6-b8c0-a9d6017f388f", "name": "network-vif-plugged", "status": "completed", "tag": "c0a78137-d132-441d-8bd5-1d74354f3e67"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:54:31.289858 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-1017eda1-d513-404f-9fe0-4851e59d1a72 req-d022b050-6495-42cf-ad38-4282c17e9608 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:31.296389 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-1017eda1-d513-404f-9fe0-4851e59d1a72 req-d022b050-6495-42cf-ad38-4282c17e9608 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:31.315501 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-1017eda1-d513-404f-9fe0-4851e59d1a72 req-d022b050-6495-42cf-ad38-4282c17e9608 service nova] Creating event network-vif-plugged:c0a78137-d132-441d-8bd5-1d74354f3e67 for instance b68d79a3-e9c5-46b6-b8c0-a9d6017f388f on hv-cinder-84027 May 03 08:54:31.320865 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-1017eda1-d513-404f-9fe0-4851e59d1a72 req-d022b050-6495-42cf-ad38-4282c17e9608 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047653 May 03 08:54:31.322001 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 67/145] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 08:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:54:31.364638 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e45e0129-2ffb-4b62-92c1-bf77f80caa4f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:31.366885 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e45e0129-2ffb-4b62-92c1-bf77f80caa4f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:31.385285 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e45e0129-2ffb-4b62-92c1-bf77f80caa4f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:31.386195 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e45e0129-2ffb-4b62-92c1-bf77f80caa4f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:31.389092 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e45e0129-2ffb-4b62-92c1-bf77f80caa4f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:31.395013 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e45e0129-2ffb-4b62-92c1-bf77f80caa4f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:31.833601 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-0a900883-47d2-4f6f-9ea4-c5aa257dd147 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:31.842107 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-0a900883-47d2-4f6f-9ea4-c5aa257dd147 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1322 microversion: 2.1 time: 0.591410 May 03 08:54:31.844031 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 79/146] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:31 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1322 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:31.887177 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e45e0129-2ffb-4b62-92c1-bf77f80caa4f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:31.896985 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e45e0129-2ffb-4b62-92c1-bf77f80caa4f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:31.899331 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e45e0129-2ffb-4b62-92c1-bf77f80caa4f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:31.900807 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e45e0129-2ffb-4b62-92c1-bf77f80caa4f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1406 microversion: 2.20 time: 0.547009 May 03 08:54:31.901961 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 68/147] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:54:31 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1406 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:54:32.086318 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [req-900fc717-23f5-4324-bd9e-730e5a2b25b3 req-d65e80ba-033d-4655-90ec-c3d6d693c092 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "309e7477-cc5c-4422-ac1e-46d32bc3991b", "tag": "a1780ecc-31ca-4cfd-88ae-8e55c35791d7"}]} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:54:32.109397 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-900fc717-23f5-4324-bd9e-730e5a2b25b3 req-d65e80ba-033d-4655-90ec-c3d6d693c092 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:32.109707 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-900fc717-23f5-4324-bd9e-730e5a2b25b3 req-d65e80ba-033d-4655-90ec-c3d6d693c092 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:32.122014 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.compute.server_external_events [req-900fc717-23f5-4324-bd9e-730e5a2b25b3 req-d65e80ba-033d-4655-90ec-c3d6d693c092 service nova] Creating event network-changed:a1780ecc-31ca-4cfd-88ae-8e55c35791d7 for instance 309e7477-cc5c-4422-ac1e-46d32bc3991b on hv-cinder-84027 May 03 08:54:32.127453 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [req-900fc717-23f5-4324-bd9e-730e5a2b25b3 req-d65e80ba-033d-4655-90ec-c3d6d693c092 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050170 May 03 08:54:32.128438 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 80/148] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 08:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:54:32.860805 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-aa1b11dd-6e10-4448-9604-7a45a939552e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:32.861651 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-aa1b11dd-6e10-4448-9604-7a45a939552e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:32.869750 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aa1b11dd-6e10-4448-9604-7a45a939552e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:32.870445 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aa1b11dd-6e10-4448-9604-7a45a939552e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:32.887316 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aa1b11dd-6e10-4448-9604-7a45a939552e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:32.887896 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aa1b11dd-6e10-4448-9604-7a45a939552e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:32.919689 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e5892059-7bce-4736-b89a-67279de11fc7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:32.921499 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e5892059-7bce-4736-b89a-67279de11fc7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:32.946607 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e5892059-7bce-4736-b89a-67279de11fc7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:32.947028 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e5892059-7bce-4736-b89a-67279de11fc7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:32.947929 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e5892059-7bce-4736-b89a-67279de11fc7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:32.961091 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e5892059-7bce-4736-b89a-67279de11fc7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:33.279984 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-aa1b11dd-6e10-4448-9604-7a45a939552e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:33.289266 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e5892059-7bce-4736-b89a-67279de11fc7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:33.293096 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-aa1b11dd-6e10-4448-9604-7a45a939552e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1322 microversion: 2.1 time: 0.436297 May 03 08:54:33.294324 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 69/149] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:32 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1322 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:33.297946 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e5892059-7bce-4736-b89a-67279de11fc7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:33.299740 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e5892059-7bce-4736-b89a-67279de11fc7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:33.300888 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e5892059-7bce-4736-b89a-67279de11fc7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1406 microversion: 2.20 time: 0.385474 May 03 08:54:33.301732 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 81/150] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:54:32 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1406 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 08:54:33.337995 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-dc320713-edce-4443-afe6-baaadcb8cf16 req-c452b2b6-6b02-4437-a5e3-66e0636c58ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e33ce07e-908a-4708-8aef-351bd3e02368", "name": "network-vif-plugged", "status": "completed", "tag": "97dddf0c-2099-4aca-9f5f-d7bb688d0d06"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:54:33.346433 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-dc320713-edce-4443-afe6-baaadcb8cf16 req-c452b2b6-6b02-4437-a5e3-66e0636c58ec service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:33.346852 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-dc320713-edce-4443-afe6-baaadcb8cf16 req-c452b2b6-6b02-4437-a5e3-66e0636c58ec service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:33.358417 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-dc320713-edce-4443-afe6-baaadcb8cf16 req-c452b2b6-6b02-4437-a5e3-66e0636c58ec service nova] Creating event network-vif-plugged:97dddf0c-2099-4aca-9f5f-d7bb688d0d06 for instance e33ce07e-908a-4708-8aef-351bd3e02368 on hv-cinder-84027 May 03 08:54:33.363414 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-dc320713-edce-4443-afe6-baaadcb8cf16 req-c452b2b6-6b02-4437-a5e3-66e0636c58ec service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029021 May 03 08:54:33.364059 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 70/151] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 08:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:54:34.311368 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-2fd352af-5fa0-492a-a752-2bad8970c30d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:34.312033 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-2fd352af-5fa0-492a-a752-2bad8970c30d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:34.321517 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-050c8400-559b-4889-ae22-a9962217b9a9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:34.322536 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-050c8400-559b-4889-ae22-a9962217b9a9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:34.339282 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-050c8400-559b-4889-ae22-a9962217b9a9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:34.339729 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-050c8400-559b-4889-ae22-a9962217b9a9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:34.340522 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-050c8400-559b-4889-ae22-a9962217b9a9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:34.340952 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-050c8400-559b-4889-ae22-a9962217b9a9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:34.342695 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2fd352af-5fa0-492a-a752-2bad8970c30d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:34.342841 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2fd352af-5fa0-492a-a752-2bad8970c30d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:34.344806 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2fd352af-5fa0-492a-a752-2bad8970c30d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:34.346275 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2fd352af-5fa0-492a-a752-2bad8970c30d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:34.642555 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-050c8400-559b-4889-ae22-a9962217b9a9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:34.649754 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-2fd352af-5fa0-492a-a752-2bad8970c30d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:34.650680 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-050c8400-559b-4889-ae22-a9962217b9a9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:34.652210 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-050c8400-559b-4889-ae22-a9962217b9a9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:34.653337 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-050c8400-559b-4889-ae22-a9962217b9a9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1406 microversion: 2.20 time: 0.338596 May 03 08:54:34.653883 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 71/152] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:54:34 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1406 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:54:34.664780 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-2fd352af-5fa0-492a-a752-2bad8970c30d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1322 microversion: 2.1 time: 0.358364 May 03 08:54:34.665469 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 82/153] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:34 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1322 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:34.972960 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-684b62be-1480-4474-b31f-1df02fc7f4e6 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:34.973453 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-684b62be-1480-4474-b31f-1df02fc7f4e6 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] [instance: eb1259db-3249-432b-a8a2-f9ed13851671] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:34.984243 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-684b62be-1480-4474-b31f-1df02fc7f4e6 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:34.984693 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-684b62be-1480-4474-b31f-1df02fc7f4e6 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:34.985474 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-684b62be-1480-4474-b31f-1df02fc7f4e6 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:34.985894 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-684b62be-1480-4474-b31f-1df02fc7f4e6 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:35.010121 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-684b62be-1480-4474-b31f-1df02fc7f4e6 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] [instance: eb1259db-3249-432b-a8a2-f9ed13851671] Going to try to terminate instance {{(pid=123392) delete /opt/stack/nova/nova/compute/api.py:2664}} May 03 08:54:35.109217 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-684b62be-1480-4474-b31f-1df02fc7f4e6 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] 10.222.0.11 "DELETE /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671" status: 204 len: 0 microversion: 2.1 time: 0.140168 May 03 08:54:35.109909 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 72/154] 10.222.0.11 () {58 vars in 1238 bytes} [Tue May 3 08:54:34 2022] DELETE /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 03 08:54:35.120733 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-840168d4-0ea8-45b9-801c-bccf776640a1 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:35.124761 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-840168d4-0ea8-45b9-801c-bccf776640a1 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] [instance: eb1259db-3249-432b-a8a2-f9ed13851671] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:35.132288 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-840168d4-0ea8-45b9-801c-bccf776640a1 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:35.133347 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-840168d4-0ea8-45b9-801c-bccf776640a1 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:35.134332 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-840168d4-0ea8-45b9-801c-bccf776640a1 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:35.134761 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-840168d4-0ea8-45b9-801c-bccf776640a1 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:35.285441 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-840168d4-0ea8-45b9-801c-bccf776640a1 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f315597388e14d6ca2ffa1397d94fa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cfd646709540a4a85c64b7aeb5a523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:35.295443 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-840168d4-0ea8-45b9-801c-bccf776640a1 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] 10.222.0.11 "GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671" status: 200 len: 1554 microversion: 2.1 time: 0.181357 May 03 08:54:35.296290 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 83/155] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:35 2022] GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671 => generated 1554 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 08:54:35.674454 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a5eb8ecc-264f-41e6-b3bb-0052865a822e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:35.675161 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a5eb8ecc-264f-41e6-b3bb-0052865a822e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:35.683095 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c89aca47-928b-49c4-a37b-be77c6176f09 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:35.683563 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a5eb8ecc-264f-41e6-b3bb-0052865a822e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:35.683563 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a5eb8ecc-264f-41e6-b3bb-0052865a822e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:35.684048 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c89aca47-928b-49c4-a37b-be77c6176f09 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:35.684511 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a5eb8ecc-264f-41e6-b3bb-0052865a822e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:35.685014 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a5eb8ecc-264f-41e6-b3bb-0052865a822e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:35.690580 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c89aca47-928b-49c4-a37b-be77c6176f09 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:35.691259 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c89aca47-928b-49c4-a37b-be77c6176f09 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:35.692298 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c89aca47-928b-49c4-a37b-be77c6176f09 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:35.692733 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c89aca47-928b-49c4-a37b-be77c6176f09 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:35.905471 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a5eb8ecc-264f-41e6-b3bb-0052865a822e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:35.915398 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a5eb8ecc-264f-41e6-b3bb-0052865a822e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:35.921870 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a5eb8ecc-264f-41e6-b3bb-0052865a822e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:35.923508 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a5eb8ecc-264f-41e6-b3bb-0052865a822e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1406 microversion: 2.20 time: 0.255532 May 03 08:54:35.923976 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 73/156] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:54:35 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1406 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:54:35.934549 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c89aca47-928b-49c4-a37b-be77c6176f09 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:35.948406 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c89aca47-928b-49c4-a37b-be77c6176f09 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1322 microversion: 2.1 time: 0.270393 May 03 08:54:35.948961 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 84/157] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:35 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1322 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:36.314428 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b84d5e4e-8dfa-46f7-939e-a16418b2a3fd tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:36.315379 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b84d5e4e-8dfa-46f7-939e-a16418b2a3fd tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] [instance: eb1259db-3249-432b-a8a2-f9ed13851671] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:36.322517 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b84d5e4e-8dfa-46f7-939e-a16418b2a3fd tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:36.323399 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b84d5e4e-8dfa-46f7-939e-a16418b2a3fd tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:36.324132 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b84d5e4e-8dfa-46f7-939e-a16418b2a3fd tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:36.324745 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b84d5e4e-8dfa-46f7-939e-a16418b2a3fd tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:36.490543 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b84d5e4e-8dfa-46f7-939e-a16418b2a3fd tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f315597388e14d6ca2ffa1397d94fa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cfd646709540a4a85c64b7aeb5a523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:36.500473 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b84d5e4e-8dfa-46f7-939e-a16418b2a3fd tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] 10.222.0.11 "GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671" status: 200 len: 1554 microversion: 2.1 time: 0.190447 May 03 08:54:36.511044 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 74/158] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:36 2022] GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671 => generated 1554 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:36.943453 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-04864f0c-7c29-4831-a8f4-4cdb830d2a83 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:36.944402 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-04864f0c-7c29-4831-a8f4-4cdb830d2a83 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:36.950507 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-04864f0c-7c29-4831-a8f4-4cdb830d2a83 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:36.951173 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-04864f0c-7c29-4831-a8f4-4cdb830d2a83 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:36.952164 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-04864f0c-7c29-4831-a8f4-4cdb830d2a83 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:36.953187 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-04864f0c-7c29-4831-a8f4-4cdb830d2a83 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:36.965474 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7c1776a0-42f0-44e8-a23f-8ba6bcf1093b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:36.966985 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7c1776a0-42f0-44e8-a23f-8ba6bcf1093b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:36.976464 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7c1776a0-42f0-44e8-a23f-8ba6bcf1093b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:36.978020 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7c1776a0-42f0-44e8-a23f-8ba6bcf1093b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:36.979998 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7c1776a0-42f0-44e8-a23f-8ba6bcf1093b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:36.980908 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7c1776a0-42f0-44e8-a23f-8ba6bcf1093b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:37.165353 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-04864f0c-7c29-4831-a8f4-4cdb830d2a83 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:37.175816 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-04864f0c-7c29-4831-a8f4-4cdb830d2a83 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:37.177953 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-04864f0c-7c29-4831-a8f4-4cdb830d2a83 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:37.180098 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-04864f0c-7c29-4831-a8f4-4cdb830d2a83 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1406 microversion: 2.20 time: 0.240413 May 03 08:54:37.181111 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 85/159] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:54:36 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1406 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:54:37.198669 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7c1776a0-42f0-44e8-a23f-8ba6bcf1093b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:37.207399 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7c1776a0-42f0-44e8-a23f-8ba6bcf1093b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1322 microversion: 2.1 time: 0.246433 May 03 08:54:37.208294 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 75/160] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:36 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:37.519687 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-96565a34-d761-40d5-bb9e-76451da1f116 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:37.520648 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-96565a34-d761-40d5-bb9e-76451da1f116 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] [instance: eb1259db-3249-432b-a8a2-f9ed13851671] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:37.529239 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-96565a34-d761-40d5-bb9e-76451da1f116 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:37.529684 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-96565a34-d761-40d5-bb9e-76451da1f116 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:37.530446 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-96565a34-d761-40d5-bb9e-76451da1f116 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:37.530917 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-96565a34-d761-40d5-bb9e-76451da1f116 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:37.697730 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-96565a34-d761-40d5-bb9e-76451da1f116 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f315597388e14d6ca2ffa1397d94fa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cfd646709540a4a85c64b7aeb5a523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:37.707336 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-96565a34-d761-40d5-bb9e-76451da1f116 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] 10.222.0.11 "GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671" status: 200 len: 1554 microversion: 2.1 time: 0.192401 May 03 08:54:37.715933 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 86/161] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:37 2022] GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671 => generated 1554 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:38.198538 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-741b6f1c-3497-4c0d-9c11-fa33416d0583 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:38.203241 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-741b6f1c-3497-4c0d-9c11-fa33416d0583 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:38.217478 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-741b6f1c-3497-4c0d-9c11-fa33416d0583 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:38.222251 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-741b6f1c-3497-4c0d-9c11-fa33416d0583 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:38.225437 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-741b6f1c-3497-4c0d-9c11-fa33416d0583 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:38.225596 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a45e0c64-7b20-4d47-97e5-b27c92feba2f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:38.227114 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a45e0c64-7b20-4d47-97e5-b27c92feba2f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:38.230143 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-741b6f1c-3497-4c0d-9c11-fa33416d0583 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:38.237770 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a45e0c64-7b20-4d47-97e5-b27c92feba2f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:38.238479 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a45e0c64-7b20-4d47-97e5-b27c92feba2f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:38.240202 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a45e0c64-7b20-4d47-97e5-b27c92feba2f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:38.240833 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a45e0c64-7b20-4d47-97e5-b27c92feba2f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:38.494203 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-741b6f1c-3497-4c0d-9c11-fa33416d0583 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:38.501510 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a45e0c64-7b20-4d47-97e5-b27c92feba2f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:38.502024 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-741b6f1c-3497-4c0d-9c11-fa33416d0583 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:38.504060 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-741b6f1c-3497-4c0d-9c11-fa33416d0583 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:38.505438 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-741b6f1c-3497-4c0d-9c11-fa33416d0583 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1598 microversion: 2.20 time: 0.310872 May 03 08:54:38.506487 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 76/162] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:54:38 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1598 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:54:38.509950 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a45e0c64-7b20-4d47-97e5-b27c92feba2f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1322 microversion: 2.1 time: 0.288896 May 03 08:54:38.519114 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 87/163] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:38 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1322 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:38.527655 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e3656672-2dda-4604-aa3b-87f9a3b72ce5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:38.528169 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e3656672-2dda-4604-aa3b-87f9a3b72ce5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:38.534502 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e3656672-2dda-4604-aa3b-87f9a3b72ce5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:38.534954 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e3656672-2dda-4604-aa3b-87f9a3b72ce5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:38.535733 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e3656672-2dda-4604-aa3b-87f9a3b72ce5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:38.536199 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e3656672-2dda-4604-aa3b-87f9a3b72ce5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:38.619706 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e3656672-2dda-4604-aa3b-87f9a3b72ce5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.095939 May 03 08:54:38.620561 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 77/164] 10.222.0.11 () {60 vars in 1315 bytes} [Tue May 3 08:54:38 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:54:38.725180 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-141e89f6-ab63-4e27-a44b-cdd391dc0940 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:38.726017 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-141e89f6-ab63-4e27-a44b-cdd391dc0940 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] [instance: eb1259db-3249-432b-a8a2-f9ed13851671] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:38.733298 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-141e89f6-ab63-4e27-a44b-cdd391dc0940 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:38.733988 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-141e89f6-ab63-4e27-a44b-cdd391dc0940 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:38.734757 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-141e89f6-ab63-4e27-a44b-cdd391dc0940 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:38.735177 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-141e89f6-ab63-4e27-a44b-cdd391dc0940 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:38.983966 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-141e89f6-ab63-4e27-a44b-cdd391dc0940 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f315597388e14d6ca2ffa1397d94fa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cfd646709540a4a85c64b7aeb5a523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:38.991854 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-141e89f6-ab63-4e27-a44b-cdd391dc0940 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] 10.222.0.11 "GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671" status: 200 len: 1554 microversion: 2.1 time: 0.270862 May 03 08:54:39.003949 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 88/165] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:38 2022] GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671 => generated 1554 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:39.530184 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7959e456-738d-4ebb-aabe-19e5d2078982 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:39.530995 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7959e456-738d-4ebb-aabe-19e5d2078982 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:39.539059 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7959e456-738d-4ebb-aabe-19e5d2078982 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:39.539847 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7959e456-738d-4ebb-aabe-19e5d2078982 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:39.541140 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7959e456-738d-4ebb-aabe-19e5d2078982 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:39.541747 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7959e456-738d-4ebb-aabe-19e5d2078982 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:39.929769 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7959e456-738d-4ebb-aabe-19e5d2078982 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:39.940488 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7959e456-738d-4ebb-aabe-19e5d2078982 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1322 microversion: 2.1 time: 0.416499 May 03 08:54:39.957099 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 78/166] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:39 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1322 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:40.010052 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-acbc5998-3462-4657-bb6e-ef9f3022d26e tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:40.010660 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-acbc5998-3462-4657-bb6e-ef9f3022d26e tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] [instance: eb1259db-3249-432b-a8a2-f9ed13851671] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:40.016559 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-acbc5998-3462-4657-bb6e-ef9f3022d26e tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:40.017000 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-acbc5998-3462-4657-bb6e-ef9f3022d26e tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:40.017931 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-acbc5998-3462-4657-bb6e-ef9f3022d26e tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:40.018360 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-acbc5998-3462-4657-bb6e-ef9f3022d26e tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:40.142942 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-69185c96-0e04-4008-8031-1961ba174cd4 req-9912000b-4a43-4749-aaab-d52b9e7de4ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b68d79a3-e9c5-46b6-b8c0-a9d6017f388f", "tag": "c0a78137-d132-441d-8bd5-1d74354f3e67"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:54:40.152967 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-69185c96-0e04-4008-8031-1961ba174cd4 req-9912000b-4a43-4749-aaab-d52b9e7de4ae service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:40.153547 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-69185c96-0e04-4008-8031-1961ba174cd4 req-9912000b-4a43-4749-aaab-d52b9e7de4ae service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:40.168856 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-69185c96-0e04-4008-8031-1961ba174cd4 req-9912000b-4a43-4749-aaab-d52b9e7de4ae service nova] Creating event network-changed:c0a78137-d132-441d-8bd5-1d74354f3e67 for instance b68d79a3-e9c5-46b6-b8c0-a9d6017f388f on hv-cinder-84027 May 03 08:54:40.180892 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-69185c96-0e04-4008-8031-1961ba174cd4 req-9912000b-4a43-4749-aaab-d52b9e7de4ae service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042521 May 03 08:54:40.182244 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 79/167] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 08:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 08:54:40.198935 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-acbc5998-3462-4657-bb6e-ef9f3022d26e tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f315597388e14d6ca2ffa1397d94fa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cfd646709540a4a85c64b7aeb5a523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:40.226011 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-acbc5998-3462-4657-bb6e-ef9f3022d26e tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] 10.222.0.11 "GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671" status: 200 len: 1554 microversion: 2.1 time: 0.221433 May 03 08:54:40.227137 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 89/168] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:40 2022] GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671 => generated 1554 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:40.959055 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-40c93edf-ff96-4d58-b5b0-1ab92f84a237 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:40.959814 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-40c93edf-ff96-4d58-b5b0-1ab92f84a237 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:40.966518 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-40c93edf-ff96-4d58-b5b0-1ab92f84a237 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:40.966971 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-40c93edf-ff96-4d58-b5b0-1ab92f84a237 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:40.967748 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-40c93edf-ff96-4d58-b5b0-1ab92f84a237 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:40.968214 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-40c93edf-ff96-4d58-b5b0-1ab92f84a237 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:41.133599 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-40c93edf-ff96-4d58-b5b0-1ab92f84a237 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:41.144047 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-40c93edf-ff96-4d58-b5b0-1ab92f84a237 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1322 microversion: 2.1 time: 0.190185 May 03 08:54:41.144895 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 80/169] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:40 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:41.243705 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-265259ae-de39-4d68-a00a-6d2418c52a8f tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:41.244546 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-265259ae-de39-4d68-a00a-6d2418c52a8f tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] [instance: eb1259db-3249-432b-a8a2-f9ed13851671] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:41.253556 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-265259ae-de39-4d68-a00a-6d2418c52a8f tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:41.254265 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-265259ae-de39-4d68-a00a-6d2418c52a8f tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:41.255307 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-265259ae-de39-4d68-a00a-6d2418c52a8f tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:41.255741 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-265259ae-de39-4d68-a00a-6d2418c52a8f tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:41.698682 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-265259ae-de39-4d68-a00a-6d2418c52a8f tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f315597388e14d6ca2ffa1397d94fa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cfd646709540a4a85c64b7aeb5a523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:41.709990 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-265259ae-de39-4d68-a00a-6d2418c52a8f tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] 10.222.0.11 "GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671" status: 200 len: 1554 microversion: 2.1 time: 0.470177 May 03 08:54:41.710825 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 90/170] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:41 2022] GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671 => generated 1554 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:42.164364 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-fe37b34a-b603-4ea0-8e07-a12c7d05fa08 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:42.166217 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-fe37b34a-b603-4ea0-8e07-a12c7d05fa08 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:42.184608 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fe37b34a-b603-4ea0-8e07-a12c7d05fa08 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:42.185156 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fe37b34a-b603-4ea0-8e07-a12c7d05fa08 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:42.185959 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fe37b34a-b603-4ea0-8e07-a12c7d05fa08 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:42.186398 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fe37b34a-b603-4ea0-8e07-a12c7d05fa08 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:42.213440 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [req-b316357a-827b-4390-9252-993a2a7bc06a req-ddd1f75e-53e4-4107-a083-c51203089487 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb1259db-3249-432b-a8a2-f9ed13851671", "name": "network-vif-deleted", "tag": "04da02f0-8439-4fde-b108-b007aeba8b59"}]} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:54:42.225799 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-b316357a-827b-4390-9252-993a2a7bc06a req-ddd1f75e-53e4-4107-a083-c51203089487 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:42.226773 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-b316357a-827b-4390-9252-993a2a7bc06a req-ddd1f75e-53e4-4107-a083-c51203089487 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:42.243083 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.compute.server_external_events [req-b316357a-827b-4390-9252-993a2a7bc06a req-ddd1f75e-53e4-4107-a083-c51203089487 service nova] Creating event network-vif-deleted:04da02f0-8439-4fde-b108-b007aeba8b59 for instance eb1259db-3249-432b-a8a2-f9ed13851671 on hv-cinder-84027 May 03 08:54:42.249601 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [req-b316357a-827b-4390-9252-993a2a7bc06a req-ddd1f75e-53e4-4107-a083-c51203089487 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040515 May 03 08:54:42.251579 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 91/171] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 08:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:54:42.503497 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-fe37b34a-b603-4ea0-8e07-a12c7d05fa08 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:42.525331 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-fe37b34a-b603-4ea0-8e07-a12c7d05fa08 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1516 microversion: 2.1 time: 0.365642 May 03 08:54:42.538608 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 81/172] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:42 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1516 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:42.546371 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-fd6ff0df-df70-44b6-b5ea-d9d15a2bf222 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:54:42.547553 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-fd6ff0df-df70-44b6-b5ea-d9d15a2bf222 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:42.560674 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fd6ff0df-df70-44b6-b5ea-d9d15a2bf222 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:42.561164 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fd6ff0df-df70-44b6-b5ea-d9d15a2bf222 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:42.564456 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fd6ff0df-df70-44b6-b5ea-d9d15a2bf222 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:42.567485 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fd6ff0df-df70-44b6-b5ea-d9d15a2bf222 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:42.644007 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.objects.instance [None req-fd6ff0df-df70-44b6-b5ea-d9d15a2bf222 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lazy-loading 'flavor' on Instance uuid e33ce07e-908a-4708-8aef-351bd3e02368 {{(pid=123391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 03 08:54:42.726934 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d5038af9-f476-4854-8563-408c47eb8651 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:42.727934 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d5038af9-f476-4854-8563-408c47eb8651 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] [instance: eb1259db-3249-432b-a8a2-f9ed13851671] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:42.735020 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d5038af9-f476-4854-8563-408c47eb8651 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:42.735456 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d5038af9-f476-4854-8563-408c47eb8651 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:42.736250 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d5038af9-f476-4854-8563-408c47eb8651 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:42.736680 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d5038af9-f476-4854-8563-408c47eb8651 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:42.775607 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-fd6ff0df-df70-44b6-b5ea-d9d15a2bf222 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "POST /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368/action" status: 200 len: 32 microversion: 2.1 time: 0.232099 May 03 08:54:42.776910 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 92/173] 10.222.0.11 () {60 vars in 1277 bytes} [Tue May 3 08:54:42 2022] POST /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368/action => generated 32 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 03 08:54:42.787416 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-1dd43ba4-762d-4e1a-b467-ff1fc2b1a303 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:42.787820 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-1dd43ba4-762d-4e1a-b467-ff1fc2b1a303 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:42.794718 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1dd43ba4-762d-4e1a-b467-ff1fc2b1a303 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:42.795291 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1dd43ba4-762d-4e1a-b467-ff1fc2b1a303 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:42.796204 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1dd43ba4-762d-4e1a-b467-ff1fc2b1a303 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:42.796840 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1dd43ba4-762d-4e1a-b467-ff1fc2b1a303 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:42.821380 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d5038af9-f476-4854-8563-408c47eb8651 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f315597388e14d6ca2ffa1397d94fa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cfd646709540a4a85c64b7aeb5a523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:42.831909 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d5038af9-f476-4854-8563-408c47eb8651 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] 10.222.0.11 "GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671" status: 200 len: 1512 microversion: 2.1 time: 0.108896 May 03 08:54:42.832918 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 82/174] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:42 2022] GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671 => generated 1512 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 08:54:42.934208 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-1dd43ba4-762d-4e1a-b467-ff1fc2b1a303 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:42.951082 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-1dd43ba4-762d-4e1a-b467-ff1fc2b1a303 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1522 microversion: 2.1 time: 0.168890 May 03 08:54:42.951738 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 93/175] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:42 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:43.854880 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-11b273c3-0ede-48b4-95bd-f36ff59632b4 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:43.855494 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-11b273c3-0ede-48b4-95bd-f36ff59632b4 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] [instance: eb1259db-3249-432b-a8a2-f9ed13851671] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:43.863350 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-11b273c3-0ede-48b4-95bd-f36ff59632b4 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:43.863537 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-11b273c3-0ede-48b4-95bd-f36ff59632b4 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:43.865705 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-11b273c3-0ede-48b4-95bd-f36ff59632b4 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:43.866369 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-11b273c3-0ede-48b4-95bd-f36ff59632b4 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:43.913584 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-11b273c3-0ede-48b4-95bd-f36ff59632b4 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:43.914196 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-11b273c3-0ede-48b4-95bd-f36ff59632b4 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:43.914963 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.objects.instance [None req-11b273c3-0ede-48b4-95bd-f36ff59632b4 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lazy-loading 'fault' on Instance uuid eb1259db-3249-432b-a8a2-f9ed13851671 {{(pid=123392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 03 08:54:43.968101 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f6cbb671-0603-4a75-8c4a-134958ab77d1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:43.968786 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f6cbb671-0603-4a75-8c4a-134958ab77d1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:43.976148 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f6cbb671-0603-4a75-8c4a-134958ab77d1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:43.978368 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f6cbb671-0603-4a75-8c4a-134958ab77d1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:43.988874 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f6cbb671-0603-4a75-8c4a-134958ab77d1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:43.989593 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f6cbb671-0603-4a75-8c4a-134958ab77d1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:43.999970 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-11b273c3-0ede-48b4-95bd-f36ff59632b4 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f315597388e14d6ca2ffa1397d94fa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cfd646709540a4a85c64b7aeb5a523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:44.011539 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-11b273c3-0ede-48b4-95bd-f36ff59632b4 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] 10.222.0.11 "GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671" status: 200 len: 1517 microversion: 2.1 time: 0.165579 May 03 08:54:44.015885 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 83/176] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:43 2022] GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671 => generated 1517 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:44.497057 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f6cbb671-0603-4a75-8c4a-134958ab77d1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:44.504735 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f6cbb671-0603-4a75-8c4a-134958ab77d1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1522 microversion: 2.1 time: 0.541014 May 03 08:54:44.505629 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 94/177] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:43 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1522 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:45.037447 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d3157c32-9779-4f65-a41e-32ab30ee48dd tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:45.038807 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d3157c32-9779-4f65-a41e-32ab30ee48dd tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] [instance: eb1259db-3249-432b-a8a2-f9ed13851671] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:45.048273 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d3157c32-9779-4f65-a41e-32ab30ee48dd tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:45.049028 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d3157c32-9779-4f65-a41e-32ab30ee48dd tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:45.049725 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d3157c32-9779-4f65-a41e-32ab30ee48dd tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:45.050318 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d3157c32-9779-4f65-a41e-32ab30ee48dd tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:45.066196 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-d3157c32-9779-4f65-a41e-32ab30ee48dd tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] HTTP exception thrown: Instance eb1259db-3249-432b-a8a2-f9ed13851671 could not be found. May 03 08:54:45.066800 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d3157c32-9779-4f65-a41e-32ab30ee48dd tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Returning 404 to user: Instance eb1259db-3249-432b-a8a2-f9ed13851671 could not be found. {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 08:54:45.067634 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d3157c32-9779-4f65-a41e-32ab30ee48dd tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] 10.222.0.11 "GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671" status: 404 len: 111 microversion: 2.1 time: 0.034639 May 03 08:54:45.068519 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 84/178] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:45 2022] GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 08:54:45.172808 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-76c1a309-dc6c-481f-807d-c8cfaee8447e tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:45.173860 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-76c1a309-dc6c-481f-807d-c8cfaee8447e tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] [instance: eb1259db-3249-432b-a8a2-f9ed13851671] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:45.179886 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-76c1a309-dc6c-481f-807d-c8cfaee8447e tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:45.180505 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-76c1a309-dc6c-481f-807d-c8cfaee8447e tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:45.181418 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-76c1a309-dc6c-481f-807d-c8cfaee8447e tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:45.182014 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-76c1a309-dc6c-481f-807d-c8cfaee8447e tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:45.197153 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.wsgi [None req-76c1a309-dc6c-481f-807d-c8cfaee8447e tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] HTTP exception thrown: Instance eb1259db-3249-432b-a8a2-f9ed13851671 could not be found. May 03 08:54:45.198123 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-76c1a309-dc6c-481f-807d-c8cfaee8447e tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Returning 404 to user: Instance eb1259db-3249-432b-a8a2-f9ed13851671 could not be found. {{(pid=123391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 08:54:45.199002 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-76c1a309-dc6c-481f-807d-c8cfaee8447e tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] 10.222.0.11 "GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.030302 May 03 08:54:45.199649 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 95/179] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 08:54:45 2022] GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671/os-volume_attachments => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 08:54:45.529224 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-1c8156d1-7af2-4c09-8e70-e5d8dac8eece tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:45.529224 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-1c8156d1-7af2-4c09-8e70-e5d8dac8eece tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:45.539293 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1c8156d1-7af2-4c09-8e70-e5d8dac8eece tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:45.539293 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1c8156d1-7af2-4c09-8e70-e5d8dac8eece tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:45.539293 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1c8156d1-7af2-4c09-8e70-e5d8dac8eece tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:45.539293 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1c8156d1-7af2-4c09-8e70-e5d8dac8eece tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:45.674132 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-1c8156d1-7af2-4c09-8e70-e5d8dac8eece tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:45.684001 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-1c8156d1-7af2-4c09-8e70-e5d8dac8eece tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1522 microversion: 2.1 time: 0.163525 May 03 08:54:45.684001 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 85/180] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:45 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:46.433295 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-11ea0cde-6aab-4866-bb78-d2f83f61c746 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:46.433973 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-11ea0cde-6aab-4866-bb78-d2f83f61c746 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] [instance: eb1259db-3249-432b-a8a2-f9ed13851671] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:46.440839 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-11ea0cde-6aab-4866-bb78-d2f83f61c746 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:46.441283 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-11ea0cde-6aab-4866-bb78-d2f83f61c746 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:46.442155 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-11ea0cde-6aab-4866-bb78-d2f83f61c746 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:46.442650 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-11ea0cde-6aab-4866-bb78-d2f83f61c746 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:46.458172 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.wsgi [None req-11ea0cde-6aab-4866-bb78-d2f83f61c746 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] HTTP exception thrown: Instance eb1259db-3249-432b-a8a2-f9ed13851671 could not be found. May 03 08:54:46.458764 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-11ea0cde-6aab-4866-bb78-d2f83f61c746 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Returning 404 to user: Instance eb1259db-3249-432b-a8a2-f9ed13851671 could not be found. {{(pid=123391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 08:54:46.459600 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-11ea0cde-6aab-4866-bb78-d2f83f61c746 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] 10.222.0.11 "DELETE /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671" status: 404 len: 111 microversion: 2.1 time: 0.030943 May 03 08:54:46.460193 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 96/181] 10.222.0.11 () {58 vars in 1238 bytes} [Tue May 3 08:54:46 2022] DELETE /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 08:54:46.468792 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a495dd74-7a50-422b-b942-5a663a10d2f3 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:46.469408 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a495dd74-7a50-422b-b942-5a663a10d2f3 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] [instance: eb1259db-3249-432b-a8a2-f9ed13851671] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:46.476226 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a495dd74-7a50-422b-b942-5a663a10d2f3 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:46.476677 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a495dd74-7a50-422b-b942-5a663a10d2f3 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:46.477454 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a495dd74-7a50-422b-b942-5a663a10d2f3 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:46.477885 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a495dd74-7a50-422b-b942-5a663a10d2f3 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:46.491687 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-a495dd74-7a50-422b-b942-5a663a10d2f3 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] HTTP exception thrown: Instance eb1259db-3249-432b-a8a2-f9ed13851671 could not be found. May 03 08:54:46.492319 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a495dd74-7a50-422b-b942-5a663a10d2f3 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] Returning 404 to user: Instance eb1259db-3249-432b-a8a2-f9ed13851671 could not be found. {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 08:54:46.493211 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a495dd74-7a50-422b-b942-5a663a10d2f3 tempest-DeleteServersTestJSON-1857473241 tempest-DeleteServersTestJSON-1857473241-project] 10.222.0.11 "GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671" status: 404 len: 111 microversion: 2.1 time: 0.028382 May 03 08:54:46.493663 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 86/182] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:46 2022] GET /compute/v2.1/servers/eb1259db-3249-432b-a8a2-f9ed13851671 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 08:54:46.699970 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-de1b66d8-4e3c-4ee7-a4d6-ccb199446762 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:46.701118 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-de1b66d8-4e3c-4ee7-a4d6-ccb199446762 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:46.709041 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-de1b66d8-4e3c-4ee7-a4d6-ccb199446762 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:46.709980 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-de1b66d8-4e3c-4ee7-a4d6-ccb199446762 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:46.711186 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-de1b66d8-4e3c-4ee7-a4d6-ccb199446762 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:46.711832 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-de1b66d8-4e3c-4ee7-a4d6-ccb199446762 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:46.944540 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-de1b66d8-4e3c-4ee7-a4d6-ccb199446762 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:46.953706 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-de1b66d8-4e3c-4ee7-a4d6-ccb199446762 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1522 microversion: 2.1 time: 0.258751 May 03 08:54:46.956008 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 97/183] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:46 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:47.970492 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6232d0fe-835b-4181-be8b-5b3b843210e2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:47.971101 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6232d0fe-835b-4181-be8b-5b3b843210e2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:47.977921 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6232d0fe-835b-4181-be8b-5b3b843210e2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:47.978373 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6232d0fe-835b-4181-be8b-5b3b843210e2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:47.979431 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6232d0fe-835b-4181-be8b-5b3b843210e2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:47.979886 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6232d0fe-835b-4181-be8b-5b3b843210e2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:48.111096 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6232d0fe-835b-4181-be8b-5b3b843210e2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:48.119574 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6232d0fe-835b-4181-be8b-5b3b843210e2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1522 microversion: 2.1 time: 0.152993 May 03 08:54:48.120410 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 87/184] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:47 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:49.138275 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a9d59e4f-020d-4beb-86b5-c4b68a149553 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:49.140188 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a9d59e4f-020d-4beb-86b5-c4b68a149553 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:49.147059 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a9d59e4f-020d-4beb-86b5-c4b68a149553 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:49.147563 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a9d59e4f-020d-4beb-86b5-c4b68a149553 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:49.148395 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a9d59e4f-020d-4beb-86b5-c4b68a149553 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:49.148820 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a9d59e4f-020d-4beb-86b5-c4b68a149553 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:49.300290 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a9d59e4f-020d-4beb-86b5-c4b68a149553 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:49.308996 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a9d59e4f-020d-4beb-86b5-c4b68a149553 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1522 microversion: 2.1 time: 0.175014 May 03 08:54:49.309890 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 98/185] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:49 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:50.333345 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d376dfed-5748-427a-95ce-fb3b458d70ce tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:50.334110 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d376dfed-5748-427a-95ce-fb3b458d70ce tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:50.341746 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d376dfed-5748-427a-95ce-fb3b458d70ce tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:50.342643 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d376dfed-5748-427a-95ce-fb3b458d70ce tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:50.343539 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d376dfed-5748-427a-95ce-fb3b458d70ce tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:50.344084 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d376dfed-5748-427a-95ce-fb3b458d70ce tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:50.484756 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d376dfed-5748-427a-95ce-fb3b458d70ce tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:50.492553 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d376dfed-5748-427a-95ce-fb3b458d70ce tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1522 microversion: 2.1 time: 0.163627 May 03 08:54:50.493317 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 88/186] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:50 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:51.510755 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ce0be483-2b1e-48e4-8e19-52415d08465d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:51.511358 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ce0be483-2b1e-48e4-8e19-52415d08465d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:51.517334 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ce0be483-2b1e-48e4-8e19-52415d08465d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:51.517695 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ce0be483-2b1e-48e4-8e19-52415d08465d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:51.518458 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ce0be483-2b1e-48e4-8e19-52415d08465d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:51.518878 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ce0be483-2b1e-48e4-8e19-52415d08465d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:51.673485 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ce0be483-2b1e-48e4-8e19-52415d08465d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:51.681402 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ce0be483-2b1e-48e4-8e19-52415d08465d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1522 microversion: 2.1 time: 0.174412 May 03 08:54:51.682163 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 99/187] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:51 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:52.704969 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9c2b9d8f-5a0b-463e-b115-8b7651029883 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:52.705570 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9c2b9d8f-5a0b-463e-b115-8b7651029883 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:52.714790 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9c2b9d8f-5a0b-463e-b115-8b7651029883 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:52.715235 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9c2b9d8f-5a0b-463e-b115-8b7651029883 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:52.716023 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9c2b9d8f-5a0b-463e-b115-8b7651029883 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:52.716637 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9c2b9d8f-5a0b-463e-b115-8b7651029883 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:52.857383 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9c2b9d8f-5a0b-463e-b115-8b7651029883 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:52.865126 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9c2b9d8f-5a0b-463e-b115-8b7651029883 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1522 microversion: 2.1 time: 0.163853 May 03 08:54:52.865699 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 89/188] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:52 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:53.882181 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-2e79c732-6eac-422f-9c79-e00f0245e6a5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:53.882914 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-2e79c732-6eac-422f-9c79-e00f0245e6a5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:53.889039 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2e79c732-6eac-422f-9c79-e00f0245e6a5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:53.889526 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2e79c732-6eac-422f-9c79-e00f0245e6a5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:53.890295 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2e79c732-6eac-422f-9c79-e00f0245e6a5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:53.890736 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2e79c732-6eac-422f-9c79-e00f0245e6a5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:54.026300 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-2e79c732-6eac-422f-9c79-e00f0245e6a5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:54.033538 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-2e79c732-6eac-422f-9c79-e00f0245e6a5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1522 microversion: 2.1 time: 0.155403 May 03 08:54:54.034111 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 100/189] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:53 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:55.050712 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ed493108-c8a5-4b0c-af26-b03e926c6d7b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:55.051293 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ed493108-c8a5-4b0c-af26-b03e926c6d7b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:55.058721 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ed493108-c8a5-4b0c-af26-b03e926c6d7b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:55.059487 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ed493108-c8a5-4b0c-af26-b03e926c6d7b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:55.060464 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ed493108-c8a5-4b0c-af26-b03e926c6d7b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:55.060899 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ed493108-c8a5-4b0c-af26-b03e926c6d7b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:55.231910 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ed493108-c8a5-4b0c-af26-b03e926c6d7b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:55.240426 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ed493108-c8a5-4b0c-af26-b03e926c6d7b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1522 microversion: 2.1 time: 0.193779 May 03 08:54:55.241284 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 90/190] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:55 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:56.258236 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e49fa293-1c95-4e0c-a6f3-55fd92d93820 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:56.259507 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e49fa293-1c95-4e0c-a6f3-55fd92d93820 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:56.266530 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e49fa293-1c95-4e0c-a6f3-55fd92d93820 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:56.267221 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e49fa293-1c95-4e0c-a6f3-55fd92d93820 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:56.268122 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e49fa293-1c95-4e0c-a6f3-55fd92d93820 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:56.268670 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e49fa293-1c95-4e0c-a6f3-55fd92d93820 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:56.499123 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e49fa293-1c95-4e0c-a6f3-55fd92d93820 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:56.506580 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e49fa293-1c95-4e0c-a6f3-55fd92d93820 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1522 microversion: 2.1 time: 0.252371 May 03 08:54:56.507156 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 101/191] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:56 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:54:57.523693 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-654e3265-5b5e-4c45-9b0e-8ef4e05a6c58 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:57.524337 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-654e3265-5b5e-4c45-9b0e-8ef4e05a6c58 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:57.532058 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-654e3265-5b5e-4c45-9b0e-8ef4e05a6c58 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:57.532505 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-654e3265-5b5e-4c45-9b0e-8ef4e05a6c58 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:57.533279 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-654e3265-5b5e-4c45-9b0e-8ef4e05a6c58 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:57.533709 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-654e3265-5b5e-4c45-9b0e-8ef4e05a6c58 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:57.805806 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-654e3265-5b5e-4c45-9b0e-8ef4e05a6c58 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:57.814108 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-654e3265-5b5e-4c45-9b0e-8ef4e05a6c58 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1522 microversion: 2.1 time: 0.294769 May 03 08:54:57.814690 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 91/192] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:57 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 08:54:58.832274 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-032ffa32-8e7f-46f0-96d2-8c5b2d10eca2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:54:58.832893 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-032ffa32-8e7f-46f0-96d2-8c5b2d10eca2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:54:58.846468 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-032ffa32-8e7f-46f0-96d2-8c5b2d10eca2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:58.846936 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-032ffa32-8e7f-46f0-96d2-8c5b2d10eca2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:58.847726 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-032ffa32-8e7f-46f0-96d2-8c5b2d10eca2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:54:58.848155 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-032ffa32-8e7f-46f0-96d2-8c5b2d10eca2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:54:59.059549 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-032ffa32-8e7f-46f0-96d2-8c5b2d10eca2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:54:59.068298 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-032ffa32-8e7f-46f0-96d2-8c5b2d10eca2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1522 microversion: 2.1 time: 0.239352 May 03 08:54:59.069067 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 102/193] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:54:58 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 08:55:00.094514 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7ef3a3c3-74d0-442a-80ec-aae30711aad7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:00.096521 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7ef3a3c3-74d0-442a-80ec-aae30711aad7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:00.113968 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7ef3a3c3-74d0-442a-80ec-aae30711aad7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:00.114779 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7ef3a3c3-74d0-442a-80ec-aae30711aad7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:00.116229 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7ef3a3c3-74d0-442a-80ec-aae30711aad7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:00.116871 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7ef3a3c3-74d0-442a-80ec-aae30711aad7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:00.288852 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7ef3a3c3-74d0-442a-80ec-aae30711aad7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:00.298453 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7ef3a3c3-74d0-442a-80ec-aae30711aad7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1522 microversion: 2.1 time: 0.210943 May 03 08:55:00.299045 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 92/194] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:00 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:01.315143 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-23fd8c07-46eb-4a31-879f-2f8e47abe096 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:01.315866 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-23fd8c07-46eb-4a31-879f-2f8e47abe096 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:01.321570 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-23fd8c07-46eb-4a31-879f-2f8e47abe096 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:01.322008 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-23fd8c07-46eb-4a31-879f-2f8e47abe096 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:01.322762 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-23fd8c07-46eb-4a31-879f-2f8e47abe096 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:01.323187 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-23fd8c07-46eb-4a31-879f-2f8e47abe096 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:01.457688 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-23fd8c07-46eb-4a31-879f-2f8e47abe096 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:01.465689 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-23fd8c07-46eb-4a31-879f-2f8e47abe096 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1522 microversion: 2.1 time: 0.154386 May 03 08:55:01.466190 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 103/195] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:01 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:02.483331 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9e8fdfcb-d406-4b1f-9c4b-6b5bdaa61715 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:02.484024 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9e8fdfcb-d406-4b1f-9c4b-6b5bdaa61715 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:02.496147 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9e8fdfcb-d406-4b1f-9c4b-6b5bdaa61715 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:02.497498 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9e8fdfcb-d406-4b1f-9c4b-6b5bdaa61715 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:02.498390 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9e8fdfcb-d406-4b1f-9c4b-6b5bdaa61715 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:02.500048 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9e8fdfcb-d406-4b1f-9c4b-6b5bdaa61715 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:02.721504 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9e8fdfcb-d406-4b1f-9c4b-6b5bdaa61715 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:02.731021 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9e8fdfcb-d406-4b1f-9c4b-6b5bdaa61715 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1522 microversion: 2.1 time: 0.251855 May 03 08:55:02.733824 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 93/196] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:02 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:03.749900 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-87e52277-3f73-4bde-b9c4-1ad8f0371158 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:03.751206 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-87e52277-3f73-4bde-b9c4-1ad8f0371158 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:03.761300 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-87e52277-3f73-4bde-b9c4-1ad8f0371158 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:03.761940 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-87e52277-3f73-4bde-b9c4-1ad8f0371158 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:03.764733 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-87e52277-3f73-4bde-b9c4-1ad8f0371158 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:03.765353 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-87e52277-3f73-4bde-b9c4-1ad8f0371158 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:04.115918 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-87e52277-3f73-4bde-b9c4-1ad8f0371158 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:04.142470 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-87e52277-3f73-4bde-b9c4-1ad8f0371158 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1522 microversion: 2.1 time: 0.382400 May 03 08:55:04.143359 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 104/197] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:03 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1522 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 08:55:05.166431 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-8cd395c2-f7a1-480f-b68b-fb27aa716697 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:05.167062 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-8cd395c2-f7a1-480f-b68b-fb27aa716697 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:05.192913 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8cd395c2-f7a1-480f-b68b-fb27aa716697 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:05.193576 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8cd395c2-f7a1-480f-b68b-fb27aa716697 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:05.194440 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8cd395c2-f7a1-480f-b68b-fb27aa716697 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:05.194922 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8cd395c2-f7a1-480f-b68b-fb27aa716697 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:06.056246 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-8cd395c2-f7a1-480f-b68b-fb27aa716697 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:06.064529 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-8cd395c2-f7a1-480f-b68b-fb27aa716697 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1522 microversion: 2.1 time: 0.906886 May 03 08:55:06.072415 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 94/198] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:05 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1522 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:07.053077 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-4228db3f-e2b9-4b9d-b7a5-4da4f5d38922 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Action: 'create', calling method: .version_select at 0x7f09cf04d040>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1090483213"}} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:55:07.072805 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.quota [None req-4228db3f-e2b9-4b9d-b7a5-4da4f5d38922 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Getting quotas for project ffda909ab345414b8962364cf2f5738f. Resources: {'key_pairs'} {{(pid=123391) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 03 08:55:07.077031 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.quota [None req-4228db3f-e2b9-4b9d-b7a5-4da4f5d38922 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Getting quotas for user f3e7163264a04db9a3b18aea3ae7631b and project ffda909ab345414b8962364cf2f5738f. Resources: {'key_pairs'} {{(pid=123391) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 03 08:55:07.090041 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-409fd346-ee86-46bf-bd23-b6871d4c933c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:07.091295 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-409fd346-ee86-46bf-bd23-b6871d4c933c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:07.104756 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-409fd346-ee86-46bf-bd23-b6871d4c933c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:07.105241 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-409fd346-ee86-46bf-bd23-b6871d4c933c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:07.108995 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-409fd346-ee86-46bf-bd23-b6871d4c933c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:07.110721 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-409fd346-ee86-46bf-bd23-b6871d4c933c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:07.275141 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-409fd346-ee86-46bf-bd23-b6871d4c933c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:07.287734 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-409fd346-ee86-46bf-bd23-b6871d4c933c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1522 microversion: 2.1 time: 0.202080 May 03 08:55:07.288793 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 95/199] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:07 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:07.303561 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.quota [None req-4228db3f-e2b9-4b9d-b7a5-4da4f5d38922 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Getting quotas for project ffda909ab345414b8962364cf2f5738f. Resources: {'key_pairs'} {{(pid=123391) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 03 08:55:07.307505 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.quota [None req-4228db3f-e2b9-4b9d-b7a5-4da4f5d38922 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Getting quotas for user f3e7163264a04db9a3b18aea3ae7631b and project ffda909ab345414b8962364cf2f5738f. Resources: {'key_pairs'} {{(pid=123391) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 03 08:55:07.321603 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-4228db3f-e2b9-4b9d-b7a5-4da4f5d38922 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.537444 May 03 08:55:07.322301 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 105/200] 10.222.0.11 () {60 vars in 1157 bytes} [Tue May 3 08:55:06 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:08.306550 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6e540221-4fb0-47fd-a151-f028d13e0114 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:08.307350 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6e540221-4fb0-47fd-a151-f028d13e0114 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:08.314547 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6e540221-4fb0-47fd-a151-f028d13e0114 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:08.315701 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6e540221-4fb0-47fd-a151-f028d13e0114 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:08.317006 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6e540221-4fb0-47fd-a151-f028d13e0114 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:08.317769 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6e540221-4fb0-47fd-a151-f028d13e0114 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:08.558177 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6e540221-4fb0-47fd-a151-f028d13e0114 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:08.571594 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6e540221-4fb0-47fd-a151-f028d13e0114 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1522 microversion: 2.1 time: 0.269182 May 03 08:55:08.572347 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 96/201] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:08 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1522 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:09.590613 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-641cc91d-8604-4d0d-9243-d0c0b2ff85d0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:09.592086 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-641cc91d-8604-4d0d-9243-d0c0b2ff85d0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:09.601248 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-641cc91d-8604-4d0d-9243-d0c0b2ff85d0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:09.602032 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-641cc91d-8604-4d0d-9243-d0c0b2ff85d0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:09.603998 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-641cc91d-8604-4d0d-9243-d0c0b2ff85d0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:09.604676 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-641cc91d-8604-4d0d-9243-d0c0b2ff85d0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:09.811156 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-641cc91d-8604-4d0d-9243-d0c0b2ff85d0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:09.818578 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-641cc91d-8604-4d0d-9243-d0c0b2ff85d0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1522 microversion: 2.1 time: 0.233589 May 03 08:55:09.819140 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 106/202] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:09 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:10.835079 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ec6a53d7-0985-4384-9bfc-394707d8fd26 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:10.835693 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ec6a53d7-0985-4384-9bfc-394707d8fd26 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:10.842189 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ec6a53d7-0985-4384-9bfc-394707d8fd26 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:10.843206 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ec6a53d7-0985-4384-9bfc-394707d8fd26 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:10.843554 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ec6a53d7-0985-4384-9bfc-394707d8fd26 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:10.844054 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ec6a53d7-0985-4384-9bfc-394707d8fd26 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:11.027222 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ec6a53d7-0985-4384-9bfc-394707d8fd26 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:11.036042 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ec6a53d7-0985-4384-9bfc-394707d8fd26 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1522 microversion: 2.1 time: 0.205485 May 03 08:55:11.036655 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 97/203] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:10 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:12.054890 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-1f97e058-5223-438b-9838-e7c0a09d36ec tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:12.055487 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-1f97e058-5223-438b-9838-e7c0a09d36ec tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:12.064022 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1f97e058-5223-438b-9838-e7c0a09d36ec tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:12.064560 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1f97e058-5223-438b-9838-e7c0a09d36ec tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:12.065444 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1f97e058-5223-438b-9838-e7c0a09d36ec tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:12.065885 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1f97e058-5223-438b-9838-e7c0a09d36ec tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:12.205937 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-1f97e058-5223-438b-9838-e7c0a09d36ec tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:12.214389 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-1f97e058-5223-438b-9838-e7c0a09d36ec tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1522 microversion: 2.1 time: 0.163501 May 03 08:55:12.214959 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 107/204] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:12 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:13.235096 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a08539ac-7724-4a0a-bbaa-1737aaa41af4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:13.235848 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a08539ac-7724-4a0a-bbaa-1737aaa41af4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:13.245141 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a08539ac-7724-4a0a-bbaa-1737aaa41af4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:13.245722 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a08539ac-7724-4a0a-bbaa-1737aaa41af4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:13.246761 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a08539ac-7724-4a0a-bbaa-1737aaa41af4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:13.247340 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a08539ac-7724-4a0a-bbaa-1737aaa41af4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:13.390494 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a08539ac-7724-4a0a-bbaa-1737aaa41af4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:13.398589 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a08539ac-7724-4a0a-bbaa-1737aaa41af4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1522 microversion: 2.1 time: 0.169756 May 03 08:55:13.399159 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 98/205] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:13 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:14.420402 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b950fd06-ff9a-4d04-aa6e-d7b77f9bcdb9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:14.420968 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b950fd06-ff9a-4d04-aa6e-d7b77f9bcdb9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:14.427369 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b950fd06-ff9a-4d04-aa6e-d7b77f9bcdb9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:14.427803 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b950fd06-ff9a-4d04-aa6e-d7b77f9bcdb9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:14.428589 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b950fd06-ff9a-4d04-aa6e-d7b77f9bcdb9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:14.429016 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b950fd06-ff9a-4d04-aa6e-d7b77f9bcdb9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:14.568554 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b950fd06-ff9a-4d04-aa6e-d7b77f9bcdb9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:14.576395 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b950fd06-ff9a-4d04-aa6e-d7b77f9bcdb9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1522 microversion: 2.1 time: 0.160356 May 03 08:55:14.576968 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 108/206] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:14 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:15.593905 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6f4c11ce-f409-4b1e-8d4e-8f5f133d8909 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:15.594545 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6f4c11ce-f409-4b1e-8d4e-8f5f133d8909 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:15.601230 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6f4c11ce-f409-4b1e-8d4e-8f5f133d8909 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:15.601670 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6f4c11ce-f409-4b1e-8d4e-8f5f133d8909 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:15.602434 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6f4c11ce-f409-4b1e-8d4e-8f5f133d8909 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:15.603177 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6f4c11ce-f409-4b1e-8d4e-8f5f133d8909 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:15.734452 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6f4c11ce-f409-4b1e-8d4e-8f5f133d8909 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:15.741830 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6f4c11ce-f409-4b1e-8d4e-8f5f133d8909 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1522 microversion: 2.1 time: 0.152292 May 03 08:55:15.742424 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 99/207] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:15 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:16.759171 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-57fcdd18-4f96-487c-aaf9-9aa3af3ead54 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:16.759986 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-57fcdd18-4f96-487c-aaf9-9aa3af3ead54 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:16.765978 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-57fcdd18-4f96-487c-aaf9-9aa3af3ead54 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:16.766424 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-57fcdd18-4f96-487c-aaf9-9aa3af3ead54 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:16.767190 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-57fcdd18-4f96-487c-aaf9-9aa3af3ead54 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:16.767619 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-57fcdd18-4f96-487c-aaf9-9aa3af3ead54 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:16.908576 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-57fcdd18-4f96-487c-aaf9-9aa3af3ead54 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:16.915983 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-57fcdd18-4f96-487c-aaf9-9aa3af3ead54 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1522 microversion: 2.1 time: 0.161203 May 03 08:55:16.916703 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 109/208] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:16 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:17.933606 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4933be3c-30f2-466c-a489-d7f1b3c0e3ea tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:17.934124 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4933be3c-30f2-466c-a489-d7f1b3c0e3ea tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:17.940802 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4933be3c-30f2-466c-a489-d7f1b3c0e3ea tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:17.941246 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4933be3c-30f2-466c-a489-d7f1b3c0e3ea tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:17.942047 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4933be3c-30f2-466c-a489-d7f1b3c0e3ea tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:17.942475 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4933be3c-30f2-466c-a489-d7f1b3c0e3ea tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:18.077371 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-4933be3c-30f2-466c-a489-d7f1b3c0e3ea tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:18.085043 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-4933be3c-30f2-466c-a489-d7f1b3c0e3ea tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1502 microversion: 2.1 time: 0.155505 May 03 08:55:18.085612 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 100/209] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:17 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:18.101567 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d6dd485c-8f0a-47f7-be89-1b5bd34f89e0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:18.103210 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d6dd485c-8f0a-47f7-be89-1b5bd34f89e0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: a5e0d581-50da-4cfd-a5da-d35a632c7874] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:18.110035 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d6dd485c-8f0a-47f7-be89-1b5bd34f89e0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:18.110476 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d6dd485c-8f0a-47f7-be89-1b5bd34f89e0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:18.111232 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d6dd485c-8f0a-47f7-be89-1b5bd34f89e0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:18.111658 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d6dd485c-8f0a-47f7-be89-1b5bd34f89e0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:18.248296 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d6dd485c-8f0a-47f7-be89-1b5bd34f89e0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:18.255663 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d6dd485c-8f0a-47f7-be89-1b5bd34f89e0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874" status: 200 len: 1514 microversion: 2.1 time: 0.157938 May 03 08:55:18.256607 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 110/210] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:18 2022] GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:19.621795 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-56181272-f56c-42d4-b0c0-8ec3f59db6f0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:55:19.622855 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-56181272-f56c-42d4-b0c0-8ec3f59db6f0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: a5e0d581-50da-4cfd-a5da-d35a632c7874] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:19.629688 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-56181272-f56c-42d4-b0c0-8ec3f59db6f0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:19.630159 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-56181272-f56c-42d4-b0c0-8ec3f59db6f0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:19.631031 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-56181272-f56c-42d4-b0c0-8ec3f59db6f0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:19.631508 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-56181272-f56c-42d4-b0c0-8ec3f59db6f0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:19.655804 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.objects.instance [None req-56181272-f56c-42d4-b0c0-8ec3f59db6f0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lazy-loading 'flavor' on Instance uuid a5e0d581-50da-4cfd-a5da-d35a632c7874 {{(pid=123392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 03 08:55:19.793678 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-56181272-f56c-42d4-b0c0-8ec3f59db6f0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "POST /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874/action" status: 200 len: 32 microversion: 2.1 time: 0.175859 May 03 08:55:19.794299 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 101/211] 10.222.0.11 () {60 vars in 1277 bytes} [Tue May 3 08:55:19 2022] POST /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874/action => generated 32 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 03 08:55:19.803692 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c0ecc45e-4d35-4eb6-8beb-b9626382cea2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:19.804333 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c0ecc45e-4d35-4eb6-8beb-b9626382cea2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: a5e0d581-50da-4cfd-a5da-d35a632c7874] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:19.812046 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c0ecc45e-4d35-4eb6-8beb-b9626382cea2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:19.813024 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c0ecc45e-4d35-4eb6-8beb-b9626382cea2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:19.814040 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c0ecc45e-4d35-4eb6-8beb-b9626382cea2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:19.814545 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c0ecc45e-4d35-4eb6-8beb-b9626382cea2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:20.040764 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c0ecc45e-4d35-4eb6-8beb-b9626382cea2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:20.048531 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c0ecc45e-4d35-4eb6-8beb-b9626382cea2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874" status: 200 len: 1520 microversion: 2.1 time: 0.248726 May 03 08:55:20.049159 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 111/212] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:19 2022] GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874 => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:21.066741 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-588a542b-9849-41e4-9a77-875d89542575 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:21.067518 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-588a542b-9849-41e4-9a77-875d89542575 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: a5e0d581-50da-4cfd-a5da-d35a632c7874] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:21.074432 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-588a542b-9849-41e4-9a77-875d89542575 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:21.074963 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-588a542b-9849-41e4-9a77-875d89542575 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:21.075880 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-588a542b-9849-41e4-9a77-875d89542575 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:21.076423 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-588a542b-9849-41e4-9a77-875d89542575 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:21.230638 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-588a542b-9849-41e4-9a77-875d89542575 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:21.238101 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-588a542b-9849-41e4-9a77-875d89542575 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874" status: 200 len: 1520 microversion: 2.1 time: 0.176338 May 03 08:55:21.238848 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 102/213] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:21 2022] GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:22.255568 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-19a5b85a-2363-4a81-98d5-c9babaadf749 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:22.257158 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-19a5b85a-2363-4a81-98d5-c9babaadf749 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: a5e0d581-50da-4cfd-a5da-d35a632c7874] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:22.265098 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-19a5b85a-2363-4a81-98d5-c9babaadf749 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:22.265878 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-19a5b85a-2363-4a81-98d5-c9babaadf749 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:22.266917 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-19a5b85a-2363-4a81-98d5-c9babaadf749 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:22.267694 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-19a5b85a-2363-4a81-98d5-c9babaadf749 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:22.427800 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-19a5b85a-2363-4a81-98d5-c9babaadf749 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:22.445010 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-19a5b85a-2363-4a81-98d5-c9babaadf749 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874" status: 200 len: 1520 microversion: 2.1 time: 0.191784 May 03 08:55:22.453264 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 112/214] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:22 2022] GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874 => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:23.462113 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-57e54a42-fcca-4093-b12c-a943fcc92a02 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:23.462817 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-57e54a42-fcca-4093-b12c-a943fcc92a02 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: a5e0d581-50da-4cfd-a5da-d35a632c7874] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:23.469724 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-57e54a42-fcca-4093-b12c-a943fcc92a02 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:23.470143 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-57e54a42-fcca-4093-b12c-a943fcc92a02 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:23.470938 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-57e54a42-fcca-4093-b12c-a943fcc92a02 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:23.472101 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-57e54a42-fcca-4093-b12c-a943fcc92a02 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:23.570228 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9fb31cf0-5de7-4147-8213-e0276e7aef2c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-930544010", "imageRef": "bd46d67a-108d-4c0c-9f0b-cb6d41c82a32", "flavorRef": "452", "networks": [{"uuid": "978e1d5b-e67a-43aa-888e-674641045e53"}]}} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:55:23.615823 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-57e54a42-fcca-4093-b12c-a943fcc92a02 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:23.624967 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-57e54a42-fcca-4093-b12c-a943fcc92a02 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874" status: 200 len: 1520 microversion: 2.1 time: 0.166606 May 03 08:55:23.625753 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 103/215] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:23 2022] GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:23.627662 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.network.neutron [None req-9fb31cf0-5de7-4147-8213-e0276e7aef2c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] validate_networks() for [('978e1d5b-e67a-43aa-888e-674641045e53', None, None, None, None, None)] {{(pid=123391) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 03 08:55:23.993006 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-9fb31cf0-5de7-4147-8213-e0276e7aef2c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Flavor limits 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 03 08:55:23.993483 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-9fb31cf0-5de7-4147-8213-e0276e7aef2c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Image limits 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 03 08:55:23.994010 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-9fb31cf0-5de7-4147-8213-e0276e7aef2c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Flavor pref 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 03 08:55:23.994470 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-9fb31cf0-5de7-4147-8213-e0276e7aef2c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Image pref 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 03 08:55:23.994928 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-9fb31cf0-5de7-4147-8213-e0276e7aef2c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 03 08:55:24.004510 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9fb31cf0-5de7-4147-8213-e0276e7aef2c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:24.004954 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9fb31cf0-5de7-4147-8213-e0276e7aef2c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:24.005752 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9fb31cf0-5de7-4147-8213-e0276e7aef2c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:24.006178 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9fb31cf0-5de7-4147-8213-e0276e7aef2c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:24.021856 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.quota [None req-9fb31cf0-5de7-4147-8213-e0276e7aef2c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Getting quotas for project 0cffdf9d4af6405dbc203be720191014. Resources: {'cores', 'ram', 'instances'} {{(pid=123391) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 03 08:55:24.025757 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.quota [None req-9fb31cf0-5de7-4147-8213-e0276e7aef2c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Getting quotas for user f8cb9871fdf14a16a12c3d73a951fb61 and project 0cffdf9d4af6405dbc203be720191014. Resources: {'cores', 'ram', 'instances'} {{(pid=123391) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 03 08:55:24.037260 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9fb31cf0-5de7-4147-8213-e0276e7aef2c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Going to run 1 instances... {{(pid=123391) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 03 08:55:24.039932 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9fb31cf0-5de7-4147-8213-e0276e7aef2c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 58e5c955-f74d-4c1d-8492-457b7ab13f21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd46d67a-108d-4c0c-9f0b-cb6d41c82a32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123391) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 03 08:55:24.085514 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9fb31cf0-5de7-4147-8213-e0276e7aef2c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.520057 May 03 08:55:24.086355 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 113/216] 10.222.0.11 () {60 vars in 1146 bytes} [Tue May 3 08:55:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 03 08:55:24.096255 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-de4222cf-45da-436a-b913-d44f5a740178 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:24.097276 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-de4222cf-45da-436a-b913-d44f5a740178 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 58e5c955-f74d-4c1d-8492-457b7ab13f21] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:24.153250 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-de4222cf-45da-436a-b913-d44f5a740178 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:24.164089 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-de4222cf-45da-436a-b913-d44f5a740178 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21" status: 200 len: 1218 microversion: 2.1 time: 0.070335 May 03 08:55:24.164816 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 104/217] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:24 2022] GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21 => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:24.642327 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-dc17cdbb-33fc-46b0-8c58-b4625a57e53f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:24.643755 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-dc17cdbb-33fc-46b0-8c58-b4625a57e53f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: a5e0d581-50da-4cfd-a5da-d35a632c7874] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:24.661707 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dc17cdbb-33fc-46b0-8c58-b4625a57e53f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:24.662216 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dc17cdbb-33fc-46b0-8c58-b4625a57e53f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:24.665831 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dc17cdbb-33fc-46b0-8c58-b4625a57e53f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:24.665831 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dc17cdbb-33fc-46b0-8c58-b4625a57e53f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:24.818131 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-dc17cdbb-33fc-46b0-8c58-b4625a57e53f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:24.826263 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-dc17cdbb-33fc-46b0-8c58-b4625a57e53f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874" status: 200 len: 1520 microversion: 2.1 time: 0.188018 May 03 08:55:24.826929 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 114/218] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:24 2022] GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874 => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:25.184692 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9297fe29-a124-4a45-a9c0-e335db4ba63b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:25.186310 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9297fe29-a124-4a45-a9c0-e335db4ba63b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 58e5c955-f74d-4c1d-8492-457b7ab13f21] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:25.193762 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9297fe29-a124-4a45-a9c0-e335db4ba63b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:25.194504 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9297fe29-a124-4a45-a9c0-e335db4ba63b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:25.195465 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9297fe29-a124-4a45-a9c0-e335db4ba63b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:25.196240 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9297fe29-a124-4a45-a9c0-e335db4ba63b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:25.298315 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9297fe29-a124-4a45-a9c0-e335db4ba63b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:25.308567 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9297fe29-a124-4a45-a9c0-e335db4ba63b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21" status: 200 len: 1278 microversion: 2.1 time: 0.130335 May 03 08:55:25.309273 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 105/219] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:25 2022] GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21 => generated 1278 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:25.843909 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b30ab6c6-213f-42f1-829a-e3a8c2a4e5a8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:25.845453 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b30ab6c6-213f-42f1-829a-e3a8c2a4e5a8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: a5e0d581-50da-4cfd-a5da-d35a632c7874] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:25.852034 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b30ab6c6-213f-42f1-829a-e3a8c2a4e5a8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:25.852905 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b30ab6c6-213f-42f1-829a-e3a8c2a4e5a8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:25.853687 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b30ab6c6-213f-42f1-829a-e3a8c2a4e5a8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:25.854117 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b30ab6c6-213f-42f1-829a-e3a8c2a4e5a8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:26.103743 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b30ab6c6-213f-42f1-829a-e3a8c2a4e5a8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:26.111458 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b30ab6c6-213f-42f1-829a-e3a8c2a4e5a8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874" status: 200 len: 1520 microversion: 2.1 time: 0.272788 May 03 08:55:26.112256 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 115/220] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:25 2022] GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874 => generated 1520 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:26.326036 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-74d48363-abb0-43c9-881a-ad5022e1a208 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:26.326806 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-74d48363-abb0-43c9-881a-ad5022e1a208 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 58e5c955-f74d-4c1d-8492-457b7ab13f21] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:26.333565 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-74d48363-abb0-43c9-881a-ad5022e1a208 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:26.334335 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-74d48363-abb0-43c9-881a-ad5022e1a208 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:26.335366 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-74d48363-abb0-43c9-881a-ad5022e1a208 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:26.335880 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-74d48363-abb0-43c9-881a-ad5022e1a208 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:26.531254 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-74d48363-abb0-43c9-881a-ad5022e1a208 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:26.539181 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-74d48363-abb0-43c9-881a-ad5022e1a208 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21" status: 200 len: 1318 microversion: 2.1 time: 0.216922 May 03 08:55:26.539757 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 106/221] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:26 2022] GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:26.817194 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [req-e46ae546-9936-417c-a3f2-4e37c6dea60e req-ffa983e6-280c-4b8a-a975-9cbee8994cfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58e5c955-f74d-4c1d-8492-457b7ab13f21", "tag": "6e0bf9b7-b606-460e-8579-66e8b961c35d"}]} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:55:26.826632 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-e46ae546-9936-417c-a3f2-4e37c6dea60e req-ffa983e6-280c-4b8a-a975-9cbee8994cfc service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:26.827550 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-e46ae546-9936-417c-a3f2-4e37c6dea60e req-ffa983e6-280c-4b8a-a975-9cbee8994cfc service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:26.849528 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.compute.server_external_events [req-e46ae546-9936-417c-a3f2-4e37c6dea60e req-ffa983e6-280c-4b8a-a975-9cbee8994cfc service nova] Creating event network-changed:6e0bf9b7-b606-460e-8579-66e8b961c35d for instance 58e5c955-f74d-4c1d-8492-457b7ab13f21 on hv-cinder-84027 May 03 08:55:26.859470 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [req-e46ae546-9936-417c-a3f2-4e37c6dea60e req-ffa983e6-280c-4b8a-a975-9cbee8994cfc service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051369 May 03 08:55:26.860292 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 116/222] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 08:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 08:55:27.127616 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-47e2dd86-7537-4fc8-ac08-fbacf4a94f48 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:27.128529 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-47e2dd86-7537-4fc8-ac08-fbacf4a94f48 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: a5e0d581-50da-4cfd-a5da-d35a632c7874] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:27.143551 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-47e2dd86-7537-4fc8-ac08-fbacf4a94f48 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:27.144751 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-47e2dd86-7537-4fc8-ac08-fbacf4a94f48 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:27.145556 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-47e2dd86-7537-4fc8-ac08-fbacf4a94f48 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:27.145989 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-47e2dd86-7537-4fc8-ac08-fbacf4a94f48 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:27.372571 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-47e2dd86-7537-4fc8-ac08-fbacf4a94f48 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:27.384397 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-47e2dd86-7537-4fc8-ac08-fbacf4a94f48 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874" status: 200 len: 1520 microversion: 2.1 time: 0.260520 May 03 08:55:27.384976 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 107/223] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:27 2022] GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874 => generated 1520 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:27.557390 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-bdb252d8-ed39-4b60-9bf0-3b19f7f10927 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:27.558415 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-bdb252d8-ed39-4b60-9bf0-3b19f7f10927 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 58e5c955-f74d-4c1d-8492-457b7ab13f21] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:27.566498 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bdb252d8-ed39-4b60-9bf0-3b19f7f10927 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:27.566946 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bdb252d8-ed39-4b60-9bf0-3b19f7f10927 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:27.567904 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bdb252d8-ed39-4b60-9bf0-3b19f7f10927 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:27.568337 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bdb252d8-ed39-4b60-9bf0-3b19f7f10927 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:27.709997 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-bdb252d8-ed39-4b60-9bf0-3b19f7f10927 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:27.718054 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-bdb252d8-ed39-4b60-9bf0-3b19f7f10927 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21" status: 200 len: 1318 microversion: 2.1 time: 0.165051 May 03 08:55:27.718893 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 117/224] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:27 2022] GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:28.406110 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-60517137-f9b7-4de6-8132-457292e5c5f9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:28.407323 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-60517137-f9b7-4de6-8132-457292e5c5f9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: a5e0d581-50da-4cfd-a5da-d35a632c7874] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:28.415445 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-60517137-f9b7-4de6-8132-457292e5c5f9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:28.415933 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-60517137-f9b7-4de6-8132-457292e5c5f9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:28.416698 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-60517137-f9b7-4de6-8132-457292e5c5f9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:28.417157 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-60517137-f9b7-4de6-8132-457292e5c5f9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:28.618710 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-60517137-f9b7-4de6-8132-457292e5c5f9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:28.626678 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-60517137-f9b7-4de6-8132-457292e5c5f9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874" status: 200 len: 1520 microversion: 2.1 time: 0.227075 May 03 08:55:28.627339 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 108/225] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:28 2022] GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874 => generated 1520 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:28.736558 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-fb143d90-785c-43a0-b799-3bd96b09fb9c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:28.737188 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-fb143d90-785c-43a0-b799-3bd96b09fb9c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 58e5c955-f74d-4c1d-8492-457b7ab13f21] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:28.743445 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fb143d90-785c-43a0-b799-3bd96b09fb9c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:28.743926 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fb143d90-785c-43a0-b799-3bd96b09fb9c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:28.744684 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fb143d90-785c-43a0-b799-3bd96b09fb9c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:28.745121 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fb143d90-785c-43a0-b799-3bd96b09fb9c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:29.204200 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-fb143d90-785c-43a0-b799-3bd96b09fb9c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:29.212243 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-fb143d90-785c-43a0-b799-3bd96b09fb9c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21" status: 200 len: 1318 microversion: 2.1 time: 0.479600 May 03 08:55:29.212711 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 118/226] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:28 2022] GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21 => generated 1318 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:29.537785 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-952c84bf-60ea-4f0c-bea7-8b17978f2893 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:29.538363 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-952c84bf-60ea-4f0c-bea7-8b17978f2893 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:29.546183 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-952c84bf-60ea-4f0c-bea7-8b17978f2893 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:29.546710 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-952c84bf-60ea-4f0c-bea7-8b17978f2893 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:29.547605 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-952c84bf-60ea-4f0c-bea7-8b17978f2893 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:29.548145 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-952c84bf-60ea-4f0c-bea7-8b17978f2893 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:29.571517 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-952c84bf-60ea-4f0c-bea7-8b17978f2893 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/ips" status: 200 len: 146 microversion: 2.1 time: 0.038383 May 03 08:55:29.572151 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 109/227] 10.222.0.11 () {58 vars in 1247 bytes} [Tue May 3 08:55:29 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:55:29.644103 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-625aff2e-71d4-4727-ba08-0d7098cd9894 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:29.644737 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-625aff2e-71d4-4727-ba08-0d7098cd9894 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: a5e0d581-50da-4cfd-a5da-d35a632c7874] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:29.651486 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-625aff2e-71d4-4727-ba08-0d7098cd9894 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:29.651977 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-625aff2e-71d4-4727-ba08-0d7098cd9894 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:29.652737 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-625aff2e-71d4-4727-ba08-0d7098cd9894 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:29.653165 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-625aff2e-71d4-4727-ba08-0d7098cd9894 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:29.794596 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-625aff2e-71d4-4727-ba08-0d7098cd9894 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:29.802063 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-625aff2e-71d4-4727-ba08-0d7098cd9894 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874" status: 200 len: 1520 microversion: 2.1 time: 0.161813 May 03 08:55:29.802634 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 119/228] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:29 2022] GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:30.229197 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0e07e5b5-9112-4232-98b6-7b2b4f9628f8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:30.229814 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0e07e5b5-9112-4232-98b6-7b2b4f9628f8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 58e5c955-f74d-4c1d-8492-457b7ab13f21] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:30.236006 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0e07e5b5-9112-4232-98b6-7b2b4f9628f8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:30.236449 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0e07e5b5-9112-4232-98b6-7b2b4f9628f8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:30.237207 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0e07e5b5-9112-4232-98b6-7b2b4f9628f8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:30.237634 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0e07e5b5-9112-4232-98b6-7b2b4f9628f8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:30.389992 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0e07e5b5-9112-4232-98b6-7b2b4f9628f8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:30.397681 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0e07e5b5-9112-4232-98b6-7b2b4f9628f8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21" status: 200 len: 1318 microversion: 2.1 time: 0.172677 May 03 08:55:30.398225 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 110/229] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:30 2022] GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:30.820976 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-7f632e65-753e-41fa-b029-85a7efe14db4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:30.821564 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-7f632e65-753e-41fa-b029-85a7efe14db4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: a5e0d581-50da-4cfd-a5da-d35a632c7874] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:30.828217 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7f632e65-753e-41fa-b029-85a7efe14db4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:30.828632 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7f632e65-753e-41fa-b029-85a7efe14db4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:30.829428 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7f632e65-753e-41fa-b029-85a7efe14db4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:30.829864 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7f632e65-753e-41fa-b029-85a7efe14db4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:30.960665 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7f632e65-753e-41fa-b029-85a7efe14db4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:30.968484 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-7f632e65-753e-41fa-b029-85a7efe14db4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874" status: 200 len: 1520 microversion: 2.1 time: 0.151728 May 03 08:55:30.969071 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 120/230] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:30 2022] GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:31.421623 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-40a2fadb-3125-466a-9bca-1047edbff5ef tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:31.422540 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-40a2fadb-3125-466a-9bca-1047edbff5ef tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 58e5c955-f74d-4c1d-8492-457b7ab13f21] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:31.433497 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-40a2fadb-3125-466a-9bca-1047edbff5ef tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:31.434275 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-40a2fadb-3125-466a-9bca-1047edbff5ef tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:31.435523 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-40a2fadb-3125-466a-9bca-1047edbff5ef tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:31.436274 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-40a2fadb-3125-466a-9bca-1047edbff5ef tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:31.573520 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-40a2fadb-3125-466a-9bca-1047edbff5ef tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:31.583748 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-40a2fadb-3125-466a-9bca-1047edbff5ef tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21" status: 200 len: 1318 microversion: 2.1 time: 0.171268 May 03 08:55:31.584345 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 111/231] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:31 2022] GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:31.990221 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-daf46657-d574-41f9-b3d7-6b29d97e159b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:31.991225 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-daf46657-d574-41f9-b3d7-6b29d97e159b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: a5e0d581-50da-4cfd-a5da-d35a632c7874] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:32.001621 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-daf46657-d574-41f9-b3d7-6b29d97e159b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:32.002377 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-daf46657-d574-41f9-b3d7-6b29d97e159b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:32.003635 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-daf46657-d574-41f9-b3d7-6b29d97e159b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:32.004512 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-daf46657-d574-41f9-b3d7-6b29d97e159b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:32.132314 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-daf46657-d574-41f9-b3d7-6b29d97e159b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:32.140052 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-daf46657-d574-41f9-b3d7-6b29d97e159b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874" status: 200 len: 1520 microversion: 2.1 time: 0.156083 May 03 08:55:32.140901 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 121/232] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:31 2022] GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:32.601733 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c03be5bb-8997-45b8-b677-5c94108335fc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:32.603329 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c03be5bb-8997-45b8-b677-5c94108335fc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 58e5c955-f74d-4c1d-8492-457b7ab13f21] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:32.610786 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c03be5bb-8997-45b8-b677-5c94108335fc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:32.611361 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c03be5bb-8997-45b8-b677-5c94108335fc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:32.612948 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c03be5bb-8997-45b8-b677-5c94108335fc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:32.613646 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c03be5bb-8997-45b8-b677-5c94108335fc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:32.759321 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c03be5bb-8997-45b8-b677-5c94108335fc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:32.766644 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c03be5bb-8997-45b8-b677-5c94108335fc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21" status: 200 len: 1318 microversion: 2.1 time: 0.169774 May 03 08:55:32.767213 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 112/233] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:32 2022] GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:33.159223 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-75438105-c31b-44b1-8e1e-7addea61126c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:33.160074 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-75438105-c31b-44b1-8e1e-7addea61126c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: a5e0d581-50da-4cfd-a5da-d35a632c7874] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:33.168651 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-75438105-c31b-44b1-8e1e-7addea61126c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:33.169245 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-75438105-c31b-44b1-8e1e-7addea61126c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:33.170253 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-75438105-c31b-44b1-8e1e-7addea61126c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:33.170822 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-75438105-c31b-44b1-8e1e-7addea61126c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:33.305942 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-75438105-c31b-44b1-8e1e-7addea61126c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:33.314333 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-75438105-c31b-44b1-8e1e-7addea61126c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874" status: 200 len: 1520 microversion: 2.1 time: 0.160223 May 03 08:55:33.315391 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 122/234] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:33 2022] GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:33.437172 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-aced948e-86ab-4491-9a18-2222bb22c12d req-0ddd8468-173f-43fd-b36f-d6f6ba6fec95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58e5c955-f74d-4c1d-8492-457b7ab13f21", "name": "network-vif-plugged", "status": "completed", "tag": "6e0bf9b7-b606-460e-8579-66e8b961c35d"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:55:33.452463 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-aced948e-86ab-4491-9a18-2222bb22c12d req-0ddd8468-173f-43fd-b36f-d6f6ba6fec95 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:33.453301 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-aced948e-86ab-4491-9a18-2222bb22c12d req-0ddd8468-173f-43fd-b36f-d6f6ba6fec95 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:33.469106 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-aced948e-86ab-4491-9a18-2222bb22c12d req-0ddd8468-173f-43fd-b36f-d6f6ba6fec95 service nova] Creating event network-vif-plugged:6e0bf9b7-b606-460e-8579-66e8b961c35d for instance 58e5c955-f74d-4c1d-8492-457b7ab13f21 on hv-cinder-84027 May 03 08:55:33.478316 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-aced948e-86ab-4491-9a18-2222bb22c12d req-0ddd8468-173f-43fd-b36f-d6f6ba6fec95 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047650 May 03 08:55:33.479019 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 113/235] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 08:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:55:33.578956 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ddccf1aa-3947-4f96-a90e-515eedcd06cc tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1289355486", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1090483213", "security_groups": [{"name": "tempest-secgroup-smoke-581413980"}], "block_device_mapping_v2": [{"uuid": "3477ddce-ff10-4bbe-9c17-9268810471da", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "defa9b96-48e9-4be8-af34-bb2fa15f583e"}]}} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:55:33.731853 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.network.neutron [None req-ddccf1aa-3947-4f96-a90e-515eedcd06cc tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] validate_networks() for [('defa9b96-48e9-4be8-af34-bb2fa15f583e', None, None, None, None, None)] {{(pid=123391) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 03 08:55:33.769390 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2aa4a50c-26e3-408c-b201-acdcb4bf40bb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9eece5b-c21b-49bd-8f09-ec8e0373f1a0"}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:55:33.770880 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-2aa4a50c-26e3-408c-b201-acdcb4bf40bb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:33.777362 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2aa4a50c-26e3-408c-b201-acdcb4bf40bb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:33.777806 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2aa4a50c-26e3-408c-b201-acdcb4bf40bb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:33.778947 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2aa4a50c-26e3-408c-b201-acdcb4bf40bb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:33.779378 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2aa4a50c-26e3-408c-b201-acdcb4bf40bb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:34.122568 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-ddccf1aa-3947-4f96-a90e-515eedcd06cc tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Flavor limits 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 03 08:55:34.122982 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-ddccf1aa-3947-4f96-a90e-515eedcd06cc tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Image limits 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 03 08:55:34.123449 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-ddccf1aa-3947-4f96-a90e-515eedcd06cc tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Flavor pref 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 03 08:55:34.123877 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-ddccf1aa-3947-4f96-a90e-515eedcd06cc tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Image pref 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 03 08:55:34.124270 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-ddccf1aa-3947-4f96-a90e-515eedcd06cc tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 03 08:55:34.136427 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ddccf1aa-3947-4f96-a90e-515eedcd06cc tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:34.137087 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ddccf1aa-3947-4f96-a90e-515eedcd06cc tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:34.137984 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ddccf1aa-3947-4f96-a90e-515eedcd06cc tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:34.138526 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ddccf1aa-3947-4f96-a90e-515eedcd06cc tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:34.157491 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.quota [None req-ddccf1aa-3947-4f96-a90e-515eedcd06cc tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Getting quotas for project ffda909ab345414b8962364cf2f5738f. Resources: {'cores', 'ram', 'instances'} {{(pid=123391) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 03 08:55:34.161812 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.quota [None req-ddccf1aa-3947-4f96-a90e-515eedcd06cc tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Getting quotas for user f3e7163264a04db9a3b18aea3ae7631b and project ffda909ab345414b8962364cf2f5738f. Resources: {'cores', 'ram', 'instances'} {{(pid=123391) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 03 08:55:34.201264 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-2aa4a50c-26e3-408c-b201-acdcb4bf40bb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "POST /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.440584 May 03 08:55:34.201961 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 114/236] 10.222.0.11 () {60 vars in 1322 bytes} [Tue May 3 08:55:33 2022] POST /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 194 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:55:34.208908 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-1fae535a-e429-449c-817e-d1cd07cdee89 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:34.209875 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-1fae535a-e429-449c-817e-d1cd07cdee89 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 58e5c955-f74d-4c1d-8492-457b7ab13f21] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:34.217236 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1fae535a-e429-449c-817e-d1cd07cdee89 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:34.217903 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1fae535a-e429-449c-817e-d1cd07cdee89 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:34.219904 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1fae535a-e429-449c-817e-d1cd07cdee89 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:34.221266 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1fae535a-e429-449c-817e-d1cd07cdee89 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:34.223434 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ddccf1aa-3947-4f96-a90e-515eedcd06cc tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Going to run 1 instances... {{(pid=123391) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 03 08:55:34.225567 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ddccf1aa-3947-4f96-a90e-515eedcd06cc tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3477ddce-ff10-4bbe-9c17-9268810471da',volume_size=None,volume_type=None)] {{(pid=123391) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 03 08:55:34.368707 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ddccf1aa-3947-4f96-a90e-515eedcd06cc tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.793596 May 03 08:55:34.369861 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 123/237] 10.222.0.11 () {60 vars in 1146 bytes} [Tue May 3 08:55:33 2022] POST /compute/v2.1/servers => generated 405 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 03 08:55:34.375354 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-63f73e00-67e7-4b32-80b2-40f4d7fe6650 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:34.375992 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-63f73e00-67e7-4b32-80b2-40f4d7fe6650 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: a5e0d581-50da-4cfd-a5da-d35a632c7874] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:34.382266 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-63f73e00-67e7-4b32-80b2-40f4d7fe6650 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:34.382712 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-63f73e00-67e7-4b32-80b2-40f4d7fe6650 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:34.383482 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-63f73e00-67e7-4b32-80b2-40f4d7fe6650 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:34.383956 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-63f73e00-67e7-4b32-80b2-40f4d7fe6650 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:34.384853 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-1fae535a-e429-449c-817e-d1cd07cdee89 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:34.392390 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-1fae535a-e429-449c-817e-d1cd07cdee89 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21" status: 200 len: 1318 microversion: 2.1 time: 0.189075 May 03 08:55:34.393088 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 115/238] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:34 2022] GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:34.409598 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-1e77d51e-2cc6-4d8a-b53b-994a14312838 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:34.410533 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-1e77d51e-2cc6-4d8a-b53b-994a14312838 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:34.480423 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-1e77d51e-2cc6-4d8a-b53b-994a14312838 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:34.487267 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-1e77d51e-2cc6-4d8a-b53b-994a14312838 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1095 microversion: 2.1 time: 0.082597 May 03 08:55:34.487892 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 116/239] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:34 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1095 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:34.540595 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-63f73e00-67e7-4b32-80b2-40f4d7fe6650 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:34.548176 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-63f73e00-67e7-4b32-80b2-40f4d7fe6650 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874" status: 200 len: 1520 microversion: 2.1 time: 0.176306 May 03 08:55:34.548728 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 124/240] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:34 2022] GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:35.413287 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-25a45a0e-a90c-41a8-988f-aa52c0b9fa2b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:35.414665 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-25a45a0e-a90c-41a8-988f-aa52c0b9fa2b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 58e5c955-f74d-4c1d-8492-457b7ab13f21] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:35.425336 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-25a45a0e-a90c-41a8-988f-aa52c0b9fa2b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:35.426145 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-25a45a0e-a90c-41a8-988f-aa52c0b9fa2b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:35.426912 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-25a45a0e-a90c-41a8-988f-aa52c0b9fa2b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:35.427346 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-25a45a0e-a90c-41a8-988f-aa52c0b9fa2b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:35.506755 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a10e7930-03c5-4a27-8595-24342fb22828 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:35.508109 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a10e7930-03c5-4a27-8595-24342fb22828 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:35.514377 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a10e7930-03c5-4a27-8595-24342fb22828 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:35.514926 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a10e7930-03c5-4a27-8595-24342fb22828 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:35.515753 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a10e7930-03c5-4a27-8595-24342fb22828 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:35.516533 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a10e7930-03c5-4a27-8595-24342fb22828 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:35.585378 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a10e7930-03c5-4a27-8595-24342fb22828 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:35.596777 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a10e7930-03c5-4a27-8595-24342fb22828 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1193 microversion: 2.1 time: 0.095234 May 03 08:55:35.597414 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-25a45a0e-a90c-41a8-988f-aa52c0b9fa2b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:35.597693 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 125/241] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:35 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1193 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:35.603367 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-52601715-8d1e-433a-a1e9-d38dc4367350 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:35.603924 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-52601715-8d1e-433a-a1e9-d38dc4367350 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:35.606095 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-25a45a0e-a90c-41a8-988f-aa52c0b9fa2b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21" status: 200 len: 1318 microversion: 2.1 time: 0.199247 May 03 08:55:35.610887 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-52601715-8d1e-433a-a1e9-d38dc4367350 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:35.611335 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-52601715-8d1e-433a-a1e9-d38dc4367350 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:35.612138 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-52601715-8d1e-433a-a1e9-d38dc4367350 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:35.612565 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-52601715-8d1e-433a-a1e9-d38dc4367350 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:35.616707 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 117/242] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:35 2022] GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21 => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:35.621557 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7e91662e-4668-4cb0-8a09-f6e4ff76339c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:35.622158 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7e91662e-4668-4cb0-8a09-f6e4ff76339c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: a5e0d581-50da-4cfd-a5da-d35a632c7874] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:35.628868 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7e91662e-4668-4cb0-8a09-f6e4ff76339c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:35.629342 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7e91662e-4668-4cb0-8a09-f6e4ff76339c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:35.630695 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7e91662e-4668-4cb0-8a09-f6e4ff76339c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:35.631455 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7e91662e-4668-4cb0-8a09-f6e4ff76339c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:35.641634 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-52601715-8d1e-433a-a1e9-d38dc4367350 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/ips" status: 200 len: 151 microversion: 2.20 time: 0.042817 May 03 08:55:35.642229 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 126/243] 10.222.0.11 () {60 vars in 1288 bytes} [Tue May 3 08:55:35 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:55:35.766221 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7e91662e-4668-4cb0-8a09-f6e4ff76339c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:35.773588 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7e91662e-4668-4cb0-8a09-f6e4ff76339c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874" status: 200 len: 1520 microversion: 2.1 time: 0.155789 May 03 08:55:35.774167 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 118/244] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:35 2022] GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:36.616787 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-6845f135-f1bd-4fa5-993e-e4f94c2e26ec tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:36.622432 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-6845f135-f1bd-4fa5-993e-e4f94c2e26ec tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:36.625758 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-cdd6984c-92f8-4583-9e66-e4f093671a1e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:36.626985 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-cdd6984c-92f8-4583-9e66-e4f093671a1e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 58e5c955-f74d-4c1d-8492-457b7ab13f21] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:36.633296 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6845f135-f1bd-4fa5-993e-e4f94c2e26ec tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:36.634239 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6845f135-f1bd-4fa5-993e-e4f94c2e26ec tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:36.634587 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cdd6984c-92f8-4583-9e66-e4f093671a1e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:36.635598 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6845f135-f1bd-4fa5-993e-e4f94c2e26ec tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:36.635841 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cdd6984c-92f8-4583-9e66-e4f093671a1e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:36.636260 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6845f135-f1bd-4fa5-993e-e4f94c2e26ec tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:36.637475 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cdd6984c-92f8-4583-9e66-e4f093671a1e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:36.638050 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cdd6984c-92f8-4583-9e66-e4f093671a1e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:36.779849 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-6845f135-f1bd-4fa5-993e-e4f94c2e26ec tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:36.792725 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-6845f135-f1bd-4fa5-993e-e4f94c2e26ec tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1211 microversion: 2.1 time: 0.181914 May 03 08:55:36.793761 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 127/245] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:36 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1211 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:36.798644 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d34853d2-7605-42ad-b394-5584df46a298 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:36.799987 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d34853d2-7605-42ad-b394-5584df46a298 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: a5e0d581-50da-4cfd-a5da-d35a632c7874] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:36.807388 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d34853d2-7605-42ad-b394-5584df46a298 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:36.808826 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d34853d2-7605-42ad-b394-5584df46a298 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:36.809886 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d34853d2-7605-42ad-b394-5584df46a298 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:36.810345 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d34853d2-7605-42ad-b394-5584df46a298 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:37.004684 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-cdd6984c-92f8-4583-9e66-e4f093671a1e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:37.030842 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-cdd6984c-92f8-4583-9e66-e4f093671a1e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21" status: 200 len: 1507 microversion: 2.1 time: 0.409665 May 03 08:55:37.031732 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 119/246] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:36 2022] GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21 => generated 1507 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:37.161588 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d34853d2-7605-42ad-b394-5584df46a298 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:37.170330 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d34853d2-7605-42ad-b394-5584df46a298 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874" status: 200 len: 1520 microversion: 2.1 time: 0.375359 May 03 08:55:37.171342 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 128/247] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:36 2022] GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874 => generated 1520 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:37.504468 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0039c862-cee2-402b-aa07-518aafb2b277 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:55:37.505356 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0039c862-cee2-402b-aa07-518aafb2b277 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:37.520749 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0039c862-cee2-402b-aa07-518aafb2b277 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:37.521434 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0039c862-cee2-402b-aa07-518aafb2b277 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:37.522415 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0039c862-cee2-402b-aa07-518aafb2b277 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:37.522849 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0039c862-cee2-402b-aa07-518aafb2b277 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:37.563836 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.objects.instance [None req-0039c862-cee2-402b-aa07-518aafb2b277 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lazy-loading 'flavor' on Instance uuid b68d79a3-e9c5-46b6-b8c0-a9d6017f388f {{(pid=123392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 03 08:55:37.810410 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-50127e7f-165f-42a8-ae37-485649e22983 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:37.811056 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-50127e7f-165f-42a8-ae37-485649e22983 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:37.817151 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-50127e7f-165f-42a8-ae37-485649e22983 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:37.817920 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-50127e7f-165f-42a8-ae37-485649e22983 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:37.818911 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-50127e7f-165f-42a8-ae37-485649e22983 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:37.819597 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-50127e7f-165f-42a8-ae37-485649e22983 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:37.946701 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0039c862-cee2-402b-aa07-518aafb2b277 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "POST /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/action" status: 202 len: 0 microversion: 2.20 time: 0.446338 May 03 08:55:37.948475 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 120/248] 10.222.0.11 () {62 vars in 1318 bytes} [Tue May 3 08:55:37 2022] POST /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/action => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 03 08:55:37.960214 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a462f4cc-f9f6-4e1b-9a78-20a7aab76727 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:37.961076 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a462f4cc-f9f6-4e1b-9a78-20a7aab76727 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:37.975031 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a462f4cc-f9f6-4e1b-9a78-20a7aab76727 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:37.975493 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a462f4cc-f9f6-4e1b-9a78-20a7aab76727 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:37.978184 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a462f4cc-f9f6-4e1b-9a78-20a7aab76727 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:37.978642 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a462f4cc-f9f6-4e1b-9a78-20a7aab76727 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:38.117563 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-50127e7f-165f-42a8-ae37-485649e22983 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:38.126844 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-50127e7f-165f-42a8-ae37-485649e22983 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1278 microversion: 2.1 time: 0.320104 May 03 08:55:38.127601 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 129/249] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:37 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1278 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 08:55:38.188865 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5a2113a7-ef88-4964-94a5-2f4538e9bd01 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:38.189477 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5a2113a7-ef88-4964-94a5-2f4538e9bd01 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: a5e0d581-50da-4cfd-a5da-d35a632c7874] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:38.198333 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5a2113a7-ef88-4964-94a5-2f4538e9bd01 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:38.199000 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5a2113a7-ef88-4964-94a5-2f4538e9bd01 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:38.200533 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5a2113a7-ef88-4964-94a5-2f4538e9bd01 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:38.201423 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5a2113a7-ef88-4964-94a5-2f4538e9bd01 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:38.287325 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a462f4cc-f9f6-4e1b-9a78-20a7aab76727 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:38.316736 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a462f4cc-f9f6-4e1b-9a78-20a7aab76727 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:38.322995 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a462f4cc-f9f6-4e1b-9a78-20a7aab76727 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:38.324522 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a462f4cc-f9f6-4e1b-9a78-20a7aab76727 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1722 microversion: 2.20 time: 0.371364 May 03 08:55:38.339104 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 121/250] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:55:37 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1722 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 08:55:38.481470 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5a2113a7-ef88-4964-94a5-2f4538e9bd01 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:38.490469 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5a2113a7-ef88-4964-94a5-2f4538e9bd01 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874" status: 200 len: 1520 microversion: 2.1 time: 0.307137 May 03 08:55:38.491067 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 130/251] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:38 2022] GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874 => generated 1520 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 08:55:38.693566 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-8baee77f-4cf9-4f46-8bcf-a961b130df42 req-15c9d781-e782-4015-9d8b-ce565d890ee4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a53f83a8-c719-47a0-969f-5b1305f839df", "tag": "4e301bfe-acfc-48d5-af98-78513570286c"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:55:38.702179 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-8baee77f-4cf9-4f46-8bcf-a961b130df42 req-15c9d781-e782-4015-9d8b-ce565d890ee4 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:38.702833 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-8baee77f-4cf9-4f46-8bcf-a961b130df42 req-15c9d781-e782-4015-9d8b-ce565d890ee4 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:38.715483 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-8baee77f-4cf9-4f46-8bcf-a961b130df42 req-15c9d781-e782-4015-9d8b-ce565d890ee4 service nova] Creating event network-changed:4e301bfe-acfc-48d5-af98-78513570286c for instance a53f83a8-c719-47a0-969f-5b1305f839df on hv-cinder-84027 May 03 08:55:38.721054 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-8baee77f-4cf9-4f46-8bcf-a961b130df42 req-15c9d781-e782-4015-9d8b-ce565d890ee4 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031321 May 03 08:55:38.721834 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 122/252] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 08:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:55:39.144024 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3cad59f1-2521-4df4-ab16-05504efaf3cf tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:39.144759 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-3cad59f1-2521-4df4-ab16-05504efaf3cf tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:39.151484 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3cad59f1-2521-4df4-ab16-05504efaf3cf tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:39.151977 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3cad59f1-2521-4df4-ab16-05504efaf3cf tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:39.152739 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3cad59f1-2521-4df4-ab16-05504efaf3cf tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:39.153453 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3cad59f1-2521-4df4-ab16-05504efaf3cf tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:39.346409 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9887b267-97f1-468c-90e6-0e37cdd6dff7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:39.347118 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9887b267-97f1-468c-90e6-0e37cdd6dff7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:39.353949 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9887b267-97f1-468c-90e6-0e37cdd6dff7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:39.354696 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9887b267-97f1-468c-90e6-0e37cdd6dff7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:39.355673 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9887b267-97f1-468c-90e6-0e37cdd6dff7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:39.356384 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9887b267-97f1-468c-90e6-0e37cdd6dff7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:39.898167 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-3cad59f1-2521-4df4-ab16-05504efaf3cf tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:39.905882 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-3cad59f1-2521-4df4-ab16-05504efaf3cf tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1278 microversion: 2.1 time: 0.766023 May 03 08:55:39.906761 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 131/253] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:39 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1278 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:39.911330 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-028218bf-2c67-4190-9f73-b80c36c88f7c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:39.915501 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9887b267-97f1-468c-90e6-0e37cdd6dff7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:39.916226 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-028218bf-2c67-4190-9f73-b80c36c88f7c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: a5e0d581-50da-4cfd-a5da-d35a632c7874] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:39.922404 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-028218bf-2c67-4190-9f73-b80c36c88f7c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:39.922922 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-028218bf-2c67-4190-9f73-b80c36c88f7c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:39.923718 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9887b267-97f1-468c-90e6-0e37cdd6dff7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:39.924174 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-028218bf-2c67-4190-9f73-b80c36c88f7c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:39.924893 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-028218bf-2c67-4190-9f73-b80c36c88f7c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:39.925253 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9887b267-97f1-468c-90e6-0e37cdd6dff7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:39.926658 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9887b267-97f1-468c-90e6-0e37cdd6dff7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1722 microversion: 2.20 time: 0.584664 May 03 08:55:39.927688 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 123/254] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:55:39 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1722 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 08:55:40.148872 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-028218bf-2c67-4190-9f73-b80c36c88f7c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:40.156876 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-028218bf-2c67-4190-9f73-b80c36c88f7c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874" status: 200 len: 1520 microversion: 2.1 time: 0.249144 May 03 08:55:40.166589 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 132/255] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:39 2022] GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874 => generated 1520 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:40.922834 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-74383a82-a41f-48e6-9fe2-4a9022750e30 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:40.923492 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-74383a82-a41f-48e6-9fe2-4a9022750e30 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:40.930644 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-74383a82-a41f-48e6-9fe2-4a9022750e30 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:40.931085 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-74383a82-a41f-48e6-9fe2-4a9022750e30 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:40.931888 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-74383a82-a41f-48e6-9fe2-4a9022750e30 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:40.932319 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-74383a82-a41f-48e6-9fe2-4a9022750e30 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:40.945175 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-2eff3647-64be-4ef6-ab06-aeeb44c6abe7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:40.945930 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-2eff3647-64be-4ef6-ab06-aeeb44c6abe7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:40.952426 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2eff3647-64be-4ef6-ab06-aeeb44c6abe7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:40.952869 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2eff3647-64be-4ef6-ab06-aeeb44c6abe7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:40.953632 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2eff3647-64be-4ef6-ab06-aeeb44c6abe7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:40.954061 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2eff3647-64be-4ef6-ab06-aeeb44c6abe7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:41.114401 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-74383a82-a41f-48e6-9fe2-4a9022750e30 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:41.122097 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-74383a82-a41f-48e6-9fe2-4a9022750e30 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1278 microversion: 2.1 time: 0.203202 May 03 08:55:41.122671 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 124/256] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:40 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1278 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:41.135369 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-2eff3647-64be-4ef6-ab06-aeeb44c6abe7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:41.144424 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-2eff3647-64be-4ef6-ab06-aeeb44c6abe7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:41.146015 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-2eff3647-64be-4ef6-ab06-aeeb44c6abe7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:41.147204 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-2eff3647-64be-4ef6-ab06-aeeb44c6abe7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1722 microversion: 2.20 time: 0.206496 May 03 08:55:41.147748 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 133/257] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:55:40 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1722 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:55:41.173294 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9ec37667-9869-48f0-a088-6a1f4928966a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:41.173904 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9ec37667-9869-48f0-a088-6a1f4928966a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: a5e0d581-50da-4cfd-a5da-d35a632c7874] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:41.180045 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9ec37667-9869-48f0-a088-6a1f4928966a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:41.180490 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9ec37667-9869-48f0-a088-6a1f4928966a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:41.181239 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9ec37667-9869-48f0-a088-6a1f4928966a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:41.181661 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9ec37667-9869-48f0-a088-6a1f4928966a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:41.313562 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9ec37667-9869-48f0-a088-6a1f4928966a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:41.321751 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9ec37667-9869-48f0-a088-6a1f4928966a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874" status: 200 len: 1520 microversion: 2.1 time: 0.152421 May 03 08:55:41.322322 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 125/258] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:41 2022] GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:41.762076 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a2a008ae-a3dc-496a-9024-fed7ee896e52 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:55:41.768828 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a2a008ae-a3dc-496a-9024-fed7ee896e52 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:41.769286 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a2a008ae-a3dc-496a-9024-fed7ee896e52 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:41.830990 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a2a008ae-a3dc-496a-9024-fed7ee896e52 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Going to try to stop instance {{(pid=123391) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 03 08:55:41.878243 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a2a008ae-a3dc-496a-9024-fed7ee896e52 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "POST /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/action" status: 202 len: 0 microversion: 2.1 time: 0.120073 May 03 08:55:41.878850 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 134/259] 10.222.0.11 () {60 vars in 1277 bytes} [Tue May 3 08:55:41 2022] POST /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 08:55:41.887417 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a5f91e1e-af55-4d96-b194-2295f8723ce3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:41.888059 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a5f91e1e-af55-4d96-b194-2295f8723ce3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:41.894263 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a5f91e1e-af55-4d96-b194-2295f8723ce3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:41.894727 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a5f91e1e-af55-4d96-b194-2295f8723ce3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:41.895487 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a5f91e1e-af55-4d96-b194-2295f8723ce3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:41.895956 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a5f91e1e-af55-4d96-b194-2295f8723ce3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:42.027867 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a5f91e1e-af55-4d96-b194-2295f8723ce3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:42.036683 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a5f91e1e-af55-4d96-b194-2295f8723ce3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1725 microversion: 2.1 time: 0.153304 May 03 08:55:42.037235 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 126/260] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:41 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:42.139872 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-64772127-01f3-49e9-aea5-76e2e88a8bd3 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:42.140532 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-64772127-01f3-49e9-aea5-76e2e88a8bd3 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:42.147232 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-64772127-01f3-49e9-aea5-76e2e88a8bd3 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:42.147671 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-64772127-01f3-49e9-aea5-76e2e88a8bd3 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:42.148473 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-64772127-01f3-49e9-aea5-76e2e88a8bd3 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:42.148890 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-64772127-01f3-49e9-aea5-76e2e88a8bd3 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:42.166479 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-805ba0d7-271b-418b-922c-c1b14d910853 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:42.167094 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-805ba0d7-271b-418b-922c-c1b14d910853 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:42.174254 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-805ba0d7-271b-418b-922c-c1b14d910853 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:42.174772 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-805ba0d7-271b-418b-922c-c1b14d910853 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:42.175552 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-805ba0d7-271b-418b-922c-c1b14d910853 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:42.176193 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-805ba0d7-271b-418b-922c-c1b14d910853 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:42.349885 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-64772127-01f3-49e9-aea5-76e2e88a8bd3 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:42.353410 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-805ba0d7-271b-418b-922c-c1b14d910853 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:42.357856 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-64772127-01f3-49e9-aea5-76e2e88a8bd3 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1278 microversion: 2.1 time: 0.222312 May 03 08:55:42.358420 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 135/261] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:42 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1278 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:42.361855 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-805ba0d7-271b-418b-922c-c1b14d910853 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:42.363058 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-2bf72d8b-a331-444c-9a03-b78d9a190d66 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:42.363354 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-805ba0d7-271b-418b-922c-c1b14d910853 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:42.363705 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-2bf72d8b-a331-444c-9a03-b78d9a190d66 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: a5e0d581-50da-4cfd-a5da-d35a632c7874] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:42.364699 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-805ba0d7-271b-418b-922c-c1b14d910853 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1722 microversion: 2.20 time: 0.202497 May 03 08:55:42.365251 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 127/262] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:55:42 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:55:42.369871 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2bf72d8b-a331-444c-9a03-b78d9a190d66 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:42.370309 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2bf72d8b-a331-444c-9a03-b78d9a190d66 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:42.371068 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2bf72d8b-a331-444c-9a03-b78d9a190d66 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:42.371511 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2bf72d8b-a331-444c-9a03-b78d9a190d66 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:42.511957 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-2bf72d8b-a331-444c-9a03-b78d9a190d66 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:42.522324 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-2bf72d8b-a331-444c-9a03-b78d9a190d66 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874" status: 200 len: 1520 microversion: 2.1 time: 0.162542 May 03 08:55:42.523074 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 136/263] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:42 2022] GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:43.055504 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7e37b2af-fee6-48c7-b3d3-e61e3d007eca tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:43.056128 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7e37b2af-fee6-48c7-b3d3-e61e3d007eca tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:43.063063 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7e37b2af-fee6-48c7-b3d3-e61e3d007eca tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:43.063512 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7e37b2af-fee6-48c7-b3d3-e61e3d007eca tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:43.064318 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7e37b2af-fee6-48c7-b3d3-e61e3d007eca tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:43.064752 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7e37b2af-fee6-48c7-b3d3-e61e3d007eca tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:43.201786 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7e37b2af-fee6-48c7-b3d3-e61e3d007eca tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:43.212452 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7e37b2af-fee6-48c7-b3d3-e61e3d007eca tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1725 microversion: 2.1 time: 0.160762 May 03 08:55:43.213435 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 128/264] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:43 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:43.378547 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-90196e49-1de9-4c88-9531-964c5a68e3f5 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:43.379421 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-90196e49-1de9-4c88-9531-964c5a68e3f5 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:43.384695 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ebbe706a-f581-4e6b-9816-6cadebab9f97 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:43.385330 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ebbe706a-f581-4e6b-9816-6cadebab9f97 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:43.386194 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-90196e49-1de9-4c88-9531-964c5a68e3f5 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:43.386659 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-90196e49-1de9-4c88-9531-964c5a68e3f5 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:43.387459 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-90196e49-1de9-4c88-9531-964c5a68e3f5 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:43.387958 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-90196e49-1de9-4c88-9531-964c5a68e3f5 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:43.391992 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ebbe706a-f581-4e6b-9816-6cadebab9f97 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:43.392458 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ebbe706a-f581-4e6b-9816-6cadebab9f97 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:43.393255 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ebbe706a-f581-4e6b-9816-6cadebab9f97 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:43.393684 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ebbe706a-f581-4e6b-9816-6cadebab9f97 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:43.585962 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-90196e49-1de9-4c88-9531-964c5a68e3f5 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:43.590479 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ebbe706a-f581-4e6b-9816-6cadebab9f97 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:43.597139 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-90196e49-1de9-4c88-9531-964c5a68e3f5 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1266 microversion: 2.1 time: 0.224926 May 03 08:55:43.598180 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 137/265] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:43 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:43.601051 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ebbe706a-f581-4e6b-9816-6cadebab9f97 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:43.602873 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ebbe706a-f581-4e6b-9816-6cadebab9f97 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:43.603009 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ca931a7e-ea22-4076-aa2a-d8238d30d038 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:43.603643 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ca931a7e-ea22-4076-aa2a-d8238d30d038 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: a5e0d581-50da-4cfd-a5da-d35a632c7874] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:43.604072 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ebbe706a-f581-4e6b-9816-6cadebab9f97 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1722 microversion: 2.20 time: 0.223414 May 03 08:55:43.608080 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 129/266] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:55:43 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:55:43.609670 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ca931a7e-ea22-4076-aa2a-d8238d30d038 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:43.610120 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ca931a7e-ea22-4076-aa2a-d8238d30d038 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:43.610893 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ca931a7e-ea22-4076-aa2a-d8238d30d038 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:43.611331 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ca931a7e-ea22-4076-aa2a-d8238d30d038 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:43.743317 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ca931a7e-ea22-4076-aa2a-d8238d30d038 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:43.751193 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ca931a7e-ea22-4076-aa2a-d8238d30d038 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874" status: 200 len: 1520 microversion: 2.1 time: 0.152215 May 03 08:55:43.751742 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 138/267] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:43 2022] GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:44.230533 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-25ce5173-8ce7-4bca-9957-7575cd245e37 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:44.231121 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-25ce5173-8ce7-4bca-9957-7575cd245e37 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:44.237903 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-25ce5173-8ce7-4bca-9957-7575cd245e37 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:44.238357 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-25ce5173-8ce7-4bca-9957-7575cd245e37 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:44.239123 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-25ce5173-8ce7-4bca-9957-7575cd245e37 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:44.239554 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-25ce5173-8ce7-4bca-9957-7575cd245e37 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:44.373884 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-25ce5173-8ce7-4bca-9957-7575cd245e37 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:44.382230 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-25ce5173-8ce7-4bca-9957-7575cd245e37 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1725 microversion: 2.1 time: 0.155967 May 03 08:55:44.382839 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 130/268] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:44 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:44.618902 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f120a22d-2b1e-431d-a450-5ba8f862e730 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:44.619839 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f120a22d-2b1e-431d-a450-5ba8f862e730 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:44.626397 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f4e6daf8-bc4a-4e93-b535-6e2e9f928f6f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:44.627401 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f4e6daf8-bc4a-4e93-b535-6e2e9f928f6f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:44.629929 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f120a22d-2b1e-431d-a450-5ba8f862e730 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:44.630716 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f120a22d-2b1e-431d-a450-5ba8f862e730 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:44.632066 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f120a22d-2b1e-431d-a450-5ba8f862e730 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:44.633743 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f120a22d-2b1e-431d-a450-5ba8f862e730 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:44.640445 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f4e6daf8-bc4a-4e93-b535-6e2e9f928f6f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:44.641537 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f4e6daf8-bc4a-4e93-b535-6e2e9f928f6f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:44.643196 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f4e6daf8-bc4a-4e93-b535-6e2e9f928f6f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:44.644034 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f4e6daf8-bc4a-4e93-b535-6e2e9f928f6f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:44.830972 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f120a22d-2b1e-431d-a450-5ba8f862e730 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:44.834990 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f4e6daf8-bc4a-4e93-b535-6e2e9f928f6f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:44.838689 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f120a22d-2b1e-431d-a450-5ba8f862e730 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1266 microversion: 2.1 time: 0.226624 May 03 08:55:44.839259 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 139/269] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:44 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:44.843289 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f4e6daf8-bc4a-4e93-b535-6e2e9f928f6f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:44.843794 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-4b69d0b3-70bd-4853-a7f4-2f678b14b6ed tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:44.844481 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-4b69d0b3-70bd-4853-a7f4-2f678b14b6ed tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: a5e0d581-50da-4cfd-a5da-d35a632c7874] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:44.845088 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f4e6daf8-bc4a-4e93-b535-6e2e9f928f6f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:44.846340 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f4e6daf8-bc4a-4e93-b535-6e2e9f928f6f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1722 microversion: 2.20 time: 0.226645 May 03 08:55:44.847149 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 131/270] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:55:44 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:55:44.850443 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4b69d0b3-70bd-4853-a7f4-2f678b14b6ed tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:44.850888 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4b69d0b3-70bd-4853-a7f4-2f678b14b6ed tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:44.851650 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4b69d0b3-70bd-4853-a7f4-2f678b14b6ed tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:44.852411 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4b69d0b3-70bd-4853-a7f4-2f678b14b6ed tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:44.999603 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-4b69d0b3-70bd-4853-a7f4-2f678b14b6ed tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:45.011612 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-4b69d0b3-70bd-4853-a7f4-2f678b14b6ed tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874" status: 200 len: 1500 microversion: 2.1 time: 0.171282 May 03 08:55:45.012496 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 140/271] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:44 2022] GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874 => generated 1500 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:45.029394 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ee4cc039-4739-4e21-8c77-e0b24236ad4c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e20b472-981e-440e-a55b-77842d33d6ab"}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:55:45.030497 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ee4cc039-4739-4e21-8c77-e0b24236ad4c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: a5e0d581-50da-4cfd-a5da-d35a632c7874] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:45.037019 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ee4cc039-4739-4e21-8c77-e0b24236ad4c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:45.037468 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ee4cc039-4739-4e21-8c77-e0b24236ad4c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:45.038244 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ee4cc039-4739-4e21-8c77-e0b24236ad4c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:45.038674 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ee4cc039-4739-4e21-8c77-e0b24236ad4c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:45.061216 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-ee4cc039-4739-4e21-8c77-e0b24236ad4c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] HTTP exception thrown: Cannot 'attach_volume' instance a5e0d581-50da-4cfd-a5da-d35a632c7874 while it is in vm_state rescued May 03 08:55:45.061794 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ee4cc039-4739-4e21-8c77-e0b24236ad4c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Returning 409 to user: Cannot 'attach_volume' instance a5e0d581-50da-4cfd-a5da-d35a632c7874 while it is in vm_state rescued {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 08:55:45.062615 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ee4cc039-4739-4e21-8c77-e0b24236ad4c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "POST /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.037983 May 03 08:55:45.063154 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 132/272] 10.222.0.11 () {60 vars in 1322 bytes} [Tue May 3 08:55:45 2022] POST /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874/os-volume_attachments => generated 152 bytes in 39 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 03 08:55:45.071967 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-36300ec7-62c0-488d-bd31-83203d8c4ba2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:55:45.072494 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-36300ec7-62c0-488d-bd31-83203d8c4ba2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: a5e0d581-50da-4cfd-a5da-d35a632c7874] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:45.078440 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-36300ec7-62c0-488d-bd31-83203d8c4ba2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:45.078918 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-36300ec7-62c0-488d-bd31-83203d8c4ba2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:45.079684 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-36300ec7-62c0-488d-bd31-83203d8c4ba2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:45.080140 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-36300ec7-62c0-488d-bd31-83203d8c4ba2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:45.144730 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-36300ec7-62c0-488d-bd31-83203d8c4ba2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "POST /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874/action" status: 202 len: 0 microversion: 2.1 time: 0.076435 May 03 08:55:45.145349 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 141/273] 10.222.0.11 () {60 vars in 1277 bytes} [Tue May 3 08:55:45 2022] POST /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 08:55:45.154009 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ce515ee0-28a6-48a6-a682-d99b2fbb5461 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:45.154653 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ce515ee0-28a6-48a6-a682-d99b2fbb5461 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: a5e0d581-50da-4cfd-a5da-d35a632c7874] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:45.161009 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ce515ee0-28a6-48a6-a682-d99b2fbb5461 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:45.161401 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ce515ee0-28a6-48a6-a682-d99b2fbb5461 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:45.162225 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ce515ee0-28a6-48a6-a682-d99b2fbb5461 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:45.162709 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ce515ee0-28a6-48a6-a682-d99b2fbb5461 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:45.372795 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ce515ee0-28a6-48a6-a682-d99b2fbb5461 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:45.380802 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ce515ee0-28a6-48a6-a682-d99b2fbb5461 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874" status: 200 len: 1508 microversion: 2.1 time: 0.230654 May 03 08:55:45.381413 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 133/274] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:45 2022] GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874 => generated 1508 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:45.400114 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-84ddb9cb-2947-4e10-9785-83fefdc0fbc9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:45.400742 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-84ddb9cb-2947-4e10-9785-83fefdc0fbc9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:45.407063 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-84ddb9cb-2947-4e10-9785-83fefdc0fbc9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:45.407509 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-84ddb9cb-2947-4e10-9785-83fefdc0fbc9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:45.408313 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-84ddb9cb-2947-4e10-9785-83fefdc0fbc9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:45.408712 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-84ddb9cb-2947-4e10-9785-83fefdc0fbc9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:45.617388 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-84ddb9cb-2947-4e10-9785-83fefdc0fbc9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:45.625935 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-84ddb9cb-2947-4e10-9785-83fefdc0fbc9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1725 microversion: 2.1 time: 0.230218 May 03 08:55:45.626539 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 142/275] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:45 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1725 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 08:55:45.857913 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-699de92c-e0c4-4d7d-ae8d-492c27f5c33b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:45.858661 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-699de92c-e0c4-4d7d-ae8d-492c27f5c33b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:45.866298 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-fcaa88d4-95fb-4f0e-8bbc-2e957a008682 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:45.866903 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-fcaa88d4-95fb-4f0e-8bbc-2e957a008682 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:45.873697 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-699de92c-e0c4-4d7d-ae8d-492c27f5c33b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:45.874121 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-699de92c-e0c4-4d7d-ae8d-492c27f5c33b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:45.874905 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-699de92c-e0c4-4d7d-ae8d-492c27f5c33b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:45.875147 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fcaa88d4-95fb-4f0e-8bbc-2e957a008682 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:45.875436 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-699de92c-e0c4-4d7d-ae8d-492c27f5c33b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:45.875574 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fcaa88d4-95fb-4f0e-8bbc-2e957a008682 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:45.876734 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fcaa88d4-95fb-4f0e-8bbc-2e957a008682 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:45.877162 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fcaa88d4-95fb-4f0e-8bbc-2e957a008682 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:46.078489 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-fcaa88d4-95fb-4f0e-8bbc-2e957a008682 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:46.083924 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-699de92c-e0c4-4d7d-ae8d-492c27f5c33b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:46.087576 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-fcaa88d4-95fb-4f0e-8bbc-2e957a008682 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:46.089136 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-fcaa88d4-95fb-4f0e-8bbc-2e957a008682 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:46.090290 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-fcaa88d4-95fb-4f0e-8bbc-2e957a008682 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1722 microversion: 2.20 time: 0.228500 May 03 08:55:46.091059 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 143/276] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:55:45 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:55:46.092274 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-699de92c-e0c4-4d7d-ae8d-492c27f5c33b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1266 microversion: 2.1 time: 0.240680 May 03 08:55:46.093016 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 134/277] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:45 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:46.401033 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5abe7213-3f46-46ab-bbb1-edf5e2b92691 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:46.401755 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5abe7213-3f46-46ab-bbb1-edf5e2b92691 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: a5e0d581-50da-4cfd-a5da-d35a632c7874] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:46.408497 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5abe7213-3f46-46ab-bbb1-edf5e2b92691 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:46.408944 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5abe7213-3f46-46ab-bbb1-edf5e2b92691 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:46.409712 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5abe7213-3f46-46ab-bbb1-edf5e2b92691 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:46.410244 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5abe7213-3f46-46ab-bbb1-edf5e2b92691 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:46.542623 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5abe7213-3f46-46ab-bbb1-edf5e2b92691 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:46.552539 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5abe7213-3f46-46ab-bbb1-edf5e2b92691 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874" status: 200 len: 1508 microversion: 2.1 time: 0.155628 May 03 08:55:46.553135 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 144/278] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:46 2022] GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:46.643624 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f30b5b1a-7f91-46d9-b6ff-84b546395735 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:46.644260 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f30b5b1a-7f91-46d9-b6ff-84b546395735 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:46.651173 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f30b5b1a-7f91-46d9-b6ff-84b546395735 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:46.651541 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f30b5b1a-7f91-46d9-b6ff-84b546395735 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:46.652360 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f30b5b1a-7f91-46d9-b6ff-84b546395735 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:46.652796 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f30b5b1a-7f91-46d9-b6ff-84b546395735 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:46.782283 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f30b5b1a-7f91-46d9-b6ff-84b546395735 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:46.790882 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f30b5b1a-7f91-46d9-b6ff-84b546395735 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1725 microversion: 2.1 time: 0.151252 May 03 08:55:46.791481 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 135/279] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:46 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:47.110005 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f1460a26-e74f-4202-8696-8603186d29c5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:47.110823 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f1460a26-e74f-4202-8696-8603186d29c5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:47.112247 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-125ad1fa-184d-4d0e-a531-b3f768f4c49f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:47.113457 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-125ad1fa-184d-4d0e-a531-b3f768f4c49f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:47.119463 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f1460a26-e74f-4202-8696-8603186d29c5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:47.119932 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f1460a26-e74f-4202-8696-8603186d29c5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:47.120692 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f1460a26-e74f-4202-8696-8603186d29c5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:47.121118 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f1460a26-e74f-4202-8696-8603186d29c5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:47.121254 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-125ad1fa-184d-4d0e-a531-b3f768f4c49f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:47.121680 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-125ad1fa-184d-4d0e-a531-b3f768f4c49f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:47.122504 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-125ad1fa-184d-4d0e-a531-b3f768f4c49f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:47.123001 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-125ad1fa-184d-4d0e-a531-b3f768f4c49f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:47.356116 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f1460a26-e74f-4202-8696-8603186d29c5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:47.362882 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-125ad1fa-184d-4d0e-a531-b3f768f4c49f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:47.365233 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f1460a26-e74f-4202-8696-8603186d29c5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:47.366888 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f1460a26-e74f-4202-8696-8603186d29c5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:47.368312 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f1460a26-e74f-4202-8696-8603186d29c5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1722 microversion: 2.20 time: 0.263030 May 03 08:55:47.369128 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 145/280] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:55:47 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1722 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:55:47.370637 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-125ad1fa-184d-4d0e-a531-b3f768f4c49f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1266 microversion: 2.1 time: 0.264448 May 03 08:55:47.371412 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 136/281] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:47 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1266 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:47.578516 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-aa15f39f-3205-47cf-9c3b-70cf34549c79 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:47.579516 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-aa15f39f-3205-47cf-9c3b-70cf34549c79 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: a5e0d581-50da-4cfd-a5da-d35a632c7874] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:47.586821 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-aa15f39f-3205-47cf-9c3b-70cf34549c79 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:47.587264 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-aa15f39f-3205-47cf-9c3b-70cf34549c79 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:47.588070 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-aa15f39f-3205-47cf-9c3b-70cf34549c79 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:47.588511 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-aa15f39f-3205-47cf-9c3b-70cf34549c79 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:47.734765 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-aa15f39f-3205-47cf-9c3b-70cf34549c79 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:47.745272 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-aa15f39f-3205-47cf-9c3b-70cf34549c79 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874" status: 200 len: 1508 microversion: 2.1 time: 0.173221 May 03 08:55:47.745892 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 146/282] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:47 2022] GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874 => generated 1508 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:47.808065 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e8d69167-4f78-47e2-9cbd-9be81f76589b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:47.808645 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e8d69167-4f78-47e2-9cbd-9be81f76589b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:47.815634 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e8d69167-4f78-47e2-9cbd-9be81f76589b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:47.816115 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e8d69167-4f78-47e2-9cbd-9be81f76589b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:47.816927 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e8d69167-4f78-47e2-9cbd-9be81f76589b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:47.817340 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e8d69167-4f78-47e2-9cbd-9be81f76589b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:47.951960 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e8d69167-4f78-47e2-9cbd-9be81f76589b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:47.960318 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e8d69167-4f78-47e2-9cbd-9be81f76589b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1725 microversion: 2.1 time: 0.156252 May 03 08:55:47.960898 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 137/283] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:47 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:48.390821 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-cf0e76c4-6337-4489-94d0-6629753e3d1e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:48.391671 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-feba587a-0537-491b-8180-e2b5e72ad5ed tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:48.391880 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-feba587a-0537-491b-8180-e2b5e72ad5ed tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:48.392010 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-cf0e76c4-6337-4489-94d0-6629753e3d1e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:48.399292 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-feba587a-0537-491b-8180-e2b5e72ad5ed tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:48.399444 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cf0e76c4-6337-4489-94d0-6629753e3d1e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:48.399892 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-feba587a-0537-491b-8180-e2b5e72ad5ed tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:48.400009 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cf0e76c4-6337-4489-94d0-6629753e3d1e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:48.400597 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cf0e76c4-6337-4489-94d0-6629753e3d1e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:48.400754 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-feba587a-0537-491b-8180-e2b5e72ad5ed tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:48.401031 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-feba587a-0537-491b-8180-e2b5e72ad5ed tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:48.401172 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cf0e76c4-6337-4489-94d0-6629753e3d1e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:48.599433 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-cf0e76c4-6337-4489-94d0-6629753e3d1e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:48.602849 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-feba587a-0537-491b-8180-e2b5e72ad5ed tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:48.611036 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-cf0e76c4-6337-4489-94d0-6629753e3d1e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:48.612195 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-feba587a-0537-491b-8180-e2b5e72ad5ed tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1266 microversion: 2.1 time: 0.227618 May 03 08:55:48.612895 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 138/284] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:48 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:48.621197 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-cf0e76c4-6337-4489-94d0-6629753e3d1e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:48.622542 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-cf0e76c4-6337-4489-94d0-6629753e3d1e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1722 microversion: 2.20 time: 0.238289 May 03 08:55:48.623231 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 147/285] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:55:48 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:55:48.762943 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-fe95257c-78d4-431f-aca4-9ec363ef56e1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:48.763425 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-fe95257c-78d4-431f-aca4-9ec363ef56e1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: a5e0d581-50da-4cfd-a5da-d35a632c7874] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:48.769916 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fe95257c-78d4-431f-aca4-9ec363ef56e1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:48.770374 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fe95257c-78d4-431f-aca4-9ec363ef56e1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:48.771129 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fe95257c-78d4-431f-aca4-9ec363ef56e1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:48.771563 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fe95257c-78d4-431f-aca4-9ec363ef56e1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:48.903951 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-fe95257c-78d4-431f-aca4-9ec363ef56e1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:48.911343 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-fe95257c-78d4-431f-aca4-9ec363ef56e1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874" status: 200 len: 1514 microversion: 2.1 time: 0.152487 May 03 08:55:48.911919 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 139/286] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:48 2022] GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:48.977992 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e22b4ea1-fdd3-4a46-bf17-77304998405e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:48.978581 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e22b4ea1-fdd3-4a46-bf17-77304998405e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:48.984900 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e22b4ea1-fdd3-4a46-bf17-77304998405e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:48.985355 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e22b4ea1-fdd3-4a46-bf17-77304998405e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:48.986133 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e22b4ea1-fdd3-4a46-bf17-77304998405e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:48.986569 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e22b4ea1-fdd3-4a46-bf17-77304998405e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:49.118566 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e22b4ea1-fdd3-4a46-bf17-77304998405e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:49.127751 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e22b4ea1-fdd3-4a46-bf17-77304998405e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1725 microversion: 2.1 time: 0.153687 May 03 08:55:49.137846 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 148/287] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:48 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:49.636463 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e12090b4-fb78-424e-a378-75f1dc7ea9f7 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:49.637334 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e12090b4-fb78-424e-a378-75f1dc7ea9f7 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:49.642293 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-027d543d-e3d4-4972-b679-8741a9b591bc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:49.642941 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-027d543d-e3d4-4972-b679-8741a9b591bc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:49.644694 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e12090b4-fb78-424e-a378-75f1dc7ea9f7 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:49.645178 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e12090b4-fb78-424e-a378-75f1dc7ea9f7 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:49.645992 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e12090b4-fb78-424e-a378-75f1dc7ea9f7 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:49.646415 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e12090b4-fb78-424e-a378-75f1dc7ea9f7 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:49.649412 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-027d543d-e3d4-4972-b679-8741a9b591bc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:49.649857 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-027d543d-e3d4-4972-b679-8741a9b591bc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:49.650660 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-027d543d-e3d4-4972-b679-8741a9b591bc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:49.651110 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-027d543d-e3d4-4972-b679-8741a9b591bc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:49.842278 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-027d543d-e3d4-4972-b679-8741a9b591bc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:49.850342 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-027d543d-e3d4-4972-b679-8741a9b591bc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:49.850886 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e12090b4-fb78-424e-a378-75f1dc7ea9f7 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:49.852167 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-027d543d-e3d4-4972-b679-8741a9b591bc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:49.853344 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-027d543d-e3d4-4972-b679-8741a9b591bc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1722 microversion: 2.20 time: 0.215078 May 03 08:55:49.853921 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 149/288] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:55:49 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:55:49.858776 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e12090b4-fb78-424e-a378-75f1dc7ea9f7 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1266 microversion: 2.1 time: 0.231905 May 03 08:55:49.859345 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 140/289] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:49 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:50.144696 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-211d1ca6-ea1a-485e-8073-db2350983fcd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:50.145291 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-211d1ca6-ea1a-485e-8073-db2350983fcd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:50.151409 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-211d1ca6-ea1a-485e-8073-db2350983fcd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:50.151882 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-211d1ca6-ea1a-485e-8073-db2350983fcd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:50.152641 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-211d1ca6-ea1a-485e-8073-db2350983fcd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:50.153069 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-211d1ca6-ea1a-485e-8073-db2350983fcd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:50.254929 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-3d3fd706-e708-4267-9a9d-5913ff163a9e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Action: 'create', calling method: .version_select at 0x7f09cdfbdb80>, body: {"keypair": {"name": "tempest-keypair-240125214"}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:55:50.269435 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-3d3fd706-e708-4267-9a9d-5913ff163a9e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Getting quotas for project d3ce599e490e457385310fcbca709c84. Resources: {'key_pairs'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 03 08:55:50.273274 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-3d3fd706-e708-4267-9a9d-5913ff163a9e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Getting quotas for user e6d1a1b1c3754f0d856df4ca7a8e0269 and project d3ce599e490e457385310fcbca709c84. Resources: {'key_pairs'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 03 08:55:50.293491 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-211d1ca6-ea1a-485e-8073-db2350983fcd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:50.301720 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-211d1ca6-ea1a-485e-8073-db2350983fcd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1725 microversion: 2.1 time: 0.160935 May 03 08:55:50.302195 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 150/290] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:50 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:50.501854 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-3d3fd706-e708-4267-9a9d-5913ff163a9e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Getting quotas for project d3ce599e490e457385310fcbca709c84. Resources: {'key_pairs'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 03 08:55:50.505595 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-3d3fd706-e708-4267-9a9d-5913ff163a9e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Getting quotas for user e6d1a1b1c3754f0d856df4ca7a8e0269 and project d3ce599e490e457385310fcbca709c84. Resources: {'key_pairs'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 03 08:55:50.519605 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-3d3fd706-e708-4267-9a9d-5913ff163a9e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.268692 May 03 08:55:50.520325 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 141/291] 10.222.0.11 () {60 vars in 1157 bytes} [Tue May 3 08:55:50 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 08:55:50.871663 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-80ad815f-b9bb-4015-a788-72b9fad613ce tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:50.872347 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-80ad815f-b9bb-4015-a788-72b9fad613ce tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:50.876052 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-00009c8d-6a45-40f9-a1db-44d9ee23931d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:50.876732 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-00009c8d-6a45-40f9-a1db-44d9ee23931d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:50.878398 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-80ad815f-b9bb-4015-a788-72b9fad613ce tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:50.878913 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-80ad815f-b9bb-4015-a788-72b9fad613ce tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:50.879698 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-80ad815f-b9bb-4015-a788-72b9fad613ce tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:50.880142 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-80ad815f-b9bb-4015-a788-72b9fad613ce tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:50.884751 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-00009c8d-6a45-40f9-a1db-44d9ee23931d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:50.885211 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-00009c8d-6a45-40f9-a1db-44d9ee23931d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:50.885997 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-00009c8d-6a45-40f9-a1db-44d9ee23931d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:50.886436 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-00009c8d-6a45-40f9-a1db-44d9ee23931d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:51.067238 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-80ad815f-b9bb-4015-a788-72b9fad613ce tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:51.075563 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-80ad815f-b9bb-4015-a788-72b9fad613ce tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:51.077027 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-80ad815f-b9bb-4015-a788-72b9fad613ce tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:51.078517 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-80ad815f-b9bb-4015-a788-72b9fad613ce tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1722 microversion: 2.20 time: 0.210763 May 03 08:55:51.079077 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 151/292] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:55:50 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:55:51.080221 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-00009c8d-6a45-40f9-a1db-44d9ee23931d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:51.087721 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-00009c8d-6a45-40f9-a1db-44d9ee23931d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1266 microversion: 2.1 time: 0.216031 May 03 08:55:51.088315 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 142/293] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:50 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:51.318950 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-58d51f55-d0b9-46fc-8b13-05be6f4d4dfd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:51.319794 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-58d51f55-d0b9-46fc-8b13-05be6f4d4dfd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:51.327440 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-58d51f55-d0b9-46fc-8b13-05be6f4d4dfd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:51.327946 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-58d51f55-d0b9-46fc-8b13-05be6f4d4dfd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:51.328728 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-58d51f55-d0b9-46fc-8b13-05be6f4d4dfd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:51.329155 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-58d51f55-d0b9-46fc-8b13-05be6f4d4dfd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:51.465151 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-58d51f55-d0b9-46fc-8b13-05be6f4d4dfd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:51.473840 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-58d51f55-d0b9-46fc-8b13-05be6f4d4dfd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1725 microversion: 2.1 time: 0.158978 May 03 08:55:51.474408 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 152/294] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:51 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:51.807362 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4a327df6-dc0d-412b-97a6-de4ee269b227 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-395752926", "imageRef": "bd46d67a-108d-4c0c-9f0b-cb6d41c82a32", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bab20d28-0c5b-4bd0-a0b2-15a55898853a"}], "security_groups": [{"name": "tempest-securitygroup--28476406"}], "key_name": "tempest-keypair-240125214", "user_data": "}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:55:51.914079 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.network.neutron [None req-4a327df6-dc0d-412b-97a6-de4ee269b227 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] validate_networks() for [('bab20d28-0c5b-4bd0-a0b2-15a55898853a', None, None, None, None, None)] {{(pid=123392) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 03 08:55:52.101817 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-1aaad327-bdcc-4c18-aaf4-583d7145eeac tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:52.102962 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-1aaad327-bdcc-4c18-aaf4-583d7145eeac tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:52.109304 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1aaad327-bdcc-4c18-aaf4-583d7145eeac tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:52.109755 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1aaad327-bdcc-4c18-aaf4-583d7145eeac tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:52.110516 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1aaad327-bdcc-4c18-aaf4-583d7145eeac tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:52.111126 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1aaad327-bdcc-4c18-aaf4-583d7145eeac tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:52.334528 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-1aaad327-bdcc-4c18-aaf4-583d7145eeac tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:52.342633 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-1aaad327-bdcc-4c18-aaf4-583d7145eeac tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:52.344258 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-1aaad327-bdcc-4c18-aaf4-583d7145eeac tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:52.345432 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-1aaad327-bdcc-4c18-aaf4-583d7145eeac tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1722 microversion: 2.20 time: 0.249602 May 03 08:55:52.345987 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 153/295] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:55:52 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:55:52.350481 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3eed89f7-607b-4991-9498-7cc656db376b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:52.351082 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-3eed89f7-607b-4991-9498-7cc656db376b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:52.355589 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-4a327df6-dc0d-412b-97a6-de4ee269b227 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Flavor limits 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 03 08:55:52.356284 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-4a327df6-dc0d-412b-97a6-de4ee269b227 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Image limits 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 03 08:55:52.356908 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-4a327df6-dc0d-412b-97a6-de4ee269b227 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Flavor pref 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 03 08:55:52.357167 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3eed89f7-607b-4991-9498-7cc656db376b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:52.357461 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-4a327df6-dc0d-412b-97a6-de4ee269b227 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Image pref 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 03 08:55:52.357604 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3eed89f7-607b-4991-9498-7cc656db376b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:52.358157 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-4a327df6-dc0d-412b-97a6-de4ee269b227 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 03 08:55:52.358364 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3eed89f7-607b-4991-9498-7cc656db376b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:52.358794 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3eed89f7-607b-4991-9498-7cc656db376b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:52.367330 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4a327df6-dc0d-412b-97a6-de4ee269b227 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:52.367800 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4a327df6-dc0d-412b-97a6-de4ee269b227 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:52.368777 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4a327df6-dc0d-412b-97a6-de4ee269b227 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:52.369217 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4a327df6-dc0d-412b-97a6-de4ee269b227 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:52.385970 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-4a327df6-dc0d-412b-97a6-de4ee269b227 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Getting quotas for project d3ce599e490e457385310fcbca709c84. Resources: {'cores', 'ram', 'instances'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 03 08:55:52.390103 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-4a327df6-dc0d-412b-97a6-de4ee269b227 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Getting quotas for user e6d1a1b1c3754f0d856df4ca7a8e0269 and project d3ce599e490e457385310fcbca709c84. Resources: {'cores', 'ram', 'instances'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 03 08:55:52.400969 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4a327df6-dc0d-412b-97a6-de4ee269b227 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Going to run 1 instances... {{(pid=123392) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 03 08:55:52.403255 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4a327df6-dc0d-412b-97a6-de4ee269b227 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd46d67a-108d-4c0c-9f0b-cb6d41c82a32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 03 08:55:52.449563 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-4a327df6-dc0d-412b-97a6-de4ee269b227 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.646562 May 03 08:55:52.450428 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 143/296] 10.222.0.11 () {60 vars in 1146 bytes} [Tue May 3 08:55:51 2022] POST /compute/v2.1/servers => generated 407 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 03 08:55:52.460082 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-3ea78fbc-7fe5-4ab3-80b5-3bcc53ee08b4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:52.460679 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-3ea78fbc-7fe5-4ab3-80b5-3bcc53ee08b4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:52.497583 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-3eed89f7-607b-4991-9498-7cc656db376b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:52.505615 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-3eed89f7-607b-4991-9498-7cc656db376b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1266 microversion: 2.1 time: 0.158668 May 03 08:55:52.506397 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 154/297] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:52 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:52.511306 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d9b5ea65-db26-4a80-b50b-74d41846281c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:52.512119 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d9b5ea65-db26-4a80-b50b-74d41846281c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:52.518539 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d9b5ea65-db26-4a80-b50b-74d41846281c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:52.518984 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d9b5ea65-db26-4a80-b50b-74d41846281c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:52.519811 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d9b5ea65-db26-4a80-b50b-74d41846281c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:52.520239 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d9b5ea65-db26-4a80-b50b-74d41846281c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:52.520696 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-3ea78fbc-7fe5-4ab3-80b5-3bcc53ee08b4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:52.530140 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-3ea78fbc-7fe5-4ab3-80b5-3bcc53ee08b4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1244 microversion: 2.1 time: 0.073644 May 03 08:55:52.531096 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 144/298] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:52 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1244 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 08:55:52.648004 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d9b5ea65-db26-4a80-b50b-74d41846281c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:52.657079 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d9b5ea65-db26-4a80-b50b-74d41846281c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1725 microversion: 2.1 time: 0.149424 May 03 08:55:52.657645 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 155/299] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:52 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:53.365812 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d65fdf1c-396b-4c5a-a802-f80e459a6029 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:53.366509 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d65fdf1c-396b-4c5a-a802-f80e459a6029 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:53.373218 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d65fdf1c-396b-4c5a-a802-f80e459a6029 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:53.373667 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d65fdf1c-396b-4c5a-a802-f80e459a6029 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:53.374438 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d65fdf1c-396b-4c5a-a802-f80e459a6029 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:53.374857 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d65fdf1c-396b-4c5a-a802-f80e459a6029 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:53.503669 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d65fdf1c-396b-4c5a-a802-f80e459a6029 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:53.511702 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d65fdf1c-396b-4c5a-a802-f80e459a6029 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:53.513297 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d65fdf1c-396b-4c5a-a802-f80e459a6029 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:53.514535 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d65fdf1c-396b-4c5a-a802-f80e459a6029 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1722 microversion: 2.20 time: 0.153196 May 03 08:55:53.515137 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 145/300] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:55:53 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 08:55:53.529170 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b97941a3-916f-4f1c-af7d-a435ebdc376a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:53.529858 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b97941a3-916f-4f1c-af7d-a435ebdc376a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:53.535986 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b97941a3-916f-4f1c-af7d-a435ebdc376a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:53.536504 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b97941a3-916f-4f1c-af7d-a435ebdc376a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:53.537330 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b97941a3-916f-4f1c-af7d-a435ebdc376a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:53.537825 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b97941a3-916f-4f1c-af7d-a435ebdc376a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:53.546963 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f297cef1-6cee-4fbe-b917-ff0f70334082 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:53.547566 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f297cef1-6cee-4fbe-b917-ff0f70334082 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:53.553495 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f297cef1-6cee-4fbe-b917-ff0f70334082 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:53.553942 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f297cef1-6cee-4fbe-b917-ff0f70334082 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:53.554891 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f297cef1-6cee-4fbe-b917-ff0f70334082 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:53.555332 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f297cef1-6cee-4fbe-b917-ff0f70334082 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:53.645475 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f297cef1-6cee-4fbe-b917-ff0f70334082 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:53.653007 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f297cef1-6cee-4fbe-b917-ff0f70334082 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1296 microversion: 2.1 time: 0.110204 May 03 08:55:53.654139 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 146/301] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:53 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1296 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:53.658710 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-5150e897-6cda-4856-9550-0857588d3778 req-05097d62-a897-4bed-b5f5-3d0f52db2f87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a53f83a8-c719-47a0-969f-5b1305f839df", "name": "network-vif-plugged", "status": "completed", "tag": "4e301bfe-acfc-48d5-af98-78513570286c"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:55:53.668923 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-5150e897-6cda-4856-9550-0857588d3778 req-05097d62-a897-4bed-b5f5-3d0f52db2f87 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:53.669380 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-5150e897-6cda-4856-9550-0857588d3778 req-05097d62-a897-4bed-b5f5-3d0f52db2f87 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:53.684815 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-5150e897-6cda-4856-9550-0857588d3778 req-05097d62-a897-4bed-b5f5-3d0f52db2f87 service nova] Creating event network-vif-plugged:4e301bfe-acfc-48d5-af98-78513570286c for instance a53f83a8-c719-47a0-969f-5b1305f839df on hv-cinder-84027 May 03 08:55:53.689902 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-5150e897-6cda-4856-9550-0857588d3778 req-05097d62-a897-4bed-b5f5-3d0f52db2f87 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034451 May 03 08:55:53.690809 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 147/302] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 08:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:55:53.697722 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-555fb9c0-74fe-4857-bb09-79254997781d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:53.698424 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-555fb9c0-74fe-4857-bb09-79254997781d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:53.704600 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-555fb9c0-74fe-4857-bb09-79254997781d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:53.705055 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-555fb9c0-74fe-4857-bb09-79254997781d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:53.705824 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-555fb9c0-74fe-4857-bb09-79254997781d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:53.706259 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-555fb9c0-74fe-4857-bb09-79254997781d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:53.822970 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b97941a3-916f-4f1c-af7d-a435ebdc376a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:53.831335 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b97941a3-916f-4f1c-af7d-a435ebdc376a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1266 microversion: 2.1 time: 0.305575 May 03 08:55:53.832506 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 156/303] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:53 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1266 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:54.205431 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-555fb9c0-74fe-4857-bb09-79254997781d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:54.214703 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-555fb9c0-74fe-4857-bb09-79254997781d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1725 microversion: 2.1 time: 0.522477 May 03 08:55:54.215309 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 148/304] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:53 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1725 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:54.533490 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-656c5b88-edb6-41b1-b395-cd232cf37f11 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:54.534199 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-656c5b88-edb6-41b1-b395-cd232cf37f11 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:54.540261 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-656c5b88-edb6-41b1-b395-cd232cf37f11 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:54.540709 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-656c5b88-edb6-41b1-b395-cd232cf37f11 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:54.541474 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-656c5b88-edb6-41b1-b395-cd232cf37f11 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:54.541908 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-656c5b88-edb6-41b1-b395-cd232cf37f11 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:54.670643 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-026756ae-3d90-42e2-a38e-b964a188aa46 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:54.671236 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-026756ae-3d90-42e2-a38e-b964a188aa46 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:54.678611 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-026756ae-3d90-42e2-a38e-b964a188aa46 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:54.679062 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-026756ae-3d90-42e2-a38e-b964a188aa46 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:54.680088 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-026756ae-3d90-42e2-a38e-b964a188aa46 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:54.680690 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-026756ae-3d90-42e2-a38e-b964a188aa46 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:54.740739 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-656c5b88-edb6-41b1-b395-cd232cf37f11 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:54.750647 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-656c5b88-edb6-41b1-b395-cd232cf37f11 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:54.752196 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-656c5b88-edb6-41b1-b395-cd232cf37f11 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:54.753748 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-656c5b88-edb6-41b1-b395-cd232cf37f11 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1722 microversion: 2.20 time: 0.223984 May 03 08:55:54.755249 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 157/305] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:55:54 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:55:54.764521 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-026756ae-3d90-42e2-a38e-b964a188aa46 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:54.773219 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-026756ae-3d90-42e2-a38e-b964a188aa46 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1302 microversion: 2.1 time: 0.106531 May 03 08:55:54.774177 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 149/306] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:54 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1302 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:54.847140 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c775c6bd-3f03-4527-972a-f27e7b43a343 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:54.847752 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c775c6bd-3f03-4527-972a-f27e7b43a343 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:54.859401 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c775c6bd-3f03-4527-972a-f27e7b43a343 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:54.860084 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c775c6bd-3f03-4527-972a-f27e7b43a343 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:54.860947 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c775c6bd-3f03-4527-972a-f27e7b43a343 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:54.861979 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c775c6bd-3f03-4527-972a-f27e7b43a343 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:55.003536 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c775c6bd-3f03-4527-972a-f27e7b43a343 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:55.011015 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c775c6bd-3f03-4527-972a-f27e7b43a343 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1266 microversion: 2.1 time: 0.167935 May 03 08:55:55.011609 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 158/307] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:54 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:55.232301 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a0531087-0683-420a-8e61-4bd442092266 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:55.232916 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a0531087-0683-420a-8e61-4bd442092266 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:55.238894 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a0531087-0683-420a-8e61-4bd442092266 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:55.239345 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a0531087-0683-420a-8e61-4bd442092266 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:55.240142 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a0531087-0683-420a-8e61-4bd442092266 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:55.240579 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a0531087-0683-420a-8e61-4bd442092266 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:55.430947 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a0531087-0683-420a-8e61-4bd442092266 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:55.439937 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a0531087-0683-420a-8e61-4bd442092266 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1725 microversion: 2.1 time: 0.211459 May 03 08:55:55.440719 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 150/308] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:55 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1725 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 08:55:55.491552 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-979d29fd-ae0e-44ab-97a5-2686fb719c3f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f31497da-e7a1-4354-972d-fb6676b45682", "device": "/dev/sdb"}} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:55:55.493490 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-979d29fd-ae0e-44ab-97a5-2686fb719c3f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 58e5c955-f74d-4c1d-8492-457b7ab13f21] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:55.499401 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-979d29fd-ae0e-44ab-97a5-2686fb719c3f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:55.499882 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-979d29fd-ae0e-44ab-97a5-2686fb719c3f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:55.500642 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-979d29fd-ae0e-44ab-97a5-2686fb719c3f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:55.501067 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-979d29fd-ae0e-44ab-97a5-2686fb719c3f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:55.776734 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-87c2e89b-844d-4289-ae6c-ba510f0c1e47 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:55.777351 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-87c2e89b-844d-4289-ae6c-ba510f0c1e47 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:55.787950 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-87c2e89b-844d-4289-ae6c-ba510f0c1e47 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:55.788829 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-87c2e89b-844d-4289-ae6c-ba510f0c1e47 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:55.790518 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-87c2e89b-844d-4289-ae6c-ba510f0c1e47 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:55.791120 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-87c2e89b-844d-4289-ae6c-ba510f0c1e47 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:56.024239 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-87c2e89b-844d-4289-ae6c-ba510f0c1e47 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:56.032721 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-87c2e89b-844d-4289-ae6c-ba510f0c1e47 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:56.034295 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-87c2e89b-844d-4289-ae6c-ba510f0c1e47 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:56.035590 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-87c2e89b-844d-4289-ae6c-ba510f0c1e47 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1743 microversion: 2.20 time: 0.264879 May 03 08:55:56.036219 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 151/309] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:55:55 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1743 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:55:56.040738 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-75b070cd-263d-4cc8-a2fb-c6a686c9aa4e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:56.041338 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-75b070cd-263d-4cc8-a2fb-c6a686c9aa4e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:56.047241 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-75b070cd-263d-4cc8-a2fb-c6a686c9aa4e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:56.047933 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-75b070cd-263d-4cc8-a2fb-c6a686c9aa4e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:56.048711 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-75b070cd-263d-4cc8-a2fb-c6a686c9aa4e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:56.049140 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-75b070cd-263d-4cc8-a2fb-c6a686c9aa4e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:56.298068 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-979d29fd-ae0e-44ab-97a5-2686fb719c3f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "POST /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.810697 May 03 08:55:56.298864 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 159/310] 10.222.0.11 () {60 vars in 1322 bytes} [Tue May 3 08:55:55 2022] POST /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21/os-volume_attachments => generated 194 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:55:56.301960 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-75b070cd-263d-4cc8-a2fb-c6a686c9aa4e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:56.304092 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [req-f76271b0-966b-4dcb-9167-a9947b976185 req-e7391309-26ab-4865-9f22-1399e99185ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "512c1f04-399e-4647-8bfe-f2c295397df2", "tag": "fa2818f3-6dd4-4c2e-8c03-d124c2ac8ac8"}]} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:55:56.310222 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-75b070cd-263d-4cc8-a2fb-c6a686c9aa4e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1368 microversion: 2.1 time: 0.272842 May 03 08:55:56.310978 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 152/311] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:56 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1368 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:56.319637 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-f76271b0-966b-4dcb-9167-a9947b976185 req-e7391309-26ab-4865-9f22-1399e99185ac service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:56.319637 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-f76271b0-966b-4dcb-9167-a9947b976185 req-e7391309-26ab-4865-9f22-1399e99185ac service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:56.325979 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.compute.server_external_events [req-f76271b0-966b-4dcb-9167-a9947b976185 req-e7391309-26ab-4865-9f22-1399e99185ac service nova] Creating event network-changed:fa2818f3-6dd4-4c2e-8c03-d124c2ac8ac8 for instance 512c1f04-399e-4647-8bfe-f2c295397df2 on hv-cinder-84027 May 03 08:55:56.327611 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ddb1c61e-297a-45ba-96ad-2ff694e33274 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:56.328484 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ddb1c61e-297a-45ba-96ad-2ff694e33274 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:56.330789 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [req-f76271b0-966b-4dcb-9167-a9947b976185 req-e7391309-26ab-4865-9f22-1399e99185ac service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030389 May 03 08:55:56.331461 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 160/312] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 08:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:55:56.335602 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ddb1c61e-297a-45ba-96ad-2ff694e33274 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:56.336115 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ddb1c61e-297a-45ba-96ad-2ff694e33274 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:56.336888 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ddb1c61e-297a-45ba-96ad-2ff694e33274 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:56.337317 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ddb1c61e-297a-45ba-96ad-2ff694e33274 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:56.457643 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-6b90f87f-6402-421e-a06c-7158470309ce tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:56.458330 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-6b90f87f-6402-421e-a06c-7158470309ce tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:56.466098 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6b90f87f-6402-421e-a06c-7158470309ce tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:56.466813 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6b90f87f-6402-421e-a06c-7158470309ce tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:56.467304 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6b90f87f-6402-421e-a06c-7158470309ce tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:56.467744 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6b90f87f-6402-421e-a06c-7158470309ce tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:56.577588 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ddb1c61e-297a-45ba-96ad-2ff694e33274 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:56.585518 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ddb1c61e-297a-45ba-96ad-2ff694e33274 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1453 microversion: 2.1 time: 0.263128 May 03 08:55:56.586091 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 153/313] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:56 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1453 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:56.602372 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-8dc70169-c7fa-4e9b-b913-e04a49a15198 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:56.603241 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-8dc70169-c7fa-4e9b-b913-e04a49a15198 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:56.609505 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8dc70169-c7fa-4e9b-b913-e04a49a15198 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:56.609959 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8dc70169-c7fa-4e9b-b913-e04a49a15198 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:56.610729 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8dc70169-c7fa-4e9b-b913-e04a49a15198 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:56.611163 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8dc70169-c7fa-4e9b-b913-e04a49a15198 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:56.684159 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-6b90f87f-6402-421e-a06c-7158470309ce tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:56.692797 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-6b90f87f-6402-421e-a06c-7158470309ce tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1725 microversion: 2.1 time: 0.239373 May 03 08:55:56.693373 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 161/314] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:56 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1725 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:56.813563 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-8dc70169-c7fa-4e9b-b913-e04a49a15198 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:56.821627 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-8dc70169-c7fa-4e9b-b913-e04a49a15198 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1453 microversion: 2.1 time: 0.223393 May 03 08:55:56.822207 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 154/315] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:56 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1453 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:57.054132 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-83bd2dc4-27af-47d6-af14-b4862852b174 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:57.054762 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-83bd2dc4-27af-47d6-af14-b4862852b174 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:57.061760 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-83bd2dc4-27af-47d6-af14-b4862852b174 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:57.062209 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-83bd2dc4-27af-47d6-af14-b4862852b174 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:57.062973 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-83bd2dc4-27af-47d6-af14-b4862852b174 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:57.063403 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-83bd2dc4-27af-47d6-af14-b4862852b174 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:57.202893 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-83bd2dc4-27af-47d6-af14-b4862852b174 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:57.211258 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-83bd2dc4-27af-47d6-af14-b4862852b174 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:57.212939 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-83bd2dc4-27af-47d6-af14-b4862852b174 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:57.214110 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-83bd2dc4-27af-47d6-af14-b4862852b174 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1743 microversion: 2.20 time: 0.164113 May 03 08:55:57.214659 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 162/316] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:55:57 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1743 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:55:57.327156 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-948e65ae-5eff-411d-ae3b-0ef93e9c3247 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:57.328084 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-948e65ae-5eff-411d-ae3b-0ef93e9c3247 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:57.334705 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-948e65ae-5eff-411d-ae3b-0ef93e9c3247 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:57.335148 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-948e65ae-5eff-411d-ae3b-0ef93e9c3247 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:57.335999 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-948e65ae-5eff-411d-ae3b-0ef93e9c3247 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:57.336426 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-948e65ae-5eff-411d-ae3b-0ef93e9c3247 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:57.467934 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-948e65ae-5eff-411d-ae3b-0ef93e9c3247 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:57.479190 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-948e65ae-5eff-411d-ae3b-0ef93e9c3247 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1368 microversion: 2.1 time: 0.155668 May 03 08:55:57.480606 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 155/317] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:57 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:57.712179 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9652a2e2-fb8f-4adc-aca8-6c70c85e38ac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:57.713468 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9652a2e2-fb8f-4adc-aca8-6c70c85e38ac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:57.721048 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9652a2e2-fb8f-4adc-aca8-6c70c85e38ac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:57.721479 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9652a2e2-fb8f-4adc-aca8-6c70c85e38ac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:57.722658 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9652a2e2-fb8f-4adc-aca8-6c70c85e38ac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:57.723568 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9652a2e2-fb8f-4adc-aca8-6c70c85e38ac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:57.870270 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9652a2e2-fb8f-4adc-aca8-6c70c85e38ac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:57.878201 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9652a2e2-fb8f-4adc-aca8-6c70c85e38ac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1725 microversion: 2.1 time: 0.171588 May 03 08:55:57.887964 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 163/318] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:57 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:58.233594 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2ce6ad78-05d9-4294-9fc1-3f8bd9c745ad tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:58.234220 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-2ce6ad78-05d9-4294-9fc1-3f8bd9c745ad tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:58.244268 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2ce6ad78-05d9-4294-9fc1-3f8bd9c745ad tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:58.244904 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2ce6ad78-05d9-4294-9fc1-3f8bd9c745ad tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:58.245692 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2ce6ad78-05d9-4294-9fc1-3f8bd9c745ad tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:58.246311 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2ce6ad78-05d9-4294-9fc1-3f8bd9c745ad tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:58.457152 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2ce6ad78-05d9-4294-9fc1-3f8bd9c745ad tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:58.465277 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2ce6ad78-05d9-4294-9fc1-3f8bd9c745ad tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:58.467249 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2ce6ad78-05d9-4294-9fc1-3f8bd9c745ad tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:58.468662 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-2ce6ad78-05d9-4294-9fc1-3f8bd9c745ad tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1743 microversion: 2.20 time: 0.239399 May 03 08:55:58.469794 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 156/319] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:55:58 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1743 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:55:58.496942 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-583e0359-b047-46b5-baf1-d5e1b3835322 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:58.498364 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-583e0359-b047-46b5-baf1-d5e1b3835322 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:58.505110 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-583e0359-b047-46b5-baf1-d5e1b3835322 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:58.505553 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-583e0359-b047-46b5-baf1-d5e1b3835322 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:58.506495 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-583e0359-b047-46b5-baf1-d5e1b3835322 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:58.507084 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-583e0359-b047-46b5-baf1-d5e1b3835322 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:58.711013 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-583e0359-b047-46b5-baf1-d5e1b3835322 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:58.720843 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-583e0359-b047-46b5-baf1-d5e1b3835322 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1368 microversion: 2.1 time: 0.227552 May 03 08:55:58.722629 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 164/320] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:58 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1368 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:58.896940 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0726391b-f2e1-4a8c-8727-d4e90887237a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:58.898079 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0726391b-f2e1-4a8c-8727-d4e90887237a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:58.904264 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0726391b-f2e1-4a8c-8727-d4e90887237a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:58.904718 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0726391b-f2e1-4a8c-8727-d4e90887237a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:58.905465 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0726391b-f2e1-4a8c-8727-d4e90887237a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:58.906061 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0726391b-f2e1-4a8c-8727-d4e90887237a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:58.993955 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [req-23948913-cf27-43e5-b02b-82b72bf1ef41 req-f1a92066-bb6f-496d-bf3f-c1608906c01a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a53f83a8-c719-47a0-969f-5b1305f839df", "tag": "4e301bfe-acfc-48d5-af98-78513570286c"}]} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:55:59.002354 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-23948913-cf27-43e5-b02b-82b72bf1ef41 req-f1a92066-bb6f-496d-bf3f-c1608906c01a service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:59.002824 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-23948913-cf27-43e5-b02b-82b72bf1ef41 req-f1a92066-bb6f-496d-bf3f-c1608906c01a service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:59.015423 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.compute.server_external_events [req-23948913-cf27-43e5-b02b-82b72bf1ef41 req-f1a92066-bb6f-496d-bf3f-c1608906c01a service nova] Creating event network-changed:4e301bfe-acfc-48d5-af98-78513570286c for instance a53f83a8-c719-47a0-969f-5b1305f839df on hv-cinder-84027 May 03 08:55:59.021300 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [req-23948913-cf27-43e5-b02b-82b72bf1ef41 req-f1a92066-bb6f-496d-bf3f-c1608906c01a service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031022 May 03 08:55:59.026300 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 165/321] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 08:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:55:59.055879 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0726391b-f2e1-4a8c-8727-d4e90887237a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:59.067484 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0726391b-f2e1-4a8c-8727-d4e90887237a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1702 microversion: 2.1 time: 0.175340 May 03 08:55:59.071815 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 157/322] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:58 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1702 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:59.085612 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-adafa57c-b0f5-4633-aab4-ee8bf5bc20f9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:55:59.092121 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-adafa57c-b0f5-4633-aab4-ee8bf5bc20f9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:59.092567 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-adafa57c-b0f5-4633-aab4-ee8bf5bc20f9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:59.116107 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-adafa57c-b0f5-4633-aab4-ee8bf5bc20f9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Going to try to start instance {{(pid=123391) start /opt/stack/nova/nova/compute/api.py:2730}} May 03 08:55:59.165727 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-adafa57c-b0f5-4633-aab4-ee8bf5bc20f9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "POST /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/action" status: 202 len: 0 microversion: 2.1 time: 0.084508 May 03 08:55:59.175160 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-91154998-26a0-4a34-8f9c-71cb10a33427 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:59.176400 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-91154998-26a0-4a34-8f9c-71cb10a33427 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:59.182247 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-91154998-26a0-4a34-8f9c-71cb10a33427 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:59.182701 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-91154998-26a0-4a34-8f9c-71cb10a33427 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:59.183639 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-91154998-26a0-4a34-8f9c-71cb10a33427 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:59.184108 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-91154998-26a0-4a34-8f9c-71cb10a33427 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:59.185687 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 166/323] 10.222.0.11 () {60 vars in 1277 bytes} [Tue May 3 08:55:59 2022] POST /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 08:55:59.488557 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-8593e3c7-d79c-4122-839d-23473000bba5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:59.489730 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-8593e3c7-d79c-4122-839d-23473000bba5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:59.495254 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-91154998-26a0-4a34-8f9c-71cb10a33427 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:55:59.504363 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8593e3c7-d79c-4122-839d-23473000bba5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:59.508896 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8593e3c7-d79c-4122-839d-23473000bba5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:59.511266 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8593e3c7-d79c-4122-839d-23473000bba5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:59.511375 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-91154998-26a0-4a34-8f9c-71cb10a33427 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1711 microversion: 2.1 time: 0.340327 May 03 08:55:59.512294 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8593e3c7-d79c-4122-839d-23473000bba5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:59.532059 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 158/324] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:59 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1711 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:55:59.738850 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-835c51f8-edff-4d0b-aac1-3dc80f237cba tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:55:59.739644 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-835c51f8-edff-4d0b-aac1-3dc80f237cba tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:55:59.751975 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-835c51f8-edff-4d0b-aac1-3dc80f237cba tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:59.755131 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-835c51f8-edff-4d0b-aac1-3dc80f237cba tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:55:59.756222 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-835c51f8-edff-4d0b-aac1-3dc80f237cba tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:55:59.761085 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-835c51f8-edff-4d0b-aac1-3dc80f237cba tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:00.188143 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-8593e3c7-d79c-4122-839d-23473000bba5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:00.198008 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-8593e3c7-d79c-4122-839d-23473000bba5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:00.199567 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-8593e3c7-d79c-4122-839d-23473000bba5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:00.213433 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-8593e3c7-d79c-4122-839d-23473000bba5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1738 microversion: 2.20 time: 0.730557 May 03 08:56:00.214067 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 167/325] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:55:59 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1738 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:56:00.218739 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [req-b0f91b86-6003-4e65-8c62-c623a715449c req-6054e0e1-39bc-4be2-850b-39b25cf6f001 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b68d79a3-e9c5-46b6-b8c0-a9d6017f388f", "name": "network-vif-plugged", "status": "completed", "tag": "c0a78137-d132-441d-8bd5-1d74354f3e67"}]} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:56:00.235978 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-b0f91b86-6003-4e65-8c62-c623a715449c req-6054e0e1-39bc-4be2-850b-39b25cf6f001 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:00.236670 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-b0f91b86-6003-4e65-8c62-c623a715449c req-6054e0e1-39bc-4be2-850b-39b25cf6f001 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:00.248889 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.compute.server_external_events [req-b0f91b86-6003-4e65-8c62-c623a715449c req-6054e0e1-39bc-4be2-850b-39b25cf6f001 service nova] Creating event network-vif-plugged:c0a78137-d132-441d-8bd5-1d74354f3e67 for instance b68d79a3-e9c5-46b6-b8c0-a9d6017f388f on hv-cinder-84027 May 03 08:56:00.255999 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [req-b0f91b86-6003-4e65-8c62-c623a715449c req-6054e0e1-39bc-4be2-850b-39b25cf6f001 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039682 May 03 08:56:00.257193 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 168/326] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 08:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:56:00.413242 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-835c51f8-edff-4d0b-aac1-3dc80f237cba tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:00.421218 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-835c51f8-edff-4d0b-aac1-3dc80f237cba tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1368 microversion: 2.1 time: 0.686623 May 03 08:56:00.431865 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 159/327] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:55:59 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1368 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 08:56:00.550181 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-4b55b2c9-9c2b-492c-8b56-32a27b80dcd2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:00.550876 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-4b55b2c9-9c2b-492c-8b56-32a27b80dcd2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:00.559395 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4b55b2c9-9c2b-492c-8b56-32a27b80dcd2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:00.560105 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4b55b2c9-9c2b-492c-8b56-32a27b80dcd2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:00.561041 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4b55b2c9-9c2b-492c-8b56-32a27b80dcd2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:00.561689 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4b55b2c9-9c2b-492c-8b56-32a27b80dcd2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:00.797373 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-4b55b2c9-9c2b-492c-8b56-32a27b80dcd2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:00.808624 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-4b55b2c9-9c2b-492c-8b56-32a27b80dcd2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1711 microversion: 2.1 time: 0.263067 May 03 08:56:00.818997 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 169/328] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:56:00 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1711 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:56:01.232300 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0315bd83-1e43-41dc-9d0e-01c5290e7513 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:01.233658 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0315bd83-1e43-41dc-9d0e-01c5290e7513 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:01.248690 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0315bd83-1e43-41dc-9d0e-01c5290e7513 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:01.248690 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0315bd83-1e43-41dc-9d0e-01c5290e7513 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:01.248690 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0315bd83-1e43-41dc-9d0e-01c5290e7513 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:01.248690 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0315bd83-1e43-41dc-9d0e-01c5290e7513 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:01.440986 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a80a5e57-8993-470c-804a-dc387030d906 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:01.442550 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a80a5e57-8993-470c-804a-dc387030d906 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:01.444402 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0315bd83-1e43-41dc-9d0e-01c5290e7513 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:01.449579 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a80a5e57-8993-470c-804a-dc387030d906 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:01.450312 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a80a5e57-8993-470c-804a-dc387030d906 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:01.451305 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a80a5e57-8993-470c-804a-dc387030d906 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:01.452287 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0315bd83-1e43-41dc-9d0e-01c5290e7513 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:01.453227 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a80a5e57-8993-470c-804a-dc387030d906 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:01.455352 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0315bd83-1e43-41dc-9d0e-01c5290e7513 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:01.457036 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0315bd83-1e43-41dc-9d0e-01c5290e7513 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1738 microversion: 2.20 time: 0.229017 May 03 08:56:01.458162 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 160/329] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:56:01 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1738 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:56:01.603597 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a80a5e57-8993-470c-804a-dc387030d906 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:01.615344 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a80a5e57-8993-470c-804a-dc387030d906 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1368 microversion: 2.1 time: 0.181471 May 03 08:56:01.619065 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 170/330] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:56:01 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1368 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 08:56:01.830277 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-98703ada-9cb9-4e2a-8ecb-fb489c37731e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:01.831454 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-98703ada-9cb9-4e2a-8ecb-fb489c37731e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:01.838950 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-98703ada-9cb9-4e2a-8ecb-fb489c37731e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:01.839398 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-98703ada-9cb9-4e2a-8ecb-fb489c37731e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:01.840196 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-98703ada-9cb9-4e2a-8ecb-fb489c37731e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:01.840828 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-98703ada-9cb9-4e2a-8ecb-fb489c37731e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:01.986184 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-98703ada-9cb9-4e2a-8ecb-fb489c37731e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:01.995153 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-98703ada-9cb9-4e2a-8ecb-fb489c37731e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1715 microversion: 2.1 time: 0.172661 May 03 08:56:01.995734 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 161/331] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:56:01 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1715 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:56:02.272657 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [req-d8479b1a-29c9-4663-a3d4-5c9536b03e62 req-7f9ebdc5-a60b-4f4a-9e95-953e87227e0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "512c1f04-399e-4647-8bfe-f2c295397df2", "name": "network-vif-plugged", "status": "completed", "tag": "fa2818f3-6dd4-4c2e-8c03-d124c2ac8ac8"}]} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:56:02.282895 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-d8479b1a-29c9-4663-a3d4-5c9536b03e62 req-7f9ebdc5-a60b-4f4a-9e95-953e87227e0a service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:02.284709 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-d8479b1a-29c9-4663-a3d4-5c9536b03e62 req-7f9ebdc5-a60b-4f4a-9e95-953e87227e0a service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:02.298945 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.compute.server_external_events [req-d8479b1a-29c9-4663-a3d4-5c9536b03e62 req-7f9ebdc5-a60b-4f4a-9e95-953e87227e0a service nova] Creating event network-vif-plugged:fa2818f3-6dd4-4c2e-8c03-d124c2ac8ac8 for instance 512c1f04-399e-4647-8bfe-f2c295397df2 on hv-cinder-84027 May 03 08:56:02.304078 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [req-d8479b1a-29c9-4663-a3d4-5c9536b03e62 req-7f9ebdc5-a60b-4f4a-9e95-953e87227e0a service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035489 May 03 08:56:02.307504 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 171/332] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 08:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:56:02.475356 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-041ce80f-a439-4669-b506-1ac66c2f3354 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:02.477175 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-041ce80f-a439-4669-b506-1ac66c2f3354 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:02.488927 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-041ce80f-a439-4669-b506-1ac66c2f3354 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:02.489900 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-041ce80f-a439-4669-b506-1ac66c2f3354 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:02.491976 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-041ce80f-a439-4669-b506-1ac66c2f3354 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:02.492648 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-041ce80f-a439-4669-b506-1ac66c2f3354 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:02.639283 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-7bddb485-d576-4e81-b8b3-bff0d4adc399 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:02.641080 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-7bddb485-d576-4e81-b8b3-bff0d4adc399 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:02.651745 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7bddb485-d576-4e81-b8b3-bff0d4adc399 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:02.653174 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7bddb485-d576-4e81-b8b3-bff0d4adc399 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:02.654184 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7bddb485-d576-4e81-b8b3-bff0d4adc399 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:02.654834 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7bddb485-d576-4e81-b8b3-bff0d4adc399 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:02.670253 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-041ce80f-a439-4669-b506-1ac66c2f3354 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:02.682593 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-041ce80f-a439-4669-b506-1ac66c2f3354 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:02.686805 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-041ce80f-a439-4669-b506-1ac66c2f3354 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:02.688287 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-041ce80f-a439-4669-b506-1ac66c2f3354 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1738 microversion: 2.20 time: 0.217293 May 03 08:56:02.690776 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 162/333] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:56:02 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1738 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:56:02.833136 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7bddb485-d576-4e81-b8b3-bff0d4adc399 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:02.843906 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-7bddb485-d576-4e81-b8b3-bff0d4adc399 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1368 microversion: 2.1 time: 0.209692 May 03 08:56:02.854319 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 172/334] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:56:02 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1368 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:56:03.706222 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b2fc30c1-3717-4941-9a5a-74c3c84fdd24 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:03.706826 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b2fc30c1-3717-4941-9a5a-74c3c84fdd24 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:03.713756 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b2fc30c1-3717-4941-9a5a-74c3c84fdd24 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:03.715008 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b2fc30c1-3717-4941-9a5a-74c3c84fdd24 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:03.715984 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b2fc30c1-3717-4941-9a5a-74c3c84fdd24 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:03.716605 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b2fc30c1-3717-4941-9a5a-74c3c84fdd24 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:03.864256 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-6ff820db-e67f-4922-9dd8-d3553ea709cc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:03.864256 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-6ff820db-e67f-4922-9dd8-d3553ea709cc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:03.875947 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6ff820db-e67f-4922-9dd8-d3553ea709cc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:03.877590 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6ff820db-e67f-4922-9dd8-d3553ea709cc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:03.879120 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6ff820db-e67f-4922-9dd8-d3553ea709cc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:03.879741 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6ff820db-e67f-4922-9dd8-d3553ea709cc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:03.907155 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b2fc30c1-3717-4941-9a5a-74c3c84fdd24 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:03.916492 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b2fc30c1-3717-4941-9a5a-74c3c84fdd24 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:03.921480 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b2fc30c1-3717-4941-9a5a-74c3c84fdd24 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:03.922966 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b2fc30c1-3717-4941-9a5a-74c3c84fdd24 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1738 microversion: 2.20 time: 0.220766 May 03 08:56:03.923751 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 163/335] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:56:03 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1738 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:56:04.031636 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-6ff820db-e67f-4922-9dd8-d3553ea709cc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:04.042828 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-6ff820db-e67f-4922-9dd8-d3553ea709cc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1368 microversion: 2.1 time: 0.184700 May 03 08:56:04.052174 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 173/336] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:56:03 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1368 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:56:04.942164 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5a9a4b15-913a-493e-a4ff-c62d129b08fe tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:04.942712 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5a9a4b15-913a-493e-a4ff-c62d129b08fe tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:04.949353 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5a9a4b15-913a-493e-a4ff-c62d129b08fe tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:04.950116 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5a9a4b15-913a-493e-a4ff-c62d129b08fe tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:04.950906 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5a9a4b15-913a-493e-a4ff-c62d129b08fe tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:04.951335 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5a9a4b15-913a-493e-a4ff-c62d129b08fe tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:05.067559 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c5595904-55a2-4303-bf36-58a460994d39 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:05.068485 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c5595904-55a2-4303-bf36-58a460994d39 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:05.074597 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c5595904-55a2-4303-bf36-58a460994d39 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:05.075314 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c5595904-55a2-4303-bf36-58a460994d39 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:05.076524 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c5595904-55a2-4303-bf36-58a460994d39 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:05.077133 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c5595904-55a2-4303-bf36-58a460994d39 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:05.103395 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5a9a4b15-913a-493e-a4ff-c62d129b08fe tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:05.111614 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5a9a4b15-913a-493e-a4ff-c62d129b08fe tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:05.113322 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5a9a4b15-913a-493e-a4ff-c62d129b08fe tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:05.114563 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5a9a4b15-913a-493e-a4ff-c62d129b08fe tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1738 microversion: 2.20 time: 0.176811 May 03 08:56:05.115348 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 164/337] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:56:04 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:56:05.225584 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c5595904-55a2-4303-bf36-58a460994d39 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:05.242697 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c5595904-55a2-4303-bf36-58a460994d39 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1562 microversion: 2.1 time: 0.186743 May 03 08:56:05.248881 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 174/338] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:56:05 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1562 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:56:05.261486 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4ec605a4-c285-4da8-9d7e-5974067635fa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:05.262022 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4ec605a4-c285-4da8-9d7e-5974067635fa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:05.268880 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4ec605a4-c285-4da8-9d7e-5974067635fa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:05.269326 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4ec605a4-c285-4da8-9d7e-5974067635fa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:05.270102 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4ec605a4-c285-4da8-9d7e-5974067635fa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:05.270735 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4ec605a4-c285-4da8-9d7e-5974067635fa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:05.354877 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-4ec605a4-c285-4da8-9d7e-5974067635fa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097247 May 03 08:56:05.355508 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 165/339] 10.222.0.11 () {58 vars in 1274 bytes} [Tue May 3 08:56:05 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:56:06.133357 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f0eab6b4-03c7-4917-93a7-24fe02dfa4f8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:06.134045 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f0eab6b4-03c7-4917-93a7-24fe02dfa4f8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:06.145954 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f0eab6b4-03c7-4917-93a7-24fe02dfa4f8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:06.147003 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f0eab6b4-03c7-4917-93a7-24fe02dfa4f8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:06.148291 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f0eab6b4-03c7-4917-93a7-24fe02dfa4f8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:06.149061 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f0eab6b4-03c7-4917-93a7-24fe02dfa4f8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:06.354932 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f0eab6b4-03c7-4917-93a7-24fe02dfa4f8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:06.364637 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f0eab6b4-03c7-4917-93a7-24fe02dfa4f8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:06.366614 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f0eab6b4-03c7-4917-93a7-24fe02dfa4f8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:06.368025 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f0eab6b4-03c7-4917-93a7-24fe02dfa4f8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1738 microversion: 2.20 time: 0.238628 May 03 08:56:06.368751 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 175/340] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:56:06 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1738 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:56:06.739623 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-ab32b2db-e859-4660-8e68-ea7d1cf120f8 req-d0869673-a156-4ef9-acca-720fcbf40d14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "512c1f04-399e-4647-8bfe-f2c295397df2", "tag": "fa2818f3-6dd4-4c2e-8c03-d124c2ac8ac8"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:56:06.748625 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-ab32b2db-e859-4660-8e68-ea7d1cf120f8 req-d0869673-a156-4ef9-acca-720fcbf40d14 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:06.749359 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-ab32b2db-e859-4660-8e68-ea7d1cf120f8 req-d0869673-a156-4ef9-acca-720fcbf40d14 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:06.768884 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-ab32b2db-e859-4660-8e68-ea7d1cf120f8 req-d0869673-a156-4ef9-acca-720fcbf40d14 service nova] Creating event network-changed:fa2818f3-6dd4-4c2e-8c03-d124c2ac8ac8 for instance 512c1f04-399e-4647-8bfe-f2c295397df2 on hv-cinder-84027 May 03 08:56:06.774527 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-ab32b2db-e859-4660-8e68-ea7d1cf120f8 req-d0869673-a156-4ef9-acca-720fcbf40d14 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039342 May 03 08:56:06.775863 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 166/341] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 08:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:56:07.392684 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b94e3025-e34b-46ce-920c-05636e4b3e30 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:07.394016 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b94e3025-e34b-46ce-920c-05636e4b3e30 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:07.401562 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b94e3025-e34b-46ce-920c-05636e4b3e30 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:07.405102 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b94e3025-e34b-46ce-920c-05636e4b3e30 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:07.406306 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b94e3025-e34b-46ce-920c-05636e4b3e30 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:07.407009 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b94e3025-e34b-46ce-920c-05636e4b3e30 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:07.562296 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b94e3025-e34b-46ce-920c-05636e4b3e30 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:07.573291 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b94e3025-e34b-46ce-920c-05636e4b3e30 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:07.575339 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b94e3025-e34b-46ce-920c-05636e4b3e30 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:07.578470 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b94e3025-e34b-46ce-920c-05636e4b3e30 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1738 microversion: 2.20 time: 0.190206 May 03 08:56:07.579383 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 176/342] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:56:07 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1738 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:56:08.598174 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a571de5f-7432-45c4-8e30-abb55016df6f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:08.599616 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a571de5f-7432-45c4-8e30-abb55016df6f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:08.607357 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a571de5f-7432-45c4-8e30-abb55016df6f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:08.607813 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a571de5f-7432-45c4-8e30-abb55016df6f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:08.608624 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a571de5f-7432-45c4-8e30-abb55016df6f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:08.609091 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a571de5f-7432-45c4-8e30-abb55016df6f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:08.746134 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a571de5f-7432-45c4-8e30-abb55016df6f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:08.753927 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a571de5f-7432-45c4-8e30-abb55016df6f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:08.755438 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a571de5f-7432-45c4-8e30-abb55016df6f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:08.756650 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a571de5f-7432-45c4-8e30-abb55016df6f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1738 microversion: 2.20 time: 0.163259 May 03 08:56:08.757219 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 167/343] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:56:08 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:56:09.774852 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-2ababb60-9db4-4a3a-aa2e-d992a180e20f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:09.775399 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-2ababb60-9db4-4a3a-aa2e-d992a180e20f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:09.781960 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2ababb60-9db4-4a3a-aa2e-d992a180e20f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:09.782424 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2ababb60-9db4-4a3a-aa2e-d992a180e20f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:09.783178 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2ababb60-9db4-4a3a-aa2e-d992a180e20f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:09.783607 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2ababb60-9db4-4a3a-aa2e-d992a180e20f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:09.923226 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-2ababb60-9db4-4a3a-aa2e-d992a180e20f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:09.931508 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-2ababb60-9db4-4a3a-aa2e-d992a180e20f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:09.933022 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-2ababb60-9db4-4a3a-aa2e-d992a180e20f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:09.934178 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-2ababb60-9db4-4a3a-aa2e-d992a180e20f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1738 microversion: 2.20 time: 0.163468 May 03 08:56:09.934780 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 177/344] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:56:09 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:56:10.956693 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-77f99ab4-155e-4c2c-bac8-aefef9ca0a54 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:10.957651 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-77f99ab4-155e-4c2c-bac8-aefef9ca0a54 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:10.968019 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-77f99ab4-155e-4c2c-bac8-aefef9ca0a54 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:10.968767 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-77f99ab4-155e-4c2c-bac8-aefef9ca0a54 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:10.970005 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-77f99ab4-155e-4c2c-bac8-aefef9ca0a54 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:10.970719 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-77f99ab4-155e-4c2c-bac8-aefef9ca0a54 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:11.101909 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-77f99ab4-155e-4c2c-bac8-aefef9ca0a54 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:11.113347 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-77f99ab4-155e-4c2c-bac8-aefef9ca0a54 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:11.115645 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-77f99ab4-155e-4c2c-bac8-aefef9ca0a54 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:11.117365 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-77f99ab4-155e-4c2c-bac8-aefef9ca0a54 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1720 microversion: 2.20 time: 0.167043 May 03 08:56:11.118152 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 168/345] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:56:10 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:56:12.144325 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-7217ccaf-5df1-4568-9f49-540c4a1c36de tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:12.145341 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-7217ccaf-5df1-4568-9f49-540c4a1c36de tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:12.156171 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7217ccaf-5df1-4568-9f49-540c4a1c36de tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:12.156925 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7217ccaf-5df1-4568-9f49-540c4a1c36de tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:12.158130 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7217ccaf-5df1-4568-9f49-540c4a1c36de tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:12.158991 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7217ccaf-5df1-4568-9f49-540c4a1c36de tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:12.301051 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7217ccaf-5df1-4568-9f49-540c4a1c36de tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:12.309170 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7217ccaf-5df1-4568-9f49-540c4a1c36de tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:12.310668 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7217ccaf-5df1-4568-9f49-540c4a1c36de tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:12.311822 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-7217ccaf-5df1-4568-9f49-540c4a1c36de tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1720 microversion: 2.20 time: 0.174125 May 03 08:56:12.312396 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 178/346] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:56:12 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1720 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:56:13.333827 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-1fb688fe-4993-4b65-90b9-f5bd2e1dce13 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:13.334723 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-1fb688fe-4993-4b65-90b9-f5bd2e1dce13 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:13.345302 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1fb688fe-4993-4b65-90b9-f5bd2e1dce13 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:13.346049 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1fb688fe-4993-4b65-90b9-f5bd2e1dce13 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:13.346970 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1fb688fe-4993-4b65-90b9-f5bd2e1dce13 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:13.347410 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1fb688fe-4993-4b65-90b9-f5bd2e1dce13 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:13.489316 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-1fb688fe-4993-4b65-90b9-f5bd2e1dce13 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:13.497564 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-1fb688fe-4993-4b65-90b9-f5bd2e1dce13 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:13.499060 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-1fb688fe-4993-4b65-90b9-f5bd2e1dce13 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:13.500262 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-1fb688fe-4993-4b65-90b9-f5bd2e1dce13 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1720 microversion: 2.20 time: 0.173222 May 03 08:56:13.500819 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 169/347] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:56:13 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1720 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:56:14.020422 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [req-010d57c0-9c08-4a49-9baa-3be20908f339 req-698c2429-d130-4a1d-8e5c-837c0df669bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b68d79a3-e9c5-46b6-b8c0-a9d6017f388f", "name": "network-vif-unplugged", "status": "completed", "tag": "c0a78137-d132-441d-8bd5-1d74354f3e67"}]} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:56:14.028923 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-010d57c0-9c08-4a49-9baa-3be20908f339 req-698c2429-d130-4a1d-8e5c-837c0df669bc service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:14.029359 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-010d57c0-9c08-4a49-9baa-3be20908f339 req-698c2429-d130-4a1d-8e5c-837c0df669bc service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:14.040754 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.compute.server_external_events [req-010d57c0-9c08-4a49-9baa-3be20908f339 req-698c2429-d130-4a1d-8e5c-837c0df669bc service nova] Creating event network-vif-unplugged:c0a78137-d132-441d-8bd5-1d74354f3e67 for instance b68d79a3-e9c5-46b6-b8c0-a9d6017f388f on hv-cinder-84027 May 03 08:56:14.045796 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [req-010d57c0-9c08-4a49-9baa-3be20908f339 req-698c2429-d130-4a1d-8e5c-837c0df669bc service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029025 May 03 08:56:14.046377 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 179/348] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 08:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:56:14.522865 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c846ad60-050c-43ed-b6c6-10ca3cb742b8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:14.523883 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c846ad60-050c-43ed-b6c6-10ca3cb742b8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:14.534562 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c846ad60-050c-43ed-b6c6-10ca3cb742b8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:14.535315 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c846ad60-050c-43ed-b6c6-10ca3cb742b8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:14.536631 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c846ad60-050c-43ed-b6c6-10ca3cb742b8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:14.537353 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c846ad60-050c-43ed-b6c6-10ca3cb742b8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:14.675330 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c846ad60-050c-43ed-b6c6-10ca3cb742b8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:14.683708 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c846ad60-050c-43ed-b6c6-10ca3cb742b8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:14.685240 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c846ad60-050c-43ed-b6c6-10ca3cb742b8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:14.686390 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c846ad60-050c-43ed-b6c6-10ca3cb742b8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1720 microversion: 2.20 time: 0.170294 May 03 08:56:14.686959 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 170/349] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:56:14 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:56:15.710576 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-fe10cd41-df94-47c9-8698-8bceb60cbdf9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:15.711689 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-fe10cd41-df94-47c9-8698-8bceb60cbdf9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:15.721894 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fe10cd41-df94-47c9-8698-8bceb60cbdf9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:15.722336 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fe10cd41-df94-47c9-8698-8bceb60cbdf9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:15.723093 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fe10cd41-df94-47c9-8698-8bceb60cbdf9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:15.723522 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fe10cd41-df94-47c9-8698-8bceb60cbdf9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:15.867040 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-fe10cd41-df94-47c9-8698-8bceb60cbdf9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:15.878786 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-fe10cd41-df94-47c9-8698-8bceb60cbdf9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:15.881136 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-fe10cd41-df94-47c9-8698-8bceb60cbdf9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:15.882911 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-fe10cd41-df94-47c9-8698-8bceb60cbdf9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1720 microversion: 2.20 time: 0.180011 May 03 08:56:15.883715 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 180/350] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:56:15 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1720 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:56:16.905581 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-3c7c6230-fb41-4d63-a8c9-352e2bdbfb87 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:16.906507 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-3c7c6230-fb41-4d63-a8c9-352e2bdbfb87 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:16.917194 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3c7c6230-fb41-4d63-a8c9-352e2bdbfb87 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:16.917945 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3c7c6230-fb41-4d63-a8c9-352e2bdbfb87 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:16.919198 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3c7c6230-fb41-4d63-a8c9-352e2bdbfb87 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:16.919954 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3c7c6230-fb41-4d63-a8c9-352e2bdbfb87 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:17.052796 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-3c7c6230-fb41-4d63-a8c9-352e2bdbfb87 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:17.061264 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-3c7c6230-fb41-4d63-a8c9-352e2bdbfb87 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:17.062744 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-3c7c6230-fb41-4d63-a8c9-352e2bdbfb87 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:17.063963 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-3c7c6230-fb41-4d63-a8c9-352e2bdbfb87 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1720 microversion: 2.20 time: 0.164902 May 03 08:56:17.064501 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 171/351] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:56:16 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:56:18.081817 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-395151d4-e95a-430c-a699-6de989289925 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:18.082400 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-395151d4-e95a-430c-a699-6de989289925 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:18.089428 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-395151d4-e95a-430c-a699-6de989289925 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:18.089875 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-395151d4-e95a-430c-a699-6de989289925 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:18.090660 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-395151d4-e95a-430c-a699-6de989289925 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:18.091089 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-395151d4-e95a-430c-a699-6de989289925 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:18.230582 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-395151d4-e95a-430c-a699-6de989289925 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:18.238710 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-395151d4-e95a-430c-a699-6de989289925 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:18.240218 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-395151d4-e95a-430c-a699-6de989289925 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:18.241391 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-395151d4-e95a-430c-a699-6de989289925 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1720 microversion: 2.20 time: 0.163569 May 03 08:56:18.241929 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 181/352] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:56:18 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:56:19.261338 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0d116387-e95c-4d3b-8708-317ba05b2e7a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:19.262129 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0d116387-e95c-4d3b-8708-317ba05b2e7a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:19.270624 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0d116387-e95c-4d3b-8708-317ba05b2e7a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:19.271231 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0d116387-e95c-4d3b-8708-317ba05b2e7a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:19.272277 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0d116387-e95c-4d3b-8708-317ba05b2e7a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:19.272852 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0d116387-e95c-4d3b-8708-317ba05b2e7a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:19.404309 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0d116387-e95c-4d3b-8708-317ba05b2e7a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:19.412284 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0d116387-e95c-4d3b-8708-317ba05b2e7a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:19.413786 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0d116387-e95c-4d3b-8708-317ba05b2e7a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:19.414965 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0d116387-e95c-4d3b-8708-317ba05b2e7a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1663 microversion: 2.20 time: 0.159051 May 03 08:56:19.415547 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 172/353] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:56:19 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1663 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:56:19.435958 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ead0f478-e148-49c5-873c-71a01f85da54 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a037717-e7a0-4aa0-a671-6c1977538d9d"}} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:56:19.437374 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ead0f478-e148-49c5-873c-71a01f85da54 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:19.444749 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ead0f478-e148-49c5-873c-71a01f85da54 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:19.445190 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ead0f478-e148-49c5-873c-71a01f85da54 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:19.445948 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ead0f478-e148-49c5-873c-71a01f85da54 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:19.446370 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ead0f478-e148-49c5-873c-71a01f85da54 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:19.752514 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ead0f478-e148-49c5-873c-71a01f85da54 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "POST /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.323497 May 03 08:56:19.753145 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 182/354] 10.222.0.11 () {62 vars in 1363 bytes} [Tue May 3 08:56:19 2022] POST /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 188 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:56:19.866752 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-aa6f0b2b-c576-4d2d-8bc0-32cedb21e13a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:56:19.867393 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-aa6f0b2b-c576-4d2d-8bc0-32cedb21e13a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:19.874573 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aa6f0b2b-c576-4d2d-8bc0-32cedb21e13a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:19.875024 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aa6f0b2b-c576-4d2d-8bc0-32cedb21e13a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:19.875792 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aa6f0b2b-c576-4d2d-8bc0-32cedb21e13a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:19.876255 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aa6f0b2b-c576-4d2d-8bc0-32cedb21e13a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:19.980935 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-aa6f0b2b-c576-4d2d-8bc0-32cedb21e13a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "POST /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/action" status: 202 len: 0 microversion: 2.20 time: 0.119689 May 03 08:56:19.981539 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 173/355] 10.222.0.11 () {62 vars in 1318 bytes} [Tue May 3 08:56:19 2022] POST /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 03 08:56:19.989711 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a8d91141-55aa-4a64-ab79-c8f90afe45e3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:19.990433 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a8d91141-55aa-4a64-ab79-c8f90afe45e3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:19.997495 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a8d91141-55aa-4a64-ab79-c8f90afe45e3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:19.997941 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a8d91141-55aa-4a64-ab79-c8f90afe45e3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:19.998749 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a8d91141-55aa-4a64-ab79-c8f90afe45e3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:19.999189 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a8d91141-55aa-4a64-ab79-c8f90afe45e3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:20.126239 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a8d91141-55aa-4a64-ab79-c8f90afe45e3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:20.134455 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a8d91141-55aa-4a64-ab79-c8f90afe45e3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:20.136241 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a8d91141-55aa-4a64-ab79-c8f90afe45e3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:20.137391 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a8d91141-55aa-4a64-ab79-c8f90afe45e3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1749 microversion: 2.20 time: 0.151704 May 03 08:56:20.137912 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 183/356] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:56:19 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1749 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 08:56:21.156476 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b33946f5-5695-486c-b102-45c670d11502 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:21.157082 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b33946f5-5695-486c-b102-45c670d11502 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:21.163430 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b33946f5-5695-486c-b102-45c670d11502 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:21.163910 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b33946f5-5695-486c-b102-45c670d11502 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:21.164674 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b33946f5-5695-486c-b102-45c670d11502 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:21.165101 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b33946f5-5695-486c-b102-45c670d11502 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:21.294814 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b33946f5-5695-486c-b102-45c670d11502 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:21.303135 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b33946f5-5695-486c-b102-45c670d11502 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:21.304659 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b33946f5-5695-486c-b102-45c670d11502 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:21.305829 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b33946f5-5695-486c-b102-45c670d11502 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1751 microversion: 2.20 time: 0.153938 May 03 08:56:21.306398 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 174/357] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:56:21 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:56:22.325895 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-91624c70-dff8-42e7-a595-dd5fdf10fc63 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:22.326516 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-91624c70-dff8-42e7-a595-dd5fdf10fc63 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:22.333372 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-91624c70-dff8-42e7-a595-dd5fdf10fc63 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:22.333831 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-91624c70-dff8-42e7-a595-dd5fdf10fc63 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:22.334607 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-91624c70-dff8-42e7-a595-dd5fdf10fc63 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:22.335045 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-91624c70-dff8-42e7-a595-dd5fdf10fc63 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:22.372257 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f92fd87c-a089-43c1-b9f7-f9e4e9fc7c03 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:22.372777 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f92fd87c-a089-43c1-b9f7-f9e4e9fc7c03 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 58e5c955-f74d-4c1d-8492-457b7ab13f21] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:22.379814 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f92fd87c-a089-43c1-b9f7-f9e4e9fc7c03 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:22.380503 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f92fd87c-a089-43c1-b9f7-f9e4e9fc7c03 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:22.381268 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f92fd87c-a089-43c1-b9f7-f9e4e9fc7c03 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:22.381763 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f92fd87c-a089-43c1-b9f7-f9e4e9fc7c03 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:22.511317 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.objects.instance [None req-f92fd87c-a089-43c1-b9f7-f9e4e9fc7c03 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lazy-loading 'services' on Instance uuid 58e5c955-f74d-4c1d-8492-457b7ab13f21 {{(pid=123392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 03 08:56:22.535893 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-91624c70-dff8-42e7-a595-dd5fdf10fc63 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:22.546603 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-91624c70-dff8-42e7-a595-dd5fdf10fc63 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:22.548286 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-91624c70-dff8-42e7-a595-dd5fdf10fc63 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:22.549536 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-91624c70-dff8-42e7-a595-dd5fdf10fc63 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1807 microversion: 2.20 time: 0.228007 May 03 08:56:22.550166 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 184/358] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:56:22 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1807 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:56:22.622563 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f92fd87c-a089-43c1-b9f7-f9e4e9fc7c03 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "DELETE /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21/os-volume_attachments/f31497da-e7a1-4354-972d-fb6676b45682" status: 202 len: 0 microversion: 2.1 time: 0.254150 May 03 08:56:22.623372 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 175/359] 10.222.0.11 () {58 vars in 1415 bytes} [Tue May 3 08:56:22 2022] DELETE /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21/os-volume_attachments/f31497da-e7a1-4354-972d-fb6676b45682 => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 08:56:23.567982 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d1b12d88-5617-42f8-8e98-8deb6a4486be tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:23.568547 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d1b12d88-5617-42f8-8e98-8deb6a4486be tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:23.575184 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d1b12d88-5617-42f8-8e98-8deb6a4486be tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:23.575628 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d1b12d88-5617-42f8-8e98-8deb6a4486be tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:23.576418 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d1b12d88-5617-42f8-8e98-8deb6a4486be tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:23.576845 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d1b12d88-5617-42f8-8e98-8deb6a4486be tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:23.709515 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d1b12d88-5617-42f8-8e98-8deb6a4486be tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:23.720475 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d1b12d88-5617-42f8-8e98-8deb6a4486be tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:23.722138 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d1b12d88-5617-42f8-8e98-8deb6a4486be tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:23.723443 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d1b12d88-5617-42f8-8e98-8deb6a4486be tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1807 microversion: 2.20 time: 0.159486 May 03 08:56:23.724094 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 185/360] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:56:23 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:56:23.752158 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-949d8659-3aae-46d1-b7b6-98e0eee7e6db tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:23.752733 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-949d8659-3aae-46d1-b7b6-98e0eee7e6db tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 58e5c955-f74d-4c1d-8492-457b7ab13f21] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:23.759969 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-949d8659-3aae-46d1-b7b6-98e0eee7e6db tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:23.760446 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-949d8659-3aae-46d1-b7b6-98e0eee7e6db tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:23.761278 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-949d8659-3aae-46d1-b7b6-98e0eee7e6db tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:23.761820 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-949d8659-3aae-46d1-b7b6-98e0eee7e6db tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:23.789855 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-949d8659-3aae-46d1-b7b6-98e0eee7e6db tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 58e5c955-f74d-4c1d-8492-457b7ab13f21] Going to try to terminate instance {{(pid=123392) delete /opt/stack/nova/nova/compute/api.py:2664}} May 03 08:56:23.887752 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-949d8659-3aae-46d1-b7b6-98e0eee7e6db tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "DELETE /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21" status: 204 len: 0 microversion: 2.1 time: 0.141258 May 03 08:56:23.888369 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 176/361] 10.222.0.11 () {58 vars in 1238 bytes} [Tue May 3 08:56:23 2022] DELETE /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 03 08:56:23.897217 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3a6b36b2-92f1-4a1e-8df0-fa826e287827 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:23.898072 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-3a6b36b2-92f1-4a1e-8df0-fa826e287827 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 58e5c955-f74d-4c1d-8492-457b7ab13f21] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:23.904431 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3a6b36b2-92f1-4a1e-8df0-fa826e287827 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:23.904981 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3a6b36b2-92f1-4a1e-8df0-fa826e287827 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:23.905879 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3a6b36b2-92f1-4a1e-8df0-fa826e287827 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:23.917656 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3a6b36b2-92f1-4a1e-8df0-fa826e287827 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:24.097361 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-3a6b36b2-92f1-4a1e-8df0-fa826e287827 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:24.108742 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-3a6b36b2-92f1-4a1e-8df0-fa826e287827 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21" status: 200 len: 1513 microversion: 2.1 time: 0.215539 May 03 08:56:24.109530 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 186/362] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:56:23 2022] GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21 => generated 1513 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:56:24.747100 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7890d0d0-8056-4289-b049-c2ef035672ec tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:24.748303 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7890d0d0-8056-4289-b049-c2ef035672ec tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:24.756858 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7890d0d0-8056-4289-b049-c2ef035672ec tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:24.757458 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7890d0d0-8056-4289-b049-c2ef035672ec tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:24.758070 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7890d0d0-8056-4289-b049-c2ef035672ec tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:24.758509 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7890d0d0-8056-4289-b049-c2ef035672ec tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:24.887322 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7890d0d0-8056-4289-b049-c2ef035672ec tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:24.895972 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7890d0d0-8056-4289-b049-c2ef035672ec tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:24.897490 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7890d0d0-8056-4289-b049-c2ef035672ec tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:24.898654 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7890d0d0-8056-4289-b049-c2ef035672ec tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1807 microversion: 2.20 time: 0.158792 May 03 08:56:24.899218 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 177/363] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:56:24 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:56:25.130804 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f30815f1-53e1-4c55-b7d6-337711c24e50 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:25.131616 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f30815f1-53e1-4c55-b7d6-337711c24e50 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 58e5c955-f74d-4c1d-8492-457b7ab13f21] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:25.142622 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f30815f1-53e1-4c55-b7d6-337711c24e50 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:25.143559 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f30815f1-53e1-4c55-b7d6-337711c24e50 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:25.144761 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f30815f1-53e1-4c55-b7d6-337711c24e50 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:25.145236 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f30815f1-53e1-4c55-b7d6-337711c24e50 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:25.278564 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f30815f1-53e1-4c55-b7d6-337711c24e50 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:25.286194 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f30815f1-53e1-4c55-b7d6-337711c24e50 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21" status: 200 len: 1513 microversion: 2.1 time: 0.162038 May 03 08:56:25.286769 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 187/364] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:56:25 2022] GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:56:25.917887 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ca14fd56-012a-40b2-a5a9-bbd2c97a34d0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:25.918457 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ca14fd56-012a-40b2-a5a9-bbd2c97a34d0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:25.926457 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ca14fd56-012a-40b2-a5a9-bbd2c97a34d0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:25.927338 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ca14fd56-012a-40b2-a5a9-bbd2c97a34d0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:25.933103 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ca14fd56-012a-40b2-a5a9-bbd2c97a34d0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:25.934866 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ca14fd56-012a-40b2-a5a9-bbd2c97a34d0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:26.076564 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ca14fd56-012a-40b2-a5a9-bbd2c97a34d0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:26.084927 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ca14fd56-012a-40b2-a5a9-bbd2c97a34d0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:26.086403 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ca14fd56-012a-40b2-a5a9-bbd2c97a34d0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:26.087560 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ca14fd56-012a-40b2-a5a9-bbd2c97a34d0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1807 microversion: 2.20 time: 0.173735 May 03 08:56:26.088362 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 178/365] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:56:25 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:56:26.303312 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9c204a5c-66eb-457a-a933-111d60699b1b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:26.303947 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9c204a5c-66eb-457a-a933-111d60699b1b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 58e5c955-f74d-4c1d-8492-457b7ab13f21] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:26.310705 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9c204a5c-66eb-457a-a933-111d60699b1b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:26.311166 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9c204a5c-66eb-457a-a933-111d60699b1b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:26.311999 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9c204a5c-66eb-457a-a933-111d60699b1b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:26.312422 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9c204a5c-66eb-457a-a933-111d60699b1b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:26.446026 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9c204a5c-66eb-457a-a933-111d60699b1b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:26.453451 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9c204a5c-66eb-457a-a933-111d60699b1b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21" status: 200 len: 1513 microversion: 2.1 time: 0.154185 May 03 08:56:26.454022 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 188/366] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:56:26 2022] GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:56:27.107093 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-432665ac-1ca8-4618-a733-7052d39b36f6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:27.108064 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-432665ac-1ca8-4618-a733-7052d39b36f6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:27.115101 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-432665ac-1ca8-4618-a733-7052d39b36f6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:27.115547 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-432665ac-1ca8-4618-a733-7052d39b36f6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:27.116348 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-432665ac-1ca8-4618-a733-7052d39b36f6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:27.116743 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-432665ac-1ca8-4618-a733-7052d39b36f6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:27.472471 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c6ab174c-2b60-45a2-b019-782f133b35e8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:27.473155 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c6ab174c-2b60-45a2-b019-782f133b35e8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 58e5c955-f74d-4c1d-8492-457b7ab13f21] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:27.491554 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c6ab174c-2b60-45a2-b019-782f133b35e8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:27.492069 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c6ab174c-2b60-45a2-b019-782f133b35e8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:27.492846 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c6ab174c-2b60-45a2-b019-782f133b35e8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:27.493250 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c6ab174c-2b60-45a2-b019-782f133b35e8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:27.515992 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-432665ac-1ca8-4618-a733-7052d39b36f6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:27.525022 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-432665ac-1ca8-4618-a733-7052d39b36f6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:27.527546 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-432665ac-1ca8-4618-a733-7052d39b36f6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:27.528909 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-432665ac-1ca8-4618-a733-7052d39b36f6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1807 microversion: 2.20 time: 0.426089 May 03 08:56:27.538798 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 179/367] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:56:27 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1807 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:56:27.641032 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c6ab174c-2b60-45a2-b019-782f133b35e8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:27.649013 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c6ab174c-2b60-45a2-b019-782f133b35e8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21" status: 200 len: 1513 microversion: 2.1 time: 0.181479 May 03 08:56:27.649967 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 189/368] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:56:27 2022] GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21 => generated 1513 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 08:56:28.550149 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e65282bd-aeea-4c07-8f76-68c49384866f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:28.550869 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e65282bd-aeea-4c07-8f76-68c49384866f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:28.558048 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e65282bd-aeea-4c07-8f76-68c49384866f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:28.558490 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e65282bd-aeea-4c07-8f76-68c49384866f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:28.559318 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e65282bd-aeea-4c07-8f76-68c49384866f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:28.559743 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e65282bd-aeea-4c07-8f76-68c49384866f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:28.666540 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e9c2a4dd-9023-456e-9d09-bd1924687b79 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:28.667235 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e9c2a4dd-9023-456e-9d09-bd1924687b79 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 58e5c955-f74d-4c1d-8492-457b7ab13f21] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:28.673929 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e9c2a4dd-9023-456e-9d09-bd1924687b79 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:28.674612 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e9c2a4dd-9023-456e-9d09-bd1924687b79 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:28.675558 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e9c2a4dd-9023-456e-9d09-bd1924687b79 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:28.676082 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e9c2a4dd-9023-456e-9d09-bd1924687b79 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:28.699466 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e65282bd-aeea-4c07-8f76-68c49384866f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:28.708847 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e65282bd-aeea-4c07-8f76-68c49384866f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:28.710431 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e65282bd-aeea-4c07-8f76-68c49384866f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:28.711719 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e65282bd-aeea-4c07-8f76-68c49384866f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1807 microversion: 2.20 time: 0.167445 May 03 08:56:28.712520 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 180/369] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:56:28 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:56:28.814583 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e9c2a4dd-9023-456e-9d09-bd1924687b79 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:28.822189 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e9c2a4dd-9023-456e-9d09-bd1924687b79 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21" status: 200 len: 1513 microversion: 2.1 time: 0.159672 May 03 08:56:28.822785 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 190/370] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:56:28 2022] GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 08:56:29.730546 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-841d4016-a633-40be-95a9-59e15c0c15df tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:29.731154 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-841d4016-a633-40be-95a9-59e15c0c15df tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:29.739111 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-841d4016-a633-40be-95a9-59e15c0c15df tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:29.739717 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-841d4016-a633-40be-95a9-59e15c0c15df tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:29.740875 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-841d4016-a633-40be-95a9-59e15c0c15df tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:29.741369 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-841d4016-a633-40be-95a9-59e15c0c15df tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:29.839629 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-59d6dc19-1abf-4ba1-96bc-cec22a53c5a6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:29.840271 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-59d6dc19-1abf-4ba1-96bc-cec22a53c5a6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 58e5c955-f74d-4c1d-8492-457b7ab13f21] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:29.846929 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-59d6dc19-1abf-4ba1-96bc-cec22a53c5a6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:29.847410 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-59d6dc19-1abf-4ba1-96bc-cec22a53c5a6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:29.848415 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-59d6dc19-1abf-4ba1-96bc-cec22a53c5a6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:29.848848 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-59d6dc19-1abf-4ba1-96bc-cec22a53c5a6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:29.895613 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-841d4016-a633-40be-95a9-59e15c0c15df tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:29.904732 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-841d4016-a633-40be-95a9-59e15c0c15df tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:29.906220 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-841d4016-a633-40be-95a9-59e15c0c15df tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:29.907645 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-841d4016-a633-40be-95a9-59e15c0c15df tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1807 microversion: 2.20 time: 0.181681 May 03 08:56:29.908455 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 181/371] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:56:29 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:56:30.021577 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-59d6dc19-1abf-4ba1-96bc-cec22a53c5a6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:30.028876 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-59d6dc19-1abf-4ba1-96bc-cec22a53c5a6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21" status: 200 len: 1513 microversion: 2.1 time: 0.193371 May 03 08:56:30.029686 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 191/372] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:56:29 2022] GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21 => generated 1513 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 08:56:30.926863 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-dbc525ba-026d-4f9a-9a01-be72b71776f3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:30.927511 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-dbc525ba-026d-4f9a-9a01-be72b71776f3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:30.934897 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dbc525ba-026d-4f9a-9a01-be72b71776f3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:30.935337 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dbc525ba-026d-4f9a-9a01-be72b71776f3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:30.936171 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dbc525ba-026d-4f9a-9a01-be72b71776f3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:30.936565 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dbc525ba-026d-4f9a-9a01-be72b71776f3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:31.047755 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a48dc2b2-85e3-4c6a-9ec4-949f2110c423 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:31.048640 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a48dc2b2-85e3-4c6a-9ec4-949f2110c423 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 58e5c955-f74d-4c1d-8492-457b7ab13f21] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:31.055192 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a48dc2b2-85e3-4c6a-9ec4-949f2110c423 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:31.055718 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a48dc2b2-85e3-4c6a-9ec4-949f2110c423 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:31.056518 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a48dc2b2-85e3-4c6a-9ec4-949f2110c423 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:31.056948 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a48dc2b2-85e3-4c6a-9ec4-949f2110c423 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:31.074941 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-dbc525ba-026d-4f9a-9a01-be72b71776f3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:31.084005 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-dbc525ba-026d-4f9a-9a01-be72b71776f3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:31.085526 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-dbc525ba-026d-4f9a-9a01-be72b71776f3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:31.086732 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-dbc525ba-026d-4f9a-9a01-be72b71776f3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1807 microversion: 2.20 time: 0.164048 May 03 08:56:31.087500 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 182/373] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:56:30 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:56:31.200786 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a48dc2b2-85e3-4c6a-9ec4-949f2110c423 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:31.209925 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a48dc2b2-85e3-4c6a-9ec4-949f2110c423 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21" status: 200 len: 1513 microversion: 2.1 time: 0.166024 May 03 08:56:31.210505 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 192/374] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:56:31 2022] GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 08:56:32.106258 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5eaff05e-0f50-4747-8453-186218ea766e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:32.106933 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5eaff05e-0f50-4747-8453-186218ea766e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:32.113784 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5eaff05e-0f50-4747-8453-186218ea766e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:32.114221 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5eaff05e-0f50-4747-8453-186218ea766e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:32.114984 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5eaff05e-0f50-4747-8453-186218ea766e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:32.115438 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5eaff05e-0f50-4747-8453-186218ea766e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:32.226984 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c858c43c-b985-4ec7-8bce-8fa4bf9b12c4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:32.227606 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c858c43c-b985-4ec7-8bce-8fa4bf9b12c4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 58e5c955-f74d-4c1d-8492-457b7ab13f21] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:32.235526 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c858c43c-b985-4ec7-8bce-8fa4bf9b12c4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:32.235526 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c858c43c-b985-4ec7-8bce-8fa4bf9b12c4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:32.235526 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c858c43c-b985-4ec7-8bce-8fa4bf9b12c4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:32.235526 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c858c43c-b985-4ec7-8bce-8fa4bf9b12c4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:32.272088 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5eaff05e-0f50-4747-8453-186218ea766e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:32.283131 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5eaff05e-0f50-4747-8453-186218ea766e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:32.287623 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5eaff05e-0f50-4747-8453-186218ea766e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:32.287623 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5eaff05e-0f50-4747-8453-186218ea766e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1807 microversion: 2.20 time: 0.184871 May 03 08:56:32.288178 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 183/375] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:56:32 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1807 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:56:32.377685 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c858c43c-b985-4ec7-8bce-8fa4bf9b12c4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:32.385961 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c858c43c-b985-4ec7-8bce-8fa4bf9b12c4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21" status: 200 len: 1513 microversion: 2.1 time: 0.163195 May 03 08:56:32.386700 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 193/376] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:56:32 2022] GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21 => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 08:56:33.305766 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-11a1b730-15e6-4484-9681-eb9cd2899e06 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:33.306536 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-11a1b730-15e6-4484-9681-eb9cd2899e06 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:33.313066 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-11a1b730-15e6-4484-9681-eb9cd2899e06 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:33.313514 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-11a1b730-15e6-4484-9681-eb9cd2899e06 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:33.314278 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-11a1b730-15e6-4484-9681-eb9cd2899e06 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:33.314709 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-11a1b730-15e6-4484-9681-eb9cd2899e06 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:33.402977 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ce01ff9e-8779-4da1-bf73-f9c1af324cef tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:33.403617 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ce01ff9e-8779-4da1-bf73-f9c1af324cef tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 58e5c955-f74d-4c1d-8492-457b7ab13f21] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:33.410844 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ce01ff9e-8779-4da1-bf73-f9c1af324cef tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:33.411296 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ce01ff9e-8779-4da1-bf73-f9c1af324cef tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:33.412234 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ce01ff9e-8779-4da1-bf73-f9c1af324cef tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:33.412661 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ce01ff9e-8779-4da1-bf73-f9c1af324cef tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:33.450466 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-11a1b730-15e6-4484-9681-eb9cd2899e06 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:33.460484 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-11a1b730-15e6-4484-9681-eb9cd2899e06 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:33.462250 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-11a1b730-15e6-4484-9681-eb9cd2899e06 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:33.463543 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-11a1b730-15e6-4484-9681-eb9cd2899e06 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1807 microversion: 2.20 time: 0.162002 May 03 08:56:33.472535 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 184/377] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:56:33 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:56:33.551157 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ce01ff9e-8779-4da1-bf73-f9c1af324cef tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:33.559150 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ce01ff9e-8779-4da1-bf73-f9c1af324cef tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21" status: 200 len: 1513 microversion: 2.1 time: 0.160286 May 03 08:56:33.559731 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 194/378] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:56:33 2022] GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:56:34.483438 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5932e39b-5124-4077-89ed-cc5e8e7bba6c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:34.484092 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5932e39b-5124-4077-89ed-cc5e8e7bba6c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:34.491086 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5932e39b-5124-4077-89ed-cc5e8e7bba6c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:34.491535 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5932e39b-5124-4077-89ed-cc5e8e7bba6c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:34.492383 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5932e39b-5124-4077-89ed-cc5e8e7bba6c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:34.492814 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5932e39b-5124-4077-89ed-cc5e8e7bba6c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:34.579051 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-8b53abab-917e-4c13-a223-7b8862ba0d42 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:34.579856 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-8b53abab-917e-4c13-a223-7b8862ba0d42 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 58e5c955-f74d-4c1d-8492-457b7ab13f21] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:34.586927 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8b53abab-917e-4c13-a223-7b8862ba0d42 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:34.587360 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8b53abab-917e-4c13-a223-7b8862ba0d42 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:34.588398 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8b53abab-917e-4c13-a223-7b8862ba0d42 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:34.588835 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8b53abab-917e-4c13-a223-7b8862ba0d42 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:34.632866 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5932e39b-5124-4077-89ed-cc5e8e7bba6c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:34.641989 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5932e39b-5124-4077-89ed-cc5e8e7bba6c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:34.643479 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5932e39b-5124-4077-89ed-cc5e8e7bba6c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:34.644705 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5932e39b-5124-4077-89ed-cc5e8e7bba6c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1807 microversion: 2.20 time: 0.165539 May 03 08:56:34.645494 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 185/379] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:56:34 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:56:34.734634 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-8b53abab-917e-4c13-a223-7b8862ba0d42 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:34.742221 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-8b53abab-917e-4c13-a223-7b8862ba0d42 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21" status: 200 len: 1513 microversion: 2.1 time: 0.168018 May 03 08:56:34.742799 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 195/380] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:56:34 2022] GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21 => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:56:35.663111 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4a68af76-18f7-42f8-b09c-1b606f87270d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:35.663798 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4a68af76-18f7-42f8-b09c-1b606f87270d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:35.670788 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4a68af76-18f7-42f8-b09c-1b606f87270d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:35.671274 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4a68af76-18f7-42f8-b09c-1b606f87270d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:35.672245 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4a68af76-18f7-42f8-b09c-1b606f87270d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:35.681837 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4a68af76-18f7-42f8-b09c-1b606f87270d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:35.761528 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-bef5168f-81a3-4353-9af7-876545c8f03e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:35.762908 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-bef5168f-81a3-4353-9af7-876545c8f03e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 58e5c955-f74d-4c1d-8492-457b7ab13f21] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:35.770538 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bef5168f-81a3-4353-9af7-876545c8f03e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:35.770942 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bef5168f-81a3-4353-9af7-876545c8f03e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:35.771786 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bef5168f-81a3-4353-9af7-876545c8f03e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:35.772640 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bef5168f-81a3-4353-9af7-876545c8f03e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:35.826196 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-4a68af76-18f7-42f8-b09c-1b606f87270d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:35.834324 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-4a68af76-18f7-42f8-b09c-1b606f87270d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:35.835864 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-4a68af76-18f7-42f8-b09c-1b606f87270d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:35.837046 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-4a68af76-18f7-42f8-b09c-1b606f87270d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1807 microversion: 2.20 time: 0.178136 May 03 08:56:35.837675 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 186/381] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:56:35 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:56:35.914926 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-bef5168f-81a3-4353-9af7-876545c8f03e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:35.922458 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-bef5168f-81a3-4353-9af7-876545c8f03e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21" status: 200 len: 1513 microversion: 2.1 time: 0.167272 May 03 08:56:35.923028 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 196/382] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:56:35 2022] GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21 => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:56:36.856444 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-cf5924ab-27bb-4c1a-a5ed-d0827af2f22e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:36.857087 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-cf5924ab-27bb-4c1a-a5ed-d0827af2f22e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:36.863842 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cf5924ab-27bb-4c1a-a5ed-d0827af2f22e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:36.864316 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cf5924ab-27bb-4c1a-a5ed-d0827af2f22e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:36.865081 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cf5924ab-27bb-4c1a-a5ed-d0827af2f22e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:36.865561 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cf5924ab-27bb-4c1a-a5ed-d0827af2f22e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:36.940060 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5706e8b3-cec3-4e1b-8bf5-21c9b0a0563f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:36.940658 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5706e8b3-cec3-4e1b-8bf5-21c9b0a0563f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 58e5c955-f74d-4c1d-8492-457b7ab13f21] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:36.947683 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5706e8b3-cec3-4e1b-8bf5-21c9b0a0563f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:36.948170 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5706e8b3-cec3-4e1b-8bf5-21c9b0a0563f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:36.949220 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5706e8b3-cec3-4e1b-8bf5-21c9b0a0563f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:36.949339 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5706e8b3-cec3-4e1b-8bf5-21c9b0a0563f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:37.082820 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-cf5924ab-27bb-4c1a-a5ed-d0827af2f22e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:37.091972 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-cf5924ab-27bb-4c1a-a5ed-d0827af2f22e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:37.093528 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-cf5924ab-27bb-4c1a-a5ed-d0827af2f22e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:37.094927 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-cf5924ab-27bb-4c1a-a5ed-d0827af2f22e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1807 microversion: 2.20 time: 0.242284 May 03 08:56:37.095543 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 187/383] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:56:36 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1807 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:56:37.113768 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5706e8b3-cec3-4e1b-8bf5-21c9b0a0563f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:37.121281 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5706e8b3-cec3-4e1b-8bf5-21c9b0a0563f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21" status: 200 len: 1513 microversion: 2.1 time: 0.185433 May 03 08:56:37.121843 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 197/384] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:56:36 2022] GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21 => generated 1513 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:56:38.115658 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-121267c7-c6b6-44a8-9f6f-9e17c73079a4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:38.116505 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-121267c7-c6b6-44a8-9f6f-9e17c73079a4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:38.122846 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-121267c7-c6b6-44a8-9f6f-9e17c73079a4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:38.123296 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-121267c7-c6b6-44a8-9f6f-9e17c73079a4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:38.124393 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-121267c7-c6b6-44a8-9f6f-9e17c73079a4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:38.124817 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-121267c7-c6b6-44a8-9f6f-9e17c73079a4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:38.140229 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f6b3f64d-7acb-49e2-9e15-51c550eb682e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:38.141037 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f6b3f64d-7acb-49e2-9e15-51c550eb682e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 58e5c955-f74d-4c1d-8492-457b7ab13f21] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:38.151723 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f6b3f64d-7acb-49e2-9e15-51c550eb682e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:38.152818 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f6b3f64d-7acb-49e2-9e15-51c550eb682e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:38.153684 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f6b3f64d-7acb-49e2-9e15-51c550eb682e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:38.154040 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f6b3f64d-7acb-49e2-9e15-51c550eb682e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:38.292784 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f6b3f64d-7acb-49e2-9e15-51c550eb682e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:38.300755 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f6b3f64d-7acb-49e2-9e15-51c550eb682e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21" status: 200 len: 1471 microversion: 2.1 time: 0.166153 May 03 08:56:38.301333 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 198/385] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:56:38 2022] GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21 => generated 1471 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:56:38.307414 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [req-e1c066ca-e36e-4a28-b772-2862b65cb1e0 req-5c89bbf7-c092-4278-94b1-e538415bf6e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58e5c955-f74d-4c1d-8492-457b7ab13f21", "name": "network-vif-deleted", "tag": "6e0bf9b7-b606-460e-8579-66e8b961c35d"}]} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:56:38.317349 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-e1c066ca-e36e-4a28-b772-2862b65cb1e0 req-5c89bbf7-c092-4278-94b1-e538415bf6e2 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:38.317913 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-e1c066ca-e36e-4a28-b772-2862b65cb1e0 req-5c89bbf7-c092-4278-94b1-e538415bf6e2 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:38.330711 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.compute.server_external_events [req-e1c066ca-e36e-4a28-b772-2862b65cb1e0 req-5c89bbf7-c092-4278-94b1-e538415bf6e2 service nova] Creating event network-vif-deleted:6e0bf9b7-b606-460e-8579-66e8b961c35d for instance 58e5c955-f74d-4c1d-8492-457b7ab13f21 on hv-cinder-84027 May 03 08:56:38.336580 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [req-e1c066ca-e36e-4a28-b772-2862b65cb1e0 req-5c89bbf7-c092-4278-94b1-e538415bf6e2 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032449 May 03 08:56:38.337241 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 199/386] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 08:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:56:38.409195 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-121267c7-c6b6-44a8-9f6f-9e17c73079a4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:38.421633 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-121267c7-c6b6-44a8-9f6f-9e17c73079a4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:38.423134 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-121267c7-c6b6-44a8-9f6f-9e17c73079a4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:38.424634 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-121267c7-c6b6-44a8-9f6f-9e17c73079a4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1807 microversion: 2.20 time: 0.313160 May 03 08:56:38.425225 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 188/387] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:56:38 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1807 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:56:39.320785 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-530ccb24-943c-4ba6-9b13-82fa55eff897 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:39.321558 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-530ccb24-943c-4ba6-9b13-82fa55eff897 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 58e5c955-f74d-4c1d-8492-457b7ab13f21] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:39.328563 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-530ccb24-943c-4ba6-9b13-82fa55eff897 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:39.329009 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-530ccb24-943c-4ba6-9b13-82fa55eff897 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:39.329742 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-530ccb24-943c-4ba6-9b13-82fa55eff897 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:39.330210 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-530ccb24-943c-4ba6-9b13-82fa55eff897 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:39.363921 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-530ccb24-943c-4ba6-9b13-82fa55eff897 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:39.364368 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-530ccb24-943c-4ba6-9b13-82fa55eff897 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:39.364806 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.objects.instance [None req-530ccb24-943c-4ba6-9b13-82fa55eff897 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lazy-loading 'fault' on Instance uuid 58e5c955-f74d-4c1d-8492-457b7ab13f21 {{(pid=123391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 03 08:56:39.409683 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-530ccb24-943c-4ba6-9b13-82fa55eff897 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:39.417796 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-530ccb24-943c-4ba6-9b13-82fa55eff897 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21" status: 200 len: 1308 microversion: 2.1 time: 0.102928 May 03 08:56:39.418577 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 200/388] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:56:39 2022] GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21 => generated 1308 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:56:39.444615 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-65709ccc-fcdc-43fa-be73-32e61398111f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:39.445225 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-65709ccc-fcdc-43fa-be73-32e61398111f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:39.454534 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-65709ccc-fcdc-43fa-be73-32e61398111f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:39.454993 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-65709ccc-fcdc-43fa-be73-32e61398111f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:39.455793 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-65709ccc-fcdc-43fa-be73-32e61398111f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:39.456247 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-65709ccc-fcdc-43fa-be73-32e61398111f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:39.605789 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-65709ccc-fcdc-43fa-be73-32e61398111f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:39.614158 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-65709ccc-fcdc-43fa-be73-32e61398111f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:39.615670 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-65709ccc-fcdc-43fa-be73-32e61398111f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:39.616953 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-65709ccc-fcdc-43fa-be73-32e61398111f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1807 microversion: 2.20 time: 0.176405 May 03 08:56:39.617535 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 189/389] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:56:39 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:56:40.439212 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a297fafe-63aa-4dbd-884e-ffef41c73653 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:40.440398 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a297fafe-63aa-4dbd-884e-ffef41c73653 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 58e5c955-f74d-4c1d-8492-457b7ab13f21] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:40.448358 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a297fafe-63aa-4dbd-884e-ffef41c73653 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:40.448808 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a297fafe-63aa-4dbd-884e-ffef41c73653 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:40.449570 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a297fafe-63aa-4dbd-884e-ffef41c73653 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:40.450004 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a297fafe-63aa-4dbd-884e-ffef41c73653 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:40.463691 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.wsgi [None req-a297fafe-63aa-4dbd-884e-ffef41c73653 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] HTTP exception thrown: Instance 58e5c955-f74d-4c1d-8492-457b7ab13f21 could not be found. May 03 08:56:40.464384 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a297fafe-63aa-4dbd-884e-ffef41c73653 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Returning 404 to user: Instance 58e5c955-f74d-4c1d-8492-457b7ab13f21 could not be found. {{(pid=123391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 08:56:40.465198 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a297fafe-63aa-4dbd-884e-ffef41c73653 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21" status: 404 len: 111 microversion: 2.1 time: 0.032524 May 03 08:56:40.465755 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 201/390] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:56:40 2022] GET /compute/v2.1/servers/58e5c955-f74d-4c1d-8492-457b7ab13f21 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 08:56:40.635861 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e3b920ea-0c5a-4505-bc0f-168e972f0146 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:40.636543 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e3b920ea-0c5a-4505-bc0f-168e972f0146 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:40.643153 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e3b920ea-0c5a-4505-bc0f-168e972f0146 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:40.643659 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e3b920ea-0c5a-4505-bc0f-168e972f0146 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:40.644664 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e3b920ea-0c5a-4505-bc0f-168e972f0146 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:40.645237 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e3b920ea-0c5a-4505-bc0f-168e972f0146 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:40.783031 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e3b920ea-0c5a-4505-bc0f-168e972f0146 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:40.792173 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e3b920ea-0c5a-4505-bc0f-168e972f0146 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:40.793689 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e3b920ea-0c5a-4505-bc0f-168e972f0146 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:40.794923 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e3b920ea-0c5a-4505-bc0f-168e972f0146 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1807 microversion: 2.20 time: 0.163930 May 03 08:56:40.795467 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 190/391] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:56:40 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:56:41.818768 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-933fc3be-e074-41d2-8dd3-5321a04059d2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:41.819361 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-933fc3be-e074-41d2-8dd3-5321a04059d2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:41.826672 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-933fc3be-e074-41d2-8dd3-5321a04059d2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:41.827142 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-933fc3be-e074-41d2-8dd3-5321a04059d2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:41.827969 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-933fc3be-e074-41d2-8dd3-5321a04059d2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:41.828422 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-933fc3be-e074-41d2-8dd3-5321a04059d2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:41.965728 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-933fc3be-e074-41d2-8dd3-5321a04059d2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:41.975272 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-933fc3be-e074-41d2-8dd3-5321a04059d2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:41.976791 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-933fc3be-e074-41d2-8dd3-5321a04059d2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:41.977942 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-933fc3be-e074-41d2-8dd3-5321a04059d2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1807 microversion: 2.20 time: 0.165903 May 03 08:56:41.978491 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 202/392] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:56:41 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:56:42.999798 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b2cff884-8f71-40bb-b4b6-804aa173efd7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:43.000840 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b2cff884-8f71-40bb-b4b6-804aa173efd7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:43.011451 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b2cff884-8f71-40bb-b4b6-804aa173efd7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:43.012261 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b2cff884-8f71-40bb-b4b6-804aa173efd7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:43.013525 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b2cff884-8f71-40bb-b4b6-804aa173efd7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:43.014221 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b2cff884-8f71-40bb-b4b6-804aa173efd7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:43.157771 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b2cff884-8f71-40bb-b4b6-804aa173efd7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:43.169088 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b2cff884-8f71-40bb-b4b6-804aa173efd7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:43.171463 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b2cff884-8f71-40bb-b4b6-804aa173efd7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:43.173425 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b2cff884-8f71-40bb-b4b6-804aa173efd7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1807 microversion: 2.20 time: 0.179899 May 03 08:56:43.174188 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 191/393] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:56:42 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:56:44.199121 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-048eabe5-3f9b-4b67-998f-58a09c8a2da6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:44.199731 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-048eabe5-3f9b-4b67-998f-58a09c8a2da6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:44.206821 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-048eabe5-3f9b-4b67-998f-58a09c8a2da6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:44.207270 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-048eabe5-3f9b-4b67-998f-58a09c8a2da6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:44.208084 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-048eabe5-3f9b-4b67-998f-58a09c8a2da6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:44.208521 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-048eabe5-3f9b-4b67-998f-58a09c8a2da6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:44.339639 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-048eabe5-3f9b-4b67-998f-58a09c8a2da6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:44.352649 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-048eabe5-3f9b-4b67-998f-58a09c8a2da6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:44.355025 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-048eabe5-3f9b-4b67-998f-58a09c8a2da6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:44.356884 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-048eabe5-3f9b-4b67-998f-58a09c8a2da6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1807 microversion: 2.20 time: 0.162914 May 03 08:56:44.357718 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 203/394] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:56:44 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:56:45.379679 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d46fff6e-0a60-4edf-8de6-372a2d39f6b0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:45.380748 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d46fff6e-0a60-4edf-8de6-372a2d39f6b0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:45.388627 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d46fff6e-0a60-4edf-8de6-372a2d39f6b0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:45.389123 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d46fff6e-0a60-4edf-8de6-372a2d39f6b0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:45.389937 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d46fff6e-0a60-4edf-8de6-372a2d39f6b0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:45.390400 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d46fff6e-0a60-4edf-8de6-372a2d39f6b0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:45.530341 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d46fff6e-0a60-4edf-8de6-372a2d39f6b0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:45.540259 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d46fff6e-0a60-4edf-8de6-372a2d39f6b0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:45.541760 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d46fff6e-0a60-4edf-8de6-372a2d39f6b0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:45.542931 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d46fff6e-0a60-4edf-8de6-372a2d39f6b0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1807 microversion: 2.20 time: 0.169913 May 03 08:56:45.543495 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 192/395] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:56:45 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:56:46.565198 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-cdee1832-0ded-40db-ade0-3236fe15408b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:46.566208 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-cdee1832-0ded-40db-ade0-3236fe15408b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:46.576848 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cdee1832-0ded-40db-ade0-3236fe15408b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:46.577586 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cdee1832-0ded-40db-ade0-3236fe15408b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:46.578833 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cdee1832-0ded-40db-ade0-3236fe15408b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:46.579590 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cdee1832-0ded-40db-ade0-3236fe15408b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:46.717055 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-cdee1832-0ded-40db-ade0-3236fe15408b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:46.726339 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-cdee1832-0ded-40db-ade0-3236fe15408b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:46.728542 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-cdee1832-0ded-40db-ade0-3236fe15408b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:46.730078 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-cdee1832-0ded-40db-ade0-3236fe15408b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1807 microversion: 2.20 time: 0.171287 May 03 08:56:46.731186 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 204/396] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:56:46 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:56:47.755907 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b302200b-91bd-4d5a-9cc4-6872be83f891 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:47.756892 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b302200b-91bd-4d5a-9cc4-6872be83f891 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:47.764344 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b302200b-91bd-4d5a-9cc4-6872be83f891 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:47.764819 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b302200b-91bd-4d5a-9cc4-6872be83f891 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:47.765625 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b302200b-91bd-4d5a-9cc4-6872be83f891 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:47.766080 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b302200b-91bd-4d5a-9cc4-6872be83f891 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:47.894809 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b302200b-91bd-4d5a-9cc4-6872be83f891 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:47.904602 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b302200b-91bd-4d5a-9cc4-6872be83f891 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:47.906101 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b302200b-91bd-4d5a-9cc4-6872be83f891 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:47.907268 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b302200b-91bd-4d5a-9cc4-6872be83f891 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1807 microversion: 2.20 time: 0.157933 May 03 08:56:47.907855 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 193/397] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:56:47 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:56:48.308764 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b8b071ed-6723-48ce-af75-7060f93c7115 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-685123657", "imageRef": "bd46d67a-108d-4c0c-9f0b-cb6d41c82a32", "flavorRef": "452", "networks": [{"uuid": "978e1d5b-e67a-43aa-888e-674641045e53"}]}} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:56:48.359050 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.network.neutron [None req-b8b071ed-6723-48ce-af75-7060f93c7115 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] validate_networks() for [('978e1d5b-e67a-43aa-888e-674641045e53', None, None, None, None, None)] {{(pid=123391) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 03 08:56:48.709226 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-b8b071ed-6723-48ce-af75-7060f93c7115 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Flavor limits 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 03 08:56:48.709886 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-b8b071ed-6723-48ce-af75-7060f93c7115 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Image limits 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 03 08:56:48.710664 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-b8b071ed-6723-48ce-af75-7060f93c7115 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Flavor pref 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 03 08:56:48.711251 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-b8b071ed-6723-48ce-af75-7060f93c7115 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Image pref 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 03 08:56:48.711912 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-b8b071ed-6723-48ce-af75-7060f93c7115 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 03 08:56:48.720838 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b8b071ed-6723-48ce-af75-7060f93c7115 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:48.721223 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b8b071ed-6723-48ce-af75-7060f93c7115 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:48.722028 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b8b071ed-6723-48ce-af75-7060f93c7115 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:48.722462 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b8b071ed-6723-48ce-af75-7060f93c7115 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:48.744495 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.quota [None req-b8b071ed-6723-48ce-af75-7060f93c7115 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Getting quotas for project 0cffdf9d4af6405dbc203be720191014. Resources: {'cores', 'ram', 'instances'} {{(pid=123391) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 03 08:56:48.748909 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.quota [None req-b8b071ed-6723-48ce-af75-7060f93c7115 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Getting quotas for user f8cb9871fdf14a16a12c3d73a951fb61 and project 0cffdf9d4af6405dbc203be720191014. Resources: {'cores', 'ram', 'instances'} {{(pid=123391) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 03 08:56:48.761155 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b8b071ed-6723-48ce-af75-7060f93c7115 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Going to run 1 instances... {{(pid=123391) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 03 08:56:48.763428 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b8b071ed-6723-48ce-af75-7060f93c7115 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd46d67a-108d-4c0c-9f0b-cb6d41c82a32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123391) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 03 08:56:48.808965 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b8b071ed-6723-48ce-af75-7060f93c7115 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.504140 May 03 08:56:48.809605 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 205/398] 10.222.0.11 () {60 vars in 1146 bytes} [Tue May 3 08:56:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 03 08:56:48.819707 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-3348baf6-ca74-4d3f-9b72-224d914ba24a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:48.820355 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-3348baf6-ca74-4d3f-9b72-224d914ba24a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:48.873825 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-3348baf6-ca74-4d3f-9b72-224d914ba24a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:48.880248 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-3348baf6-ca74-4d3f-9b72-224d914ba24a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1218 microversion: 2.1 time: 0.064424 May 03 08:56:48.880840 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 194/399] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:56:48 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:56:48.925565 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-86bf47ef-5df9-4378-a920-51b64ab1fb1e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:48.926173 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-86bf47ef-5df9-4378-a920-51b64ab1fb1e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:48.934700 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-86bf47ef-5df9-4378-a920-51b64ab1fb1e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:48.935142 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-86bf47ef-5df9-4378-a920-51b64ab1fb1e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:48.935908 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-86bf47ef-5df9-4378-a920-51b64ab1fb1e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:48.936335 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-86bf47ef-5df9-4378-a920-51b64ab1fb1e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:49.073655 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-86bf47ef-5df9-4378-a920-51b64ab1fb1e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:49.082166 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-86bf47ef-5df9-4378-a920-51b64ab1fb1e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:49.083664 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-86bf47ef-5df9-4378-a920-51b64ab1fb1e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:49.084855 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-86bf47ef-5df9-4378-a920-51b64ab1fb1e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1807 microversion: 2.20 time: 0.163333 May 03 08:56:49.085627 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 206/400] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:56:48 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:56:49.896926 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-fdc6cf76-217b-4c53-ad70-a68466cbf449 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:49.897552 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-fdc6cf76-217b-4c53-ad70-a68466cbf449 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:49.904384 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fdc6cf76-217b-4c53-ad70-a68466cbf449 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:49.904828 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fdc6cf76-217b-4c53-ad70-a68466cbf449 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:49.905624 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fdc6cf76-217b-4c53-ad70-a68466cbf449 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:49.906051 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fdc6cf76-217b-4c53-ad70-a68466cbf449 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:49.989576 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-fdc6cf76-217b-4c53-ad70-a68466cbf449 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:49.997238 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-fdc6cf76-217b-4c53-ad70-a68466cbf449 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1276 microversion: 2.1 time: 0.104379 May 03 08:56:49.997777 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 195/401] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:56:49 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1276 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:56:50.103116 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-60eeb33b-0263-4c7e-8a03-eb7ff50a652f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:50.103708 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-60eeb33b-0263-4c7e-8a03-eb7ff50a652f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:50.110385 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-60eeb33b-0263-4c7e-8a03-eb7ff50a652f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:50.110835 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-60eeb33b-0263-4c7e-8a03-eb7ff50a652f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:50.111608 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-60eeb33b-0263-4c7e-8a03-eb7ff50a652f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:50.112076 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-60eeb33b-0263-4c7e-8a03-eb7ff50a652f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:50.291668 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-a399cc60-ffc3-47b5-83b8-7f949e716179 req-dbbedc08-621b-427e-9b10-3fcd227a1908 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b68d79a3-e9c5-46b6-b8c0-a9d6017f388f", "name": "network-vif-plugged", "status": "completed", "tag": "c0a78137-d132-441d-8bd5-1d74354f3e67"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:56:50.297796 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-60eeb33b-0263-4c7e-8a03-eb7ff50a652f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:50.301120 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-a399cc60-ffc3-47b5-83b8-7f949e716179 req-dbbedc08-621b-427e-9b10-3fcd227a1908 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:50.301897 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-a399cc60-ffc3-47b5-83b8-7f949e716179 req-dbbedc08-621b-427e-9b10-3fcd227a1908 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:50.309463 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-60eeb33b-0263-4c7e-8a03-eb7ff50a652f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:50.311258 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-60eeb33b-0263-4c7e-8a03-eb7ff50a652f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:50.312510 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-60eeb33b-0263-4c7e-8a03-eb7ff50a652f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1807 microversion: 2.20 time: 0.213782 May 03 08:56:50.322878 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 207/402] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:56:50 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1807 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:56:50.325594 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-a399cc60-ffc3-47b5-83b8-7f949e716179 req-dbbedc08-621b-427e-9b10-3fcd227a1908 service nova] Creating event network-vif-plugged:c0a78137-d132-441d-8bd5-1d74354f3e67 for instance b68d79a3-e9c5-46b6-b8c0-a9d6017f388f on hv-cinder-84027 May 03 08:56:50.330707 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-a399cc60-ffc3-47b5-83b8-7f949e716179 req-dbbedc08-621b-427e-9b10-3fcd227a1908 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042952 May 03 08:56:50.331684 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 196/403] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 08:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 08:56:51.014876 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-40334343-4027-4bd0-a751-eb3d6e93906a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:51.015400 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-40334343-4027-4bd0-a751-eb3d6e93906a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:51.021908 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-40334343-4027-4bd0-a751-eb3d6e93906a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:51.022353 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-40334343-4027-4bd0-a751-eb3d6e93906a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:51.023147 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-40334343-4027-4bd0-a751-eb3d6e93906a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:51.023571 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-40334343-4027-4bd0-a751-eb3d6e93906a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:51.213531 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-40334343-4027-4bd0-a751-eb3d6e93906a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:51.221098 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-40334343-4027-4bd0-a751-eb3d6e93906a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1318 microversion: 2.1 time: 0.210293 May 03 08:56:51.221695 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 208/404] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:56:51 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:56:51.331719 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-213afaf1-73a2-47aa-bb2a-bcdf99007539 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:51.332452 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-213afaf1-73a2-47aa-bb2a-bcdf99007539 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:51.338685 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-213afaf1-73a2-47aa-bb2a-bcdf99007539 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:51.339144 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-213afaf1-73a2-47aa-bb2a-bcdf99007539 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:51.339958 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-213afaf1-73a2-47aa-bb2a-bcdf99007539 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:51.340393 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-213afaf1-73a2-47aa-bb2a-bcdf99007539 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:51.527238 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [req-ee545243-b1c5-4ee2-9e98-0512849e5251 req-3d4c3a53-d46f-4692-bce1-f69797dc7461 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5", "tag": "a8f323e6-cec6-48ce-90cc-5cf13c67866e"}]} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:56:51.535845 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-ee545243-b1c5-4ee2-9e98-0512849e5251 req-3d4c3a53-d46f-4692-bce1-f69797dc7461 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:51.536296 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-ee545243-b1c5-4ee2-9e98-0512849e5251 req-3d4c3a53-d46f-4692-bce1-f69797dc7461 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:51.548170 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.compute.server_external_events [req-ee545243-b1c5-4ee2-9e98-0512849e5251 req-3d4c3a53-d46f-4692-bce1-f69797dc7461 service nova] Creating event network-changed:a8f323e6-cec6-48ce-90cc-5cf13c67866e for instance 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 on hv-cinder-84027 May 03 08:56:51.552959 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-213afaf1-73a2-47aa-bb2a-bcdf99007539 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:51.553239 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [req-ee545243-b1c5-4ee2-9e98-0512849e5251 req-3d4c3a53-d46f-4692-bce1-f69797dc7461 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029631 May 03 08:56:51.553836 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 209/405] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 08:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:56:51.566742 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-213afaf1-73a2-47aa-bb2a-bcdf99007539 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:51.568334 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-213afaf1-73a2-47aa-bb2a-bcdf99007539 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:51.569472 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-213afaf1-73a2-47aa-bb2a-bcdf99007539 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1807 microversion: 2.20 time: 0.242687 May 03 08:56:51.570024 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 197/406] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:56:51 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1807 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:56:52.240040 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-29036abf-7b79-40cd-9054-9b48b92ff759 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:52.240620 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-29036abf-7b79-40cd-9054-9b48b92ff759 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:52.247579 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-29036abf-7b79-40cd-9054-9b48b92ff759 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:52.248034 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-29036abf-7b79-40cd-9054-9b48b92ff759 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:52.248865 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-29036abf-7b79-40cd-9054-9b48b92ff759 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:52.249300 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-29036abf-7b79-40cd-9054-9b48b92ff759 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:52.522492 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-29036abf-7b79-40cd-9054-9b48b92ff759 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:52.530384 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-29036abf-7b79-40cd-9054-9b48b92ff759 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1318 microversion: 2.1 time: 0.295455 May 03 08:56:52.530954 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 210/407] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:56:52 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1318 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:56:52.589032 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7658dcd6-2844-4b63-958c-0d8e93766704 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:52.590138 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7658dcd6-2844-4b63-958c-0d8e93766704 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:52.600829 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7658dcd6-2844-4b63-958c-0d8e93766704 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:52.601514 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7658dcd6-2844-4b63-958c-0d8e93766704 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:52.602731 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7658dcd6-2844-4b63-958c-0d8e93766704 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:52.603390 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7658dcd6-2844-4b63-958c-0d8e93766704 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:52.742804 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7658dcd6-2844-4b63-958c-0d8e93766704 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:52.751211 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7658dcd6-2844-4b63-958c-0d8e93766704 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:52.752733 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7658dcd6-2844-4b63-958c-0d8e93766704 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:52.753901 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7658dcd6-2844-4b63-958c-0d8e93766704 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1807 microversion: 2.20 time: 0.169844 May 03 08:56:52.754428 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 198/408] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:56:52 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:56:53.551698 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-177fcc24-689e-428b-bd56-6b51f1fa2124 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:53.552936 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-177fcc24-689e-428b-bd56-6b51f1fa2124 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:53.563598 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-177fcc24-689e-428b-bd56-6b51f1fa2124 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:53.564436 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-177fcc24-689e-428b-bd56-6b51f1fa2124 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:53.565691 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-177fcc24-689e-428b-bd56-6b51f1fa2124 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:53.566400 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-177fcc24-689e-428b-bd56-6b51f1fa2124 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:53.697210 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-177fcc24-689e-428b-bd56-6b51f1fa2124 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:53.704906 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-177fcc24-689e-428b-bd56-6b51f1fa2124 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1318 microversion: 2.1 time: 0.159863 May 03 08:56:53.705471 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 211/409] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:56:53 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:56:53.776505 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f410773c-e316-4d1e-9eb9-0bbf35f0b30e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:53.777569 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f410773c-e316-4d1e-9eb9-0bbf35f0b30e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:53.788090 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f410773c-e316-4d1e-9eb9-0bbf35f0b30e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:53.788834 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f410773c-e316-4d1e-9eb9-0bbf35f0b30e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:53.789977 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f410773c-e316-4d1e-9eb9-0bbf35f0b30e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:53.790403 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f410773c-e316-4d1e-9eb9-0bbf35f0b30e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:53.922927 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f410773c-e316-4d1e-9eb9-0bbf35f0b30e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:53.932144 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f410773c-e316-4d1e-9eb9-0bbf35f0b30e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:53.933738 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f410773c-e316-4d1e-9eb9-0bbf35f0b30e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:53.934983 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f410773c-e316-4d1e-9eb9-0bbf35f0b30e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1807 microversion: 2.20 time: 0.165202 May 03 08:56:53.935565 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 199/410] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:56:53 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:56:54.728615 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-6234ec06-2cfb-4db4-8ecf-88c011df4bea tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:54.729646 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-6234ec06-2cfb-4db4-8ecf-88c011df4bea tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:54.740512 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6234ec06-2cfb-4db4-8ecf-88c011df4bea tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:54.741248 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6234ec06-2cfb-4db4-8ecf-88c011df4bea tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:54.742603 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6234ec06-2cfb-4db4-8ecf-88c011df4bea tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:54.743321 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6234ec06-2cfb-4db4-8ecf-88c011df4bea tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:54.883234 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-6234ec06-2cfb-4db4-8ecf-88c011df4bea tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:54.891166 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-6234ec06-2cfb-4db4-8ecf-88c011df4bea tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1318 microversion: 2.1 time: 0.169575 May 03 08:56:54.891744 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 212/411] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:56:54 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:56:54.956830 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9fea0756-23a2-4063-816f-530bc13c7441 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:54.957782 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9fea0756-23a2-4063-816f-530bc13c7441 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:54.968449 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9fea0756-23a2-4063-816f-530bc13c7441 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:54.969186 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9fea0756-23a2-4063-816f-530bc13c7441 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:54.970428 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9fea0756-23a2-4063-816f-530bc13c7441 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:54.971159 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9fea0756-23a2-4063-816f-530bc13c7441 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:55.116025 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9fea0756-23a2-4063-816f-530bc13c7441 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:55.125339 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9fea0756-23a2-4063-816f-530bc13c7441 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:55.126847 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9fea0756-23a2-4063-816f-530bc13c7441 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:55.128092 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9fea0756-23a2-4063-816f-530bc13c7441 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1794 microversion: 2.20 time: 0.177684 May 03 08:56:55.128655 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 200/412] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 08:56:54 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1794 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 08:56:55.911541 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-356bd3ad-adf4-4dd3-96d9-f8abb4f62b1b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:55.912581 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-356bd3ad-adf4-4dd3-96d9-f8abb4f62b1b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:55.920844 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-356bd3ad-adf4-4dd3-96d9-f8abb4f62b1b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:55.921315 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-356bd3ad-adf4-4dd3-96d9-f8abb4f62b1b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:55.922075 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-356bd3ad-adf4-4dd3-96d9-f8abb4f62b1b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:55.922508 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-356bd3ad-adf4-4dd3-96d9-f8abb4f62b1b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:56.055989 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-356bd3ad-adf4-4dd3-96d9-f8abb4f62b1b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:56.066126 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-356bd3ad-adf4-4dd3-96d9-f8abb4f62b1b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1318 microversion: 2.1 time: 0.160821 May 03 08:56:56.066921 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 213/413] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:56:55 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:56:57.093029 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-37cbf11b-69f9-4b02-8406-40d5f32bf5fb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:57.094101 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-37cbf11b-69f9-4b02-8406-40d5f32bf5fb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:57.105341 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-37cbf11b-69f9-4b02-8406-40d5f32bf5fb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:57.106083 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-37cbf11b-69f9-4b02-8406-40d5f32bf5fb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:57.107347 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-37cbf11b-69f9-4b02-8406-40d5f32bf5fb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:57.108138 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-37cbf11b-69f9-4b02-8406-40d5f32bf5fb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:57.248623 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-37cbf11b-69f9-4b02-8406-40d5f32bf5fb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:57.260462 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-37cbf11b-69f9-4b02-8406-40d5f32bf5fb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1318 microversion: 2.1 time: 0.173851 May 03 08:56:57.261598 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 201/414] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:56:57 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:56:58.285236 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-03af1cf2-a537-4e72-935f-a21b3c9be22c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:58.285834 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-03af1cf2-a537-4e72-935f-a21b3c9be22c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:58.295836 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-03af1cf2-a537-4e72-935f-a21b3c9be22c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:58.296515 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-03af1cf2-a537-4e72-935f-a21b3c9be22c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:58.297699 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-03af1cf2-a537-4e72-935f-a21b3c9be22c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:58.298161 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-03af1cf2-a537-4e72-935f-a21b3c9be22c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:58.377337 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-e28814d3-0aeb-443e-b14e-612a71849f55 req-8faec0e5-dcdd-4bd6-a38f-b032f80b8347 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5", "name": "network-vif-plugged", "status": "completed", "tag": "a8f323e6-cec6-48ce-90cc-5cf13c67866e"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:56:58.386269 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-e28814d3-0aeb-443e-b14e-612a71849f55 req-8faec0e5-dcdd-4bd6-a38f-b032f80b8347 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:58.386917 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-e28814d3-0aeb-443e-b14e-612a71849f55 req-8faec0e5-dcdd-4bd6-a38f-b032f80b8347 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:58.398882 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-e28814d3-0aeb-443e-b14e-612a71849f55 req-8faec0e5-dcdd-4bd6-a38f-b032f80b8347 service nova] Creating event network-vif-plugged:a8f323e6-cec6-48ce-90cc-5cf13c67866e for instance 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 on hv-cinder-84027 May 03 08:56:58.404218 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-e28814d3-0aeb-443e-b14e-612a71849f55 req-8faec0e5-dcdd-4bd6-a38f-b032f80b8347 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030492 May 03 08:56:58.405283 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 202/415] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 08:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 08:56:58.434508 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-03af1cf2-a537-4e72-935f-a21b3c9be22c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:58.442493 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-03af1cf2-a537-4e72-935f-a21b3c9be22c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1318 microversion: 2.1 time: 0.161997 May 03 08:56:58.442933 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 214/416] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:56:58 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:56:59.459614 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9edd0058-2008-4332-a999-033e7afee883 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:56:59.460374 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9edd0058-2008-4332-a999-033e7afee883 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:56:59.467067 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9edd0058-2008-4332-a999-033e7afee883 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:59.467512 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9edd0058-2008-4332-a999-033e7afee883 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:59.468326 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9edd0058-2008-4332-a999-033e7afee883 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:56:59.468757 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9edd0058-2008-4332-a999-033e7afee883 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:56:59.594201 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9edd0058-2008-4332-a999-033e7afee883 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:56:59.602192 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9edd0058-2008-4332-a999-033e7afee883 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1318 microversion: 2.1 time: 0.147283 May 03 08:56:59.602796 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 203/417] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:56:59 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:57:00.621748 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-1a654ff6-6b6d-479c-9b7d-f445eed0adcc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:57:00.622331 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-1a654ff6-6b6d-479c-9b7d-f445eed0adcc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:57:00.629241 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1a654ff6-6b6d-479c-9b7d-f445eed0adcc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:00.629737 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1a654ff6-6b6d-479c-9b7d-f445eed0adcc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:00.630537 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1a654ff6-6b6d-479c-9b7d-f445eed0adcc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:00.630985 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1a654ff6-6b6d-479c-9b7d-f445eed0adcc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:00.763931 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-1a654ff6-6b6d-479c-9b7d-f445eed0adcc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:57:00.771283 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-1a654ff6-6b6d-479c-9b7d-f445eed0adcc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1507 microversion: 2.1 time: 0.155063 May 03 08:57:00.771872 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 215/418] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:57:00 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:57:00.787797 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c9e02167-6427-481c-bc64-066dd1a020b6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e63b7581-76a0-494d-a723-2c1f41193e62", "device": "/dev/sdb"}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:57:00.789357 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c9e02167-6427-481c-bc64-066dd1a020b6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:57:00.795941 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c9e02167-6427-481c-bc64-066dd1a020b6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:00.796381 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c9e02167-6427-481c-bc64-066dd1a020b6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:00.797114 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c9e02167-6427-481c-bc64-066dd1a020b6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:00.797669 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c9e02167-6427-481c-bc64-066dd1a020b6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:01.046331 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c9e02167-6427-481c-bc64-066dd1a020b6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "POST /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262353 May 03 08:57:01.047152 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 204/419] 10.222.0.11 () {60 vars in 1322 bytes} [Tue May 3 08:57:00 2022] POST /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:57:02.040990 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-410a4d06-df0d-4040-8e66-478a0d4dd609 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0e90a13-d5bd-4175-8cb5-6962b4700c63"}} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:57:02.042817 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-410a4d06-df0d-4040-8e66-478a0d4dd609 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:57:02.053556 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-410a4d06-df0d-4040-8e66-478a0d4dd609 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:02.054291 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-410a4d06-df0d-4040-8e66-478a0d4dd609 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:02.055541 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-410a4d06-df0d-4040-8e66-478a0d4dd609 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:02.056302 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-410a4d06-df0d-4040-8e66-478a0d4dd609 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:02.306707 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-410a4d06-df0d-4040-8e66-478a0d4dd609 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "POST /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272312 May 03 08:57:02.307235 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 216/420] 10.222.0.11 () {60 vars in 1322 bytes} [Tue May 3 08:57:02 2022] POST /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:57:05.202568 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6905bc17-ebd7-4807-affa-0160d9ae7495 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:57:05.203405 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6905bc17-ebd7-4807-affa-0160d9ae7495 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:57:05.214609 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6905bc17-ebd7-4807-affa-0160d9ae7495 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:05.215052 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6905bc17-ebd7-4807-affa-0160d9ae7495 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:05.215859 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6905bc17-ebd7-4807-affa-0160d9ae7495 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:05.216291 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6905bc17-ebd7-4807-affa-0160d9ae7495 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:05.296043 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.objects.instance [None req-6905bc17-ebd7-4807-affa-0160d9ae7495 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lazy-loading 'services' on Instance uuid 309e7477-cc5c-4422-ac1e-46d32bc3991b {{(pid=123392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 03 08:57:05.371722 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6905bc17-ebd7-4807-affa-0160d9ae7495 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "DELETE /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments/c9eece5b-c21b-49bd-8f09-ec8e0373f1a0" status: 202 len: 0 microversion: 2.1 time: 0.176571 May 03 08:57:05.372733 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 205/421] 10.222.0.11 () {58 vars in 1415 bytes} [Tue May 3 08:57:05 2022] DELETE /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments/c9eece5b-c21b-49bd-8f09-ec8e0373f1a0 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 08:57:34.119193 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-60812d19-b5a6-417d-b631-972dcab7f475 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:57:34.120177 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-60812d19-b5a6-417d-b631-972dcab7f475 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:57:34.130876 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-60812d19-b5a6-417d-b631-972dcab7f475 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:34.131632 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-60812d19-b5a6-417d-b631-972dcab7f475 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:34.132757 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-60812d19-b5a6-417d-b631-972dcab7f475 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:34.133196 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-60812d19-b5a6-417d-b631-972dcab7f475 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:34.164242 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-60812d19-b5a6-417d-b631-972dcab7f475 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments/5a037717-e7a0-4aa0-a671-6c1977538d9d" status: 200 len: 194 microversion: 2.20 time: 0.053665 May 03 08:57:34.164876 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 217/422] 10.222.0.11 () {60 vars in 1453 bytes} [Tue May 3 08:57:34 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments/5a037717-e7a0-4aa0-a671-6c1977538d9d => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:57:34.230274 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-aa1a4fe5-1b27-40f6-9b50-12d04e449e19 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:57:34.230833 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-aa1a4fe5-1b27-40f6-9b50-12d04e449e19 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:57:34.237310 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aa1a4fe5-1b27-40f6-9b50-12d04e449e19 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:34.237757 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aa1a4fe5-1b27-40f6-9b50-12d04e449e19 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:34.238526 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aa1a4fe5-1b27-40f6-9b50-12d04e449e19 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:34.238958 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aa1a4fe5-1b27-40f6-9b50-12d04e449e19 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:34.317155 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.objects.instance [None req-aa1a4fe5-1b27-40f6-9b50-12d04e449e19 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lazy-loading 'services' on Instance uuid b68d79a3-e9c5-46b6-b8c0-a9d6017f388f {{(pid=123392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 03 08:57:34.403342 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-aa1a4fe5-1b27-40f6-9b50-12d04e449e19 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "DELETE /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments/5a037717-e7a0-4aa0-a671-6c1977538d9d" status: 202 len: 0 microversion: 2.20 time: 0.177954 May 03 08:57:34.404005 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 206/423] 10.222.0.11 () {60 vars in 1456 bytes} [Tue May 3 08:57:34 2022] DELETE /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments/5a037717-e7a0-4aa0-a671-6c1977538d9d => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 03 08:57:34.412636 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-fb06f501-145a-417a-8c1b-2274f7cd44c3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:57:34.413663 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-fb06f501-145a-417a-8c1b-2274f7cd44c3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:57:34.420206 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fb06f501-145a-417a-8c1b-2274f7cd44c3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:34.420661 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fb06f501-145a-417a-8c1b-2274f7cd44c3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:34.421455 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fb06f501-145a-417a-8c1b-2274f7cd44c3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:34.421895 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fb06f501-145a-417a-8c1b-2274f7cd44c3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:34.451205 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-fb06f501-145a-417a-8c1b-2274f7cd44c3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042579 May 03 08:57:34.451739 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 218/424] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:57:34 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:57:35.469279 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4ee17d8e-c2c3-43c5-a23a-ca5f1a71ce48 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:57:35.471024 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4ee17d8e-c2c3-43c5-a23a-ca5f1a71ce48 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:57:35.479862 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4ee17d8e-c2c3-43c5-a23a-ca5f1a71ce48 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:35.480309 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4ee17d8e-c2c3-43c5-a23a-ca5f1a71ce48 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:35.481075 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4ee17d8e-c2c3-43c5-a23a-ca5f1a71ce48 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:35.481511 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4ee17d8e-c2c3-43c5-a23a-ca5f1a71ce48 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:35.510749 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-4ee17d8e-c2c3-43c5-a23a-ca5f1a71ce48 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049572 May 03 08:57:35.511301 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 207/425] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:57:35 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:57:36.528263 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c62e4731-f308-4cf7-ac38-21b6633ff5c0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:57:36.529513 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c62e4731-f308-4cf7-ac38-21b6633ff5c0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:57:36.539353 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c62e4731-f308-4cf7-ac38-21b6633ff5c0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:36.539799 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c62e4731-f308-4cf7-ac38-21b6633ff5c0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:36.540584 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c62e4731-f308-4cf7-ac38-21b6633ff5c0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:36.541014 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c62e4731-f308-4cf7-ac38-21b6633ff5c0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:36.572378 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c62e4731-f308-4cf7-ac38-21b6633ff5c0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050798 May 03 08:57:36.572926 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 219/426] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:57:36 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:57:37.585594 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-1aeac7d0-0ce7-4653-937c-d93452820c8a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:57:37.586743 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-1aeac7d0-0ce7-4653-937c-d93452820c8a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:57:37.594679 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1aeac7d0-0ce7-4653-937c-d93452820c8a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:37.595208 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1aeac7d0-0ce7-4653-937c-d93452820c8a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:37.596146 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1aeac7d0-0ce7-4653-937c-d93452820c8a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:37.596663 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1aeac7d0-0ce7-4653-937c-d93452820c8a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:37.627103 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-1aeac7d0-0ce7-4653-937c-d93452820c8a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046294 May 03 08:57:37.627648 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 208/427] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:57:37 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:57:38.643068 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f92a25a8-865d-4e04-ae61-0328b4b6f112 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:57:38.644580 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f92a25a8-865d-4e04-ae61-0328b4b6f112 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:57:38.653339 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f92a25a8-865d-4e04-ae61-0328b4b6f112 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:38.653785 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f92a25a8-865d-4e04-ae61-0328b4b6f112 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:38.654543 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f92a25a8-865d-4e04-ae61-0328b4b6f112 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:38.654971 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f92a25a8-865d-4e04-ae61-0328b4b6f112 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:38.683721 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f92a25a8-865d-4e04-ae61-0328b4b6f112 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047351 May 03 08:57:38.684285 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 220/428] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:57:38 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:57:39.696676 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-68d9e07c-8ce5-459e-bd9f-536641548c36 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:57:39.697658 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-68d9e07c-8ce5-459e-bd9f-536641548c36 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:57:39.704607 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-68d9e07c-8ce5-459e-bd9f-536641548c36 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:39.705194 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-68d9e07c-8ce5-459e-bd9f-536641548c36 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:39.705956 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-68d9e07c-8ce5-459e-bd9f-536641548c36 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:39.706390 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-68d9e07c-8ce5-459e-bd9f-536641548c36 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:39.737723 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-68d9e07c-8ce5-459e-bd9f-536641548c36 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046543 May 03 08:57:39.738399 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 209/429] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:57:39 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:57:40.753616 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d8ab7381-b937-4f08-9aee-a3bac6ee6700 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:57:40.754997 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d8ab7381-b937-4f08-9aee-a3bac6ee6700 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:57:40.765162 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d8ab7381-b937-4f08-9aee-a3bac6ee6700 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:40.765728 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d8ab7381-b937-4f08-9aee-a3bac6ee6700 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:40.766536 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d8ab7381-b937-4f08-9aee-a3bac6ee6700 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:40.767048 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d8ab7381-b937-4f08-9aee-a3bac6ee6700 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:40.800255 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d8ab7381-b937-4f08-9aee-a3bac6ee6700 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052613 May 03 08:57:40.800806 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 221/430] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:57:40 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:57:41.816742 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-83c058b5-5940-4d24-aa0c-740c54758107 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:57:41.818421 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-83c058b5-5940-4d24-aa0c-740c54758107 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:57:41.827390 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-83c058b5-5940-4d24-aa0c-740c54758107 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:41.827872 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-83c058b5-5940-4d24-aa0c-740c54758107 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:41.828645 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-83c058b5-5940-4d24-aa0c-740c54758107 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:41.829068 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-83c058b5-5940-4d24-aa0c-740c54758107 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:41.858658 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-83c058b5-5940-4d24-aa0c-740c54758107 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048801 May 03 08:57:41.859194 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 210/431] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:57:41 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:57:42.873075 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ba921b20-616e-4ae6-9e6f-daa6f667c561 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:57:42.874132 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ba921b20-616e-4ae6-9e6f-daa6f667c561 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:57:42.882844 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ba921b20-616e-4ae6-9e6f-daa6f667c561 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:42.883400 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ba921b20-616e-4ae6-9e6f-daa6f667c561 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:42.884409 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ba921b20-616e-4ae6-9e6f-daa6f667c561 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:42.884945 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ba921b20-616e-4ae6-9e6f-daa6f667c561 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:42.920783 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ba921b20-616e-4ae6-9e6f-daa6f667c561 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052909 May 03 08:57:42.921371 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 222/432] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:57:42 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:57:43.935544 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f90a0ee9-759e-44ee-aa72-cba8a6fd9130 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:57:43.936501 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f90a0ee9-759e-44ee-aa72-cba8a6fd9130 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:57:43.943082 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f90a0ee9-759e-44ee-aa72-cba8a6fd9130 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:43.943539 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f90a0ee9-759e-44ee-aa72-cba8a6fd9130 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:43.944305 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f90a0ee9-759e-44ee-aa72-cba8a6fd9130 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:43.944734 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f90a0ee9-759e-44ee-aa72-cba8a6fd9130 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:43.974591 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f90a0ee9-759e-44ee-aa72-cba8a6fd9130 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045155 May 03 08:57:43.975145 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 211/433] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:57:43 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:57:44.987078 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-de302368-3064-403a-afec-017227029807 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:57:44.988057 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-de302368-3064-403a-afec-017227029807 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:57:44.994715 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-de302368-3064-403a-afec-017227029807 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:44.995162 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-de302368-3064-403a-afec-017227029807 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:44.995966 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-de302368-3064-403a-afec-017227029807 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:44.996398 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-de302368-3064-403a-afec-017227029807 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:45.025458 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-de302368-3064-403a-afec-017227029807 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042374 May 03 08:57:45.026006 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 223/434] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:57:44 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:57:46.037488 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7837c4f3-e9f3-4306-be5d-0e8460985384 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:57:46.038416 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7837c4f3-e9f3-4306-be5d-0e8460985384 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:57:46.044877 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7837c4f3-e9f3-4306-be5d-0e8460985384 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:46.045323 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7837c4f3-e9f3-4306-be5d-0e8460985384 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:46.046091 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7837c4f3-e9f3-4306-be5d-0e8460985384 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:46.046528 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7837c4f3-e9f3-4306-be5d-0e8460985384 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:46.075833 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7837c4f3-e9f3-4306-be5d-0e8460985384 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042715 May 03 08:57:46.076423 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 212/435] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:57:46 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:57:47.087360 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5a7fa485-d434-492c-80c4-9bccd2ca7f02 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:57:47.088328 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5a7fa485-d434-492c-80c4-9bccd2ca7f02 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:57:47.095072 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5a7fa485-d434-492c-80c4-9bccd2ca7f02 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:47.095527 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5a7fa485-d434-492c-80c4-9bccd2ca7f02 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:47.096341 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5a7fa485-d434-492c-80c4-9bccd2ca7f02 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:47.096779 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5a7fa485-d434-492c-80c4-9bccd2ca7f02 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:47.126549 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5a7fa485-d434-492c-80c4-9bccd2ca7f02 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043294 May 03 08:57:47.127093 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 224/436] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:57:47 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:57:48.141742 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9104a5cc-702d-409a-842a-7ef0cf6f5bfe tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:57:48.143131 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9104a5cc-702d-409a-842a-7ef0cf6f5bfe tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:57:48.153034 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9104a5cc-702d-409a-842a-7ef0cf6f5bfe tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:48.153841 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9104a5cc-702d-409a-842a-7ef0cf6f5bfe tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:48.154612 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9104a5cc-702d-409a-842a-7ef0cf6f5bfe tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:48.155039 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9104a5cc-702d-409a-842a-7ef0cf6f5bfe tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:48.190752 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9104a5cc-702d-409a-842a-7ef0cf6f5bfe tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055782 May 03 08:57:48.191306 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 213/437] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:57:48 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:57:49.205723 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-cd570b28-1397-4da6-8c24-7ab85b8a3a4a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:57:49.206857 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-cd570b28-1397-4da6-8c24-7ab85b8a3a4a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:57:49.214661 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cd570b28-1397-4da6-8c24-7ab85b8a3a4a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:49.215158 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cd570b28-1397-4da6-8c24-7ab85b8a3a4a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:49.216069 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cd570b28-1397-4da6-8c24-7ab85b8a3a4a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:49.216543 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cd570b28-1397-4da6-8c24-7ab85b8a3a4a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:49.248748 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-cd570b28-1397-4da6-8c24-7ab85b8a3a4a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048532 May 03 08:57:49.249465 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 225/438] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:57:49 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:57:50.262352 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-414884b9-2e6d-4c4c-a699-ce5136130c89 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:57:50.263288 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-414884b9-2e6d-4c4c-a699-ce5136130c89 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:57:50.270290 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-414884b9-2e6d-4c4c-a699-ce5136130c89 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:50.270733 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-414884b9-2e6d-4c4c-a699-ce5136130c89 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:50.271485 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-414884b9-2e6d-4c4c-a699-ce5136130c89 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:50.271955 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-414884b9-2e6d-4c4c-a699-ce5136130c89 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:50.301396 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-414884b9-2e6d-4c4c-a699-ce5136130c89 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043116 May 03 08:57:50.301944 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 214/439] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:57:50 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:57:51.314703 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-add9e56f-ca4a-4cdd-963e-7fc8653f7217 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:57:51.315622 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-add9e56f-ca4a-4cdd-963e-7fc8653f7217 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:57:51.322694 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-add9e56f-ca4a-4cdd-963e-7fc8653f7217 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:51.323165 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-add9e56f-ca4a-4cdd-963e-7fc8653f7217 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:51.323982 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-add9e56f-ca4a-4cdd-963e-7fc8653f7217 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:51.324420 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-add9e56f-ca4a-4cdd-963e-7fc8653f7217 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:51.356742 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-add9e56f-ca4a-4cdd-963e-7fc8653f7217 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046736 May 03 08:57:51.357524 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 226/440] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:57:51 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:57:52.375272 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b2f1aaec-ba42-4daa-b662-3af7f2791e5e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:57:52.376707 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b2f1aaec-ba42-4daa-b662-3af7f2791e5e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:57:52.387745 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b2f1aaec-ba42-4daa-b662-3af7f2791e5e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:52.388534 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b2f1aaec-ba42-4daa-b662-3af7f2791e5e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:52.389958 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b2f1aaec-ba42-4daa-b662-3af7f2791e5e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:52.390376 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b2f1aaec-ba42-4daa-b662-3af7f2791e5e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:52.420190 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b2f1aaec-ba42-4daa-b662-3af7f2791e5e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051802 May 03 08:57:52.420746 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 215/441] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:57:52 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:57:53.436925 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-47d7493b-8945-41d7-b467-7029041af2d1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:57:53.438489 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-47d7493b-8945-41d7-b467-7029041af2d1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:57:53.445796 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-47d7493b-8945-41d7-b467-7029041af2d1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:53.446232 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-47d7493b-8945-41d7-b467-7029041af2d1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:53.446991 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-47d7493b-8945-41d7-b467-7029041af2d1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:53.447428 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-47d7493b-8945-41d7-b467-7029041af2d1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:53.477391 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-47d7493b-8945-41d7-b467-7029041af2d1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047481 May 03 08:57:53.477944 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 227/442] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:57:53 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:57:54.491078 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-540d63f1-6984-43b4-831c-da41ce59c55f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:57:54.492152 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-540d63f1-6984-43b4-831c-da41ce59c55f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:57:54.498347 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-540d63f1-6984-43b4-831c-da41ce59c55f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:54.499061 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-540d63f1-6984-43b4-831c-da41ce59c55f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:54.500097 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-540d63f1-6984-43b4-831c-da41ce59c55f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:54.500732 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-540d63f1-6984-43b4-831c-da41ce59c55f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:54.529861 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-540d63f1-6984-43b4-831c-da41ce59c55f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042842 May 03 08:57:54.530411 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 216/443] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:57:54 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:57:55.546496 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9d4ff4c0-c33f-4b93-9d02-dc90b149f49e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:57:55.547877 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9d4ff4c0-c33f-4b93-9d02-dc90b149f49e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:57:55.555528 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9d4ff4c0-c33f-4b93-9d02-dc90b149f49e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:55.556018 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9d4ff4c0-c33f-4b93-9d02-dc90b149f49e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:55.556789 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9d4ff4c0-c33f-4b93-9d02-dc90b149f49e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:55.557212 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9d4ff4c0-c33f-4b93-9d02-dc90b149f49e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:55.587244 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9d4ff4c0-c33f-4b93-9d02-dc90b149f49e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047661 May 03 08:57:55.587808 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 228/444] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:57:55 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:57:56.603919 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-bc060c7f-5634-4ba2-9e6b-3000a54d139a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:57:56.605266 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-bc060c7f-5634-4ba2-9e6b-3000a54d139a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:57:56.615850 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bc060c7f-5634-4ba2-9e6b-3000a54d139a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:56.616602 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bc060c7f-5634-4ba2-9e6b-3000a54d139a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:56.617872 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bc060c7f-5634-4ba2-9e6b-3000a54d139a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:56.618576 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bc060c7f-5634-4ba2-9e6b-3000a54d139a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:56.651363 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-bc060c7f-5634-4ba2-9e6b-3000a54d139a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054726 May 03 08:57:56.651940 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 217/445] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:57:56 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:57:57.669459 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-1302758c-1971-4918-b72a-2df3b1bcc5b7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:57:57.671029 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-1302758c-1971-4918-b72a-2df3b1bcc5b7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:57:57.682827 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1302758c-1971-4918-b72a-2df3b1bcc5b7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:57.683577 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1302758c-1971-4918-b72a-2df3b1bcc5b7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:57.684912 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1302758c-1971-4918-b72a-2df3b1bcc5b7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:57.685644 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1302758c-1971-4918-b72a-2df3b1bcc5b7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:57.717395 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-1302758c-1971-4918-b72a-2df3b1bcc5b7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054922 May 03 08:57:57.717926 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 229/446] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:57:57 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:57:58.731155 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b69948e1-36c4-4d61-84df-7b514c18f233 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:57:58.732198 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b69948e1-36c4-4d61-84df-7b514c18f233 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:57:58.739885 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b69948e1-36c4-4d61-84df-7b514c18f233 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:58.740339 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b69948e1-36c4-4d61-84df-7b514c18f233 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:58.741115 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b69948e1-36c4-4d61-84df-7b514c18f233 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:58.741548 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b69948e1-36c4-4d61-84df-7b514c18f233 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:58.773867 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b69948e1-36c4-4d61-84df-7b514c18f233 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047248 May 03 08:57:58.774424 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 218/447] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:57:58 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:57:59.788487 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-6cf06204-11f7-41cf-9c51-7a4c462bb54e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:57:59.789336 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-6cf06204-11f7-41cf-9c51-7a4c462bb54e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:57:59.796057 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6cf06204-11f7-41cf-9c51-7a4c462bb54e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:59.796500 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6cf06204-11f7-41cf-9c51-7a4c462bb54e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:59.797257 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6cf06204-11f7-41cf-9c51-7a4c462bb54e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:57:59.797689 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6cf06204-11f7-41cf-9c51-7a4c462bb54e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:57:59.832679 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-6cf06204-11f7-41cf-9c51-7a4c462bb54e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049232 May 03 08:57:59.833231 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 230/448] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:57:59 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:00.846165 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-84a59e09-5d99-4339-8135-0761c2457073 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:00.847572 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-84a59e09-5d99-4339-8135-0761c2457073 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:00.856424 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-84a59e09-5d99-4339-8135-0761c2457073 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:00.857025 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-84a59e09-5d99-4339-8135-0761c2457073 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:00.857863 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-84a59e09-5d99-4339-8135-0761c2457073 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:00.858340 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-84a59e09-5d99-4339-8135-0761c2457073 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:00.888227 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-84a59e09-5d99-4339-8135-0761c2457073 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047665 May 03 08:58:00.888780 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 219/449] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:00 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:01.902536 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c61efbc4-3b25-42f9-9858-25be2aa32e57 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:01.903614 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c61efbc4-3b25-42f9-9858-25be2aa32e57 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:01.911658 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c61efbc4-3b25-42f9-9858-25be2aa32e57 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:01.912152 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c61efbc4-3b25-42f9-9858-25be2aa32e57 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:01.912914 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c61efbc4-3b25-42f9-9858-25be2aa32e57 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:01.913355 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c61efbc4-3b25-42f9-9858-25be2aa32e57 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:01.942989 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c61efbc4-3b25-42f9-9858-25be2aa32e57 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045392 May 03 08:58:01.943527 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 231/450] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:01 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:02.754501 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d45711aa-244a-400e-82b0-c949cebe9c48 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:58:02.755524 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d45711aa-244a-400e-82b0-c949cebe9c48 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:02.762163 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d45711aa-244a-400e-82b0-c949cebe9c48 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:02.762610 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d45711aa-244a-400e-82b0-c949cebe9c48 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:02.763399 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d45711aa-244a-400e-82b0-c949cebe9c48 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:02.763864 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d45711aa-244a-400e-82b0-c949cebe9c48 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:02.787871 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.objects.instance [None req-d45711aa-244a-400e-82b0-c949cebe9c48 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lazy-loading 'flavor' on Instance uuid 512c1f04-399e-4647-8bfe-f2c295397df2 {{(pid=123392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 03 08:58:02.917950 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d45711aa-244a-400e-82b0-c949cebe9c48 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "POST /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/action" status: 200 len: 32 microversion: 2.1 time: 0.167567 May 03 08:58:02.918570 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 220/451] 10.222.0.11 () {60 vars in 1277 bytes} [Tue May 3 08:58:02 2022] POST /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/action => generated 32 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 03 08:58:02.929392 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-aa440838-5bb7-4328-99c0-b0619e15124c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:02.930040 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-aa440838-5bb7-4328-99c0-b0619e15124c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:02.936695 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-aa440838-5bb7-4328-99c0-b0619e15124c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:02.937137 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-aa440838-5bb7-4328-99c0-b0619e15124c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:02.937890 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-aa440838-5bb7-4328-99c0-b0619e15124c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:02.938327 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-aa440838-5bb7-4328-99c0-b0619e15124c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:02.955572 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e6b66b54-7937-4b9e-a9b1-47bcfd270210 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:02.956627 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e6b66b54-7937-4b9e-a9b1-47bcfd270210 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:02.963395 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e6b66b54-7937-4b9e-a9b1-47bcfd270210 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:02.963835 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e6b66b54-7937-4b9e-a9b1-47bcfd270210 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:02.964645 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e6b66b54-7937-4b9e-a9b1-47bcfd270210 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:02.965061 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e6b66b54-7937-4b9e-a9b1-47bcfd270210 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:02.995165 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e6b66b54-7937-4b9e-a9b1-47bcfd270210 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044065 May 03 08:58:02.995782 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 221/452] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:02 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:03.075362 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-aa440838-5bb7-4328-99c0-b0619e15124c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:03.084007 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-aa440838-5bb7-4328-99c0-b0619e15124c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.159565 May 03 08:58:03.084678 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 232/453] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:02 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:58:04.011189 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5b4f16d3-6c2a-4ea6-bf8e-57b5ccf24af4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:04.012564 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5b4f16d3-6c2a-4ea6-bf8e-57b5ccf24af4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:04.022002 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5b4f16d3-6c2a-4ea6-bf8e-57b5ccf24af4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:04.022450 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5b4f16d3-6c2a-4ea6-bf8e-57b5ccf24af4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:04.023212 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5b4f16d3-6c2a-4ea6-bf8e-57b5ccf24af4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:04.023643 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5b4f16d3-6c2a-4ea6-bf8e-57b5ccf24af4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:04.052594 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5b4f16d3-6c2a-4ea6-bf8e-57b5ccf24af4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048267 May 03 08:58:04.053165 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 222/454] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:04 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:04.103514 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9afe0455-016d-44e6-8de4-7d5111c6583b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:04.104400 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9afe0455-016d-44e6-8de4-7d5111c6583b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:04.113560 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9afe0455-016d-44e6-8de4-7d5111c6583b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:04.114191 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9afe0455-016d-44e6-8de4-7d5111c6583b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:04.115260 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9afe0455-016d-44e6-8de4-7d5111c6583b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:04.115929 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9afe0455-016d-44e6-8de4-7d5111c6583b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:04.257909 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9afe0455-016d-44e6-8de4-7d5111c6583b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:04.266507 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9afe0455-016d-44e6-8de4-7d5111c6583b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.168439 May 03 08:58:04.266990 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 233/455] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:04 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:58:05.069303 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f4aef106-14df-49f8-ad58-2d82827a6116 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:05.070656 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f4aef106-14df-49f8-ad58-2d82827a6116 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:05.081377 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f4aef106-14df-49f8-ad58-2d82827a6116 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:05.082129 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f4aef106-14df-49f8-ad58-2d82827a6116 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:05.083364 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f4aef106-14df-49f8-ad58-2d82827a6116 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:05.084187 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f4aef106-14df-49f8-ad58-2d82827a6116 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:05.119020 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f4aef106-14df-49f8-ad58-2d82827a6116 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056916 May 03 08:58:05.119568 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 223/456] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:05 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:05.287922 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-600542af-2ac6-40d3-9a88-08b01ca1f44d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:05.288947 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-600542af-2ac6-40d3-9a88-08b01ca1f44d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:05.299688 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-600542af-2ac6-40d3-9a88-08b01ca1f44d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:05.300491 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-600542af-2ac6-40d3-9a88-08b01ca1f44d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:05.301612 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-600542af-2ac6-40d3-9a88-08b01ca1f44d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:05.302044 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-600542af-2ac6-40d3-9a88-08b01ca1f44d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:05.429803 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-600542af-2ac6-40d3-9a88-08b01ca1f44d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:05.441523 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-600542af-2ac6-40d3-9a88-08b01ca1f44d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.159953 May 03 08:58:05.442321 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 234/457] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:05 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:58:06.135381 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-fbf00807-e626-4c79-889a-a5062ef395d4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:06.136797 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-fbf00807-e626-4c79-889a-a5062ef395d4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:06.146505 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fbf00807-e626-4c79-889a-a5062ef395d4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:06.146955 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fbf00807-e626-4c79-889a-a5062ef395d4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:06.147723 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fbf00807-e626-4c79-889a-a5062ef395d4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:06.148180 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fbf00807-e626-4c79-889a-a5062ef395d4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:06.176714 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-fbf00807-e626-4c79-889a-a5062ef395d4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048136 May 03 08:58:06.177274 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 224/458] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:06 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:06.462533 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9226ccf1-8260-46bf-8a40-ebecfdc39304 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:06.463542 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9226ccf1-8260-46bf-8a40-ebecfdc39304 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:06.474165 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9226ccf1-8260-46bf-8a40-ebecfdc39304 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:06.474599 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9226ccf1-8260-46bf-8a40-ebecfdc39304 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:06.475363 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9226ccf1-8260-46bf-8a40-ebecfdc39304 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:06.475840 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9226ccf1-8260-46bf-8a40-ebecfdc39304 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:06.617467 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9226ccf1-8260-46bf-8a40-ebecfdc39304 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:06.625788 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9226ccf1-8260-46bf-8a40-ebecfdc39304 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.169778 May 03 08:58:06.626392 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 235/459] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:06 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:58:07.193119 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-619c0554-0905-411f-bd1e-3de8388ce3fc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:07.194200 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-619c0554-0905-411f-bd1e-3de8388ce3fc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:07.200714 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-619c0554-0905-411f-bd1e-3de8388ce3fc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:07.201166 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-619c0554-0905-411f-bd1e-3de8388ce3fc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:07.201973 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-619c0554-0905-411f-bd1e-3de8388ce3fc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:07.202413 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-619c0554-0905-411f-bd1e-3de8388ce3fc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:07.232391 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-619c0554-0905-411f-bd1e-3de8388ce3fc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046100 May 03 08:58:07.232953 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 225/460] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:07 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:07.644466 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d72c31b1-c2bc-4bf1-a259-f15ba5c4599c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:07.645257 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d72c31b1-c2bc-4bf1-a259-f15ba5c4599c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:07.651994 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d72c31b1-c2bc-4bf1-a259-f15ba5c4599c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:07.652436 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d72c31b1-c2bc-4bf1-a259-f15ba5c4599c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:07.653311 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d72c31b1-c2bc-4bf1-a259-f15ba5c4599c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:07.653739 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d72c31b1-c2bc-4bf1-a259-f15ba5c4599c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:07.794027 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d72c31b1-c2bc-4bf1-a259-f15ba5c4599c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:07.802408 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d72c31b1-c2bc-4bf1-a259-f15ba5c4599c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.162785 May 03 08:58:07.802972 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 236/461] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:07 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:58:08.245303 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-219cbf9d-f856-4b7f-9163-6cb082e6ad41 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:08.246276 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-219cbf9d-f856-4b7f-9163-6cb082e6ad41 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:08.253491 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-219cbf9d-f856-4b7f-9163-6cb082e6ad41 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:08.253929 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-219cbf9d-f856-4b7f-9163-6cb082e6ad41 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:08.254699 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-219cbf9d-f856-4b7f-9163-6cb082e6ad41 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:08.255127 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-219cbf9d-f856-4b7f-9163-6cb082e6ad41 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:08.285495 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-219cbf9d-f856-4b7f-9163-6cb082e6ad41 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044492 May 03 08:58:08.286037 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 226/462] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:08 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:08.821780 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-bd29d056-e9cc-4192-8523-9cbaf622751c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:08.822387 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-bd29d056-e9cc-4192-8523-9cbaf622751c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:08.829050 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bd29d056-e9cc-4192-8523-9cbaf622751c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:08.829491 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bd29d056-e9cc-4192-8523-9cbaf622751c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:08.830249 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bd29d056-e9cc-4192-8523-9cbaf622751c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:08.830675 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bd29d056-e9cc-4192-8523-9cbaf622751c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:08.963441 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-bd29d056-e9cc-4192-8523-9cbaf622751c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:08.971355 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-bd29d056-e9cc-4192-8523-9cbaf622751c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.153481 May 03 08:58:08.972275 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 237/463] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:08 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 08:58:09.301984 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-94a727be-71c8-4b30-ba34-b2ea0f9cd9fa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:09.303467 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-94a727be-71c8-4b30-ba34-b2ea0f9cd9fa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:09.314206 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-94a727be-71c8-4b30-ba34-b2ea0f9cd9fa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:09.314938 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-94a727be-71c8-4b30-ba34-b2ea0f9cd9fa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:09.316243 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-94a727be-71c8-4b30-ba34-b2ea0f9cd9fa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:09.316898 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-94a727be-71c8-4b30-ba34-b2ea0f9cd9fa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:09.345124 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-94a727be-71c8-4b30-ba34-b2ea0f9cd9fa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049929 May 03 08:58:09.345664 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 227/464] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:09 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:09.993083 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-af5d7b3f-9f7e-41f6-a73f-9fcc119037cb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:09.993992 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-af5d7b3f-9f7e-41f6-a73f-9fcc119037cb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:10.004772 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-af5d7b3f-9f7e-41f6-a73f-9fcc119037cb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:10.005899 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-af5d7b3f-9f7e-41f6-a73f-9fcc119037cb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:10.006764 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-af5d7b3f-9f7e-41f6-a73f-9fcc119037cb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:10.007483 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-af5d7b3f-9f7e-41f6-a73f-9fcc119037cb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:10.141246 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-af5d7b3f-9f7e-41f6-a73f-9fcc119037cb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:10.149121 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-af5d7b3f-9f7e-41f6-a73f-9fcc119037cb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.162582 May 03 08:58:10.149656 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 238/465] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:09 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:58:10.361656 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-66feca03-9ed1-4491-9c76-092e6b3f5a24 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:10.362667 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-66feca03-9ed1-4491-9c76-092e6b3f5a24 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:10.372657 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-66feca03-9ed1-4491-9c76-092e6b3f5a24 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:10.373341 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-66feca03-9ed1-4491-9c76-092e6b3f5a24 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:10.374475 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-66feca03-9ed1-4491-9c76-092e6b3f5a24 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:10.375101 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-66feca03-9ed1-4491-9c76-092e6b3f5a24 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:10.405587 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-66feca03-9ed1-4491-9c76-092e6b3f5a24 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050707 May 03 08:58:10.406144 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 228/466] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:10 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:11.170184 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-eaa91cd8-6735-4f83-a479-db4ec80b45db tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:11.170821 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-eaa91cd8-6735-4f83-a479-db4ec80b45db tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:11.177792 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-eaa91cd8-6735-4f83-a479-db4ec80b45db tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:11.178257 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-eaa91cd8-6735-4f83-a479-db4ec80b45db tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:11.179023 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-eaa91cd8-6735-4f83-a479-db4ec80b45db tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:11.179442 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-eaa91cd8-6735-4f83-a479-db4ec80b45db tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:11.309859 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-eaa91cd8-6735-4f83-a479-db4ec80b45db tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:11.317722 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-eaa91cd8-6735-4f83-a479-db4ec80b45db tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.151420 May 03 08:58:11.318233 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 239/467] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:11 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:58:11.421806 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-772b9dff-6484-4eb1-abb1-8cd7047b568c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:11.423330 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-772b9dff-6484-4eb1-abb1-8cd7047b568c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:11.430922 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-772b9dff-6484-4eb1-abb1-8cd7047b568c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:11.431369 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-772b9dff-6484-4eb1-abb1-8cd7047b568c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:11.432165 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-772b9dff-6484-4eb1-abb1-8cd7047b568c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:11.432598 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-772b9dff-6484-4eb1-abb1-8cd7047b568c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:11.463415 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-772b9dff-6484-4eb1-abb1-8cd7047b568c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048251 May 03 08:58:11.464010 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 229/468] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:11 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:12.334952 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-6691b305-752e-4eb7-932b-61681f819bfe tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:12.335558 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-6691b305-752e-4eb7-932b-61681f819bfe tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:12.343484 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6691b305-752e-4eb7-932b-61681f819bfe tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:12.344241 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6691b305-752e-4eb7-932b-61681f819bfe tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:12.345104 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6691b305-752e-4eb7-932b-61681f819bfe tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:12.345530 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6691b305-752e-4eb7-932b-61681f819bfe tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:12.476160 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7dbda280-7d9b-4c18-8722-1345b3467cc8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:12.477109 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7dbda280-7d9b-4c18-8722-1345b3467cc8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:12.483309 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7dbda280-7d9b-4c18-8722-1345b3467cc8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:12.483807 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7dbda280-7d9b-4c18-8722-1345b3467cc8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:12.484575 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7dbda280-7d9b-4c18-8722-1345b3467cc8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:12.484996 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7dbda280-7d9b-4c18-8722-1345b3467cc8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:12.490560 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-6691b305-752e-4eb7-932b-61681f819bfe tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:12.498466 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-6691b305-752e-4eb7-932b-61681f819bfe tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.167509 May 03 08:58:12.499032 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 240/469] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:12 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:58:12.513929 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7dbda280-7d9b-4c18-8722-1345b3467cc8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042523 May 03 08:58:12.514518 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 230/470] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:12 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:13.519545 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a4d19220-209f-4d4f-a6ef-88129f59b1ac tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:13.520578 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a4d19220-209f-4d4f-a6ef-88129f59b1ac tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:13.527367 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-1ba1edbf-ef2f-43dd-bd93-8a0a01b853fb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:13.528393 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a4d19220-209f-4d4f-a6ef-88129f59b1ac tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:13.528596 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-1ba1edbf-ef2f-43dd-bd93-8a0a01b853fb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:13.528923 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a4d19220-209f-4d4f-a6ef-88129f59b1ac tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:13.529825 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a4d19220-209f-4d4f-a6ef-88129f59b1ac tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:13.530334 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a4d19220-209f-4d4f-a6ef-88129f59b1ac tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:13.535293 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1ba1edbf-ef2f-43dd-bd93-8a0a01b853fb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:13.535808 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1ba1edbf-ef2f-43dd-bd93-8a0a01b853fb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:13.536870 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1ba1edbf-ef2f-43dd-bd93-8a0a01b853fb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:13.537375 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1ba1edbf-ef2f-43dd-bd93-8a0a01b853fb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:13.568676 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-1ba1edbf-ef2f-43dd-bd93-8a0a01b853fb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045972 May 03 08:58:13.569221 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 231/471] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:13 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:13.664388 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a4d19220-209f-4d4f-a6ef-88129f59b1ac tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:13.676523 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a4d19220-209f-4d4f-a6ef-88129f59b1ac tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.163188 May 03 08:58:13.677309 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 241/472] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:13 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:58:14.584954 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f0143a53-512b-4ba5-aec0-f2b05375e08f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:14.586290 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f0143a53-512b-4ba5-aec0-f2b05375e08f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:14.597474 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f0143a53-512b-4ba5-aec0-f2b05375e08f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:14.598260 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f0143a53-512b-4ba5-aec0-f2b05375e08f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:14.599511 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f0143a53-512b-4ba5-aec0-f2b05375e08f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:14.600148 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f0143a53-512b-4ba5-aec0-f2b05375e08f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:14.629144 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f0143a53-512b-4ba5-aec0-f2b05375e08f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051105 May 03 08:58:14.629683 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 232/473] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:14 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:14.698132 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5cc5f351-e468-460e-8020-31222a5ad610 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:14.699136 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5cc5f351-e468-460e-8020-31222a5ad610 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:14.709962 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5cc5f351-e468-460e-8020-31222a5ad610 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:14.710716 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5cc5f351-e468-460e-8020-31222a5ad610 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:14.712032 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5cc5f351-e468-460e-8020-31222a5ad610 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:14.712774 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5cc5f351-e468-460e-8020-31222a5ad610 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:14.869610 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5cc5f351-e468-460e-8020-31222a5ad610 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:14.882117 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5cc5f351-e468-460e-8020-31222a5ad610 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.190347 May 03 08:58:14.882822 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 242/474] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:14 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:58:15.645523 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-02282eb6-9e62-45fa-8263-736c6ac67da7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:15.647007 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-02282eb6-9e62-45fa-8263-736c6ac67da7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:15.654158 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-02282eb6-9e62-45fa-8263-736c6ac67da7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:15.654634 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-02282eb6-9e62-45fa-8263-736c6ac67da7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:15.655456 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-02282eb6-9e62-45fa-8263-736c6ac67da7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:15.655937 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-02282eb6-9e62-45fa-8263-736c6ac67da7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:15.686142 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-02282eb6-9e62-45fa-8263-736c6ac67da7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047479 May 03 08:58:15.686687 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 233/475] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:15 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:15.905849 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d0e919d6-7b49-4f85-b6ac-055487ea408d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:15.906904 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d0e919d6-7b49-4f85-b6ac-055487ea408d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:15.917619 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d0e919d6-7b49-4f85-b6ac-055487ea408d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:15.918358 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d0e919d6-7b49-4f85-b6ac-055487ea408d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:15.919672 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d0e919d6-7b49-4f85-b6ac-055487ea408d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:15.920449 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d0e919d6-7b49-4f85-b6ac-055487ea408d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:16.057354 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d0e919d6-7b49-4f85-b6ac-055487ea408d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:16.065509 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d0e919d6-7b49-4f85-b6ac-055487ea408d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.166229 May 03 08:58:16.066084 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 243/476] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:15 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:58:16.698275 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-01225df0-518b-42c8-a153-6787fd2bac70 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:16.699372 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-01225df0-518b-42c8-a153-6787fd2bac70 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:16.705889 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-01225df0-518b-42c8-a153-6787fd2bac70 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:16.706349 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-01225df0-518b-42c8-a153-6787fd2bac70 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:16.707112 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-01225df0-518b-42c8-a153-6787fd2bac70 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:16.707549 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-01225df0-518b-42c8-a153-6787fd2bac70 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:16.736441 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-01225df0-518b-42c8-a153-6787fd2bac70 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042304 May 03 08:58:16.736992 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 234/477] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:16 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:17.085155 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-7ad7556b-85a6-4d84-9e38-4403b9237db6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:17.085891 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-7ad7556b-85a6-4d84-9e38-4403b9237db6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:17.094737 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7ad7556b-85a6-4d84-9e38-4403b9237db6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:17.095338 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7ad7556b-85a6-4d84-9e38-4403b9237db6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:17.096815 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7ad7556b-85a6-4d84-9e38-4403b9237db6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:17.097391 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7ad7556b-85a6-4d84-9e38-4403b9237db6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:17.232071 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7ad7556b-85a6-4d84-9e38-4403b9237db6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:17.240491 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-7ad7556b-85a6-4d84-9e38-4403b9237db6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1712 microversion: 2.1 time: 0.160708 May 03 08:58:17.241049 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 244/478] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:17 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1712 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:58:17.303390 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-76327c5d-08c0-4244-94c2-e34bf94c6aca tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:17.304025 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-76327c5d-08c0-4244-94c2-e34bf94c6aca tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:17.310214 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-76327c5d-08c0-4244-94c2-e34bf94c6aca tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:17.310663 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-76327c5d-08c0-4244-94c2-e34bf94c6aca tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:17.311429 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-76327c5d-08c0-4244-94c2-e34bf94c6aca tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:17.311903 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-76327c5d-08c0-4244-94c2-e34bf94c6aca tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:17.397766 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-76327c5d-08c0-4244-94c2-e34bf94c6aca tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] HTTP exception thrown: Cannot 'detach_volume' instance 512c1f04-399e-4647-8bfe-f2c295397df2 while it is in vm_state rescued May 03 08:58:17.398364 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-76327c5d-08c0-4244-94c2-e34bf94c6aca tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Returning 409 to user: Cannot 'detach_volume' instance 512c1f04-399e-4647-8bfe-f2c295397df2 while it is in vm_state rescued {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 08:58:17.399183 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-76327c5d-08c0-4244-94c2-e34bf94c6aca tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "DELETE /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments/b0e90a13-d5bd-4175-8cb5-6962b4700c63" status: 409 len: 152 microversion: 2.1 time: 0.099948 May 03 08:58:17.399730 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 235/479] 10.222.0.11 () {58 vars in 1415 bytes} [Tue May 3 08:58:17 2022] DELETE /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments/b0e90a13-d5bd-4175-8cb5-6962b4700c63 => generated 152 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 03 08:58:17.408469 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5bcc70b7-9843-4110-9abd-f88141287923 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:58:17.409001 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5bcc70b7-9843-4110-9abd-f88141287923 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:17.415165 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5bcc70b7-9843-4110-9abd-f88141287923 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:17.415586 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5bcc70b7-9843-4110-9abd-f88141287923 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:17.416390 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5bcc70b7-9843-4110-9abd-f88141287923 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:17.416825 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5bcc70b7-9843-4110-9abd-f88141287923 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:17.498762 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5bcc70b7-9843-4110-9abd-f88141287923 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "POST /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/action" status: 202 len: 0 microversion: 2.1 time: 0.093607 May 03 08:58:17.499707 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 245/480] 10.222.0.11 () {60 vars in 1277 bytes} [Tue May 3 08:58:17 2022] POST /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 03 08:58:17.509865 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ea7e366d-6c65-4014-98e5-506757c1574c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:17.510593 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ea7e366d-6c65-4014-98e5-506757c1574c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:17.516928 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ea7e366d-6c65-4014-98e5-506757c1574c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:17.517453 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ea7e366d-6c65-4014-98e5-506757c1574c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:17.518401 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ea7e366d-6c65-4014-98e5-506757c1574c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:17.519021 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ea7e366d-6c65-4014-98e5-506757c1574c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:17.723543 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ea7e366d-6c65-4014-98e5-506757c1574c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:17.732029 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ea7e366d-6c65-4014-98e5-506757c1574c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1720 microversion: 2.1 time: 0.226023 May 03 08:58:17.732575 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 236/481] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:17 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1720 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:58:17.749383 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-7c0aa026-8d21-4885-8b32-3af8cc4bc0f7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:17.750397 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-7c0aa026-8d21-4885-8b32-3af8cc4bc0f7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:17.757556 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7c0aa026-8d21-4885-8b32-3af8cc4bc0f7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:17.757998 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7c0aa026-8d21-4885-8b32-3af8cc4bc0f7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:17.758768 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7c0aa026-8d21-4885-8b32-3af8cc4bc0f7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:17.759195 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7c0aa026-8d21-4885-8b32-3af8cc4bc0f7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:17.789446 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-7c0aa026-8d21-4885-8b32-3af8cc4bc0f7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044371 May 03 08:58:17.790066 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 246/482] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:17 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:18.753407 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-45d9be9e-4f70-4d5a-93b7-a2197b76e7f5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:18.754323 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-45d9be9e-4f70-4d5a-93b7-a2197b76e7f5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:18.765793 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-45d9be9e-4f70-4d5a-93b7-a2197b76e7f5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:18.766552 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-45d9be9e-4f70-4d5a-93b7-a2197b76e7f5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:18.767858 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-45d9be9e-4f70-4d5a-93b7-a2197b76e7f5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:18.768600 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-45d9be9e-4f70-4d5a-93b7-a2197b76e7f5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:18.801584 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-6dca148e-6721-470b-8206-d4d3aacba082 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:18.802692 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-6dca148e-6721-470b-8206-d4d3aacba082 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:18.809633 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6dca148e-6721-470b-8206-d4d3aacba082 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:18.810075 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6dca148e-6721-470b-8206-d4d3aacba082 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:18.810852 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6dca148e-6721-470b-8206-d4d3aacba082 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:18.811281 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6dca148e-6721-470b-8206-d4d3aacba082 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:18.840664 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-6dca148e-6721-470b-8206-d4d3aacba082 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043084 May 03 08:58:18.841230 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 247/483] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:18 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:18.906716 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-45d9be9e-4f70-4d5a-93b7-a2197b76e7f5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:18.918767 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-45d9be9e-4f70-4d5a-93b7-a2197b76e7f5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1720 microversion: 2.1 time: 0.172236 May 03 08:58:18.919473 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 237/484] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:18 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1720 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:58:19.853317 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d9a5ae41-646b-477b-93de-70c2ea212f8c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:19.854253 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d9a5ae41-646b-477b-93de-70c2ea212f8c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:19.861060 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d9a5ae41-646b-477b-93de-70c2ea212f8c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:19.861610 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d9a5ae41-646b-477b-93de-70c2ea212f8c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:19.862384 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d9a5ae41-646b-477b-93de-70c2ea212f8c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:19.862880 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d9a5ae41-646b-477b-93de-70c2ea212f8c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:19.892027 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d9a5ae41-646b-477b-93de-70c2ea212f8c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042935 May 03 08:58:19.892596 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 248/485] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:19 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:19.940040 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-cbb7d5cf-a7be-4e20-84fc-86f675c38487 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:19.940635 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-cbb7d5cf-a7be-4e20-84fc-86f675c38487 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:19.947413 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cbb7d5cf-a7be-4e20-84fc-86f675c38487 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:19.947879 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cbb7d5cf-a7be-4e20-84fc-86f675c38487 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:19.948639 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cbb7d5cf-a7be-4e20-84fc-86f675c38487 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:19.949059 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cbb7d5cf-a7be-4e20-84fc-86f675c38487 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:20.079701 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-cbb7d5cf-a7be-4e20-84fc-86f675c38487 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:20.089925 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-cbb7d5cf-a7be-4e20-84fc-86f675c38487 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1726 microversion: 2.1 time: 0.153852 May 03 08:58:20.090511 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 238/486] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:19 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:58:20.106977 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-91d206fe-4481-492c-ab24-1e1242556ad2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:20.107419 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-91d206fe-4481-492c-ab24-1e1242556ad2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:20.113784 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-91d206fe-4481-492c-ab24-1e1242556ad2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:20.114204 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-91d206fe-4481-492c-ab24-1e1242556ad2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:20.114977 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-91d206fe-4481-492c-ab24-1e1242556ad2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:20.115399 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-91d206fe-4481-492c-ab24-1e1242556ad2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:20.199819 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-91d206fe-4481-492c-ab24-1e1242556ad2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096760 May 03 08:58:20.200455 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 249/487] 10.222.0.11 () {58 vars in 1274 bytes} [Tue May 3 08:58:20 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 08:58:20.751259 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-94632cee-d4b4-4933-822b-de5b087a34ac tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:20.751755 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-94632cee-d4b4-4933-822b-de5b087a34ac tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:20.758499 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-94632cee-d4b4-4933-822b-de5b087a34ac tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:20.758989 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-94632cee-d4b4-4933-822b-de5b087a34ac tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:20.759909 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-94632cee-d4b4-4933-822b-de5b087a34ac tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:20.760267 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-94632cee-d4b4-4933-822b-de5b087a34ac tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:20.784771 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-94632cee-d4b4-4933-822b-de5b087a34ac tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Going to try to terminate instance {{(pid=123392) delete /opt/stack/nova/nova/compute/api.py:2664}} May 03 08:58:20.865370 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-94632cee-d4b4-4933-822b-de5b087a34ac tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "DELETE /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 204 len: 0 microversion: 2.1 time: 0.117582 May 03 08:58:20.865885 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 239/488] 10.222.0.11 () {58 vars in 1238 bytes} [Tue May 3 08:58:20 2022] DELETE /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 03 08:58:20.874920 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-6283942e-05e4-4a0d-b208-8aeb2dbcd0fd tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:20.875662 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-6283942e-05e4-4a0d-b208-8aeb2dbcd0fd tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:20.881959 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6283942e-05e4-4a0d-b208-8aeb2dbcd0fd tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:20.882408 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6283942e-05e4-4a0d-b208-8aeb2dbcd0fd tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:20.883201 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6283942e-05e4-4a0d-b208-8aeb2dbcd0fd tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:20.883627 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6283942e-05e4-4a0d-b208-8aeb2dbcd0fd tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:20.904761 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-43cc5e6c-20f0-449c-b940-71192f34c4a1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:20.905982 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-43cc5e6c-20f0-449c-b940-71192f34c4a1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:20.913317 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-43cc5e6c-20f0-449c-b940-71192f34c4a1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:20.914305 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-43cc5e6c-20f0-449c-b940-71192f34c4a1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:20.915125 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-43cc5e6c-20f0-449c-b940-71192f34c4a1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:20.915561 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-43cc5e6c-20f0-449c-b940-71192f34c4a1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:20.946660 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-43cc5e6c-20f0-449c-b940-71192f34c4a1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046316 May 03 08:58:20.947381 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 240/489] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:20 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 03 08:58:21.064404 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-6283942e-05e4-4a0d-b208-8aeb2dbcd0fd tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:21.074076 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-6283942e-05e4-4a0d-b208-8aeb2dbcd0fd tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1577 microversion: 2.1 time: 0.203559 May 03 08:58:21.074667 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 250/490] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:20 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1577 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 08:58:21.219646 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-454bcf18-e7d3-4ee0-9dfa-7e4c45fbf610 req-f68d4a06-2cca-4bde-924d-c1971b32ee4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "512c1f04-399e-4647-8bfe-f2c295397df2", "tag": "fa2818f3-6dd4-4c2e-8c03-d124c2ac8ac8"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:58:21.228679 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-454bcf18-e7d3-4ee0-9dfa-7e4c45fbf610 req-f68d4a06-2cca-4bde-924d-c1971b32ee4a service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:21.229440 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-454bcf18-e7d3-4ee0-9dfa-7e4c45fbf610 req-f68d4a06-2cca-4bde-924d-c1971b32ee4a service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:21.243152 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-454bcf18-e7d3-4ee0-9dfa-7e4c45fbf610 req-f68d4a06-2cca-4bde-924d-c1971b32ee4a service nova] Creating event network-changed:fa2818f3-6dd4-4c2e-8c03-d124c2ac8ac8 for instance 512c1f04-399e-4647-8bfe-f2c295397df2 on hv-cinder-84027 May 03 08:58:21.248267 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-454bcf18-e7d3-4ee0-9dfa-7e4c45fbf610 req-f68d4a06-2cca-4bde-924d-c1971b32ee4a service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032171 May 03 08:58:21.249031 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 241/491] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 08:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:58:21.959107 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ed77a29b-31b2-412c-b1dd-47e5df5468d6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:21.960126 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ed77a29b-31b2-412c-b1dd-47e5df5468d6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:21.967577 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ed77a29b-31b2-412c-b1dd-47e5df5468d6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:21.968092 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ed77a29b-31b2-412c-b1dd-47e5df5468d6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:21.968899 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ed77a29b-31b2-412c-b1dd-47e5df5468d6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:21.969329 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ed77a29b-31b2-412c-b1dd-47e5df5468d6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:22.000940 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ed77a29b-31b2-412c-b1dd-47e5df5468d6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046026 May 03 08:58:22.001754 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 251/492] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:21 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:22.092882 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c7d92890-92b1-4437-8ea6-890b27f8ab3a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:22.094327 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c7d92890-92b1-4437-8ea6-890b27f8ab3a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:22.101150 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c7d92890-92b1-4437-8ea6-890b27f8ab3a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:22.101602 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c7d92890-92b1-4437-8ea6-890b27f8ab3a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:22.102377 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c7d92890-92b1-4437-8ea6-890b27f8ab3a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:22.102808 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c7d92890-92b1-4437-8ea6-890b27f8ab3a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:22.279253 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c7d92890-92b1-4437-8ea6-890b27f8ab3a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:22.288437 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c7d92890-92b1-4437-8ea6-890b27f8ab3a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1577 microversion: 2.1 time: 0.200428 May 03 08:58:22.289029 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 242/493] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:22 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1577 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:58:23.013410 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-67eb6edc-36c2-43f1-b07d-a8ca64c9d1d7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:23.014373 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-67eb6edc-36c2-43f1-b07d-a8ca64c9d1d7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:23.021112 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-67eb6edc-36c2-43f1-b07d-a8ca64c9d1d7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:23.021648 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-67eb6edc-36c2-43f1-b07d-a8ca64c9d1d7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:23.022507 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-67eb6edc-36c2-43f1-b07d-a8ca64c9d1d7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:23.022943 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-67eb6edc-36c2-43f1-b07d-a8ca64c9d1d7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:23.054487 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-67eb6edc-36c2-43f1-b07d-a8ca64c9d1d7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045453 May 03 08:58:23.055066 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 252/494] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:23 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:23.272393 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-94a9fe07-22d5-4407-888f-4893226c4762 req-cb69f235-c8ad-4fed-bc95-dbb78d8ab27b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "512c1f04-399e-4647-8bfe-f2c295397df2", "tag": "fa2818f3-6dd4-4c2e-8c03-d124c2ac8ac8"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:58:23.281125 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-94a9fe07-22d5-4407-888f-4893226c4762 req-cb69f235-c8ad-4fed-bc95-dbb78d8ab27b service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:23.281642 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-94a9fe07-22d5-4407-888f-4893226c4762 req-cb69f235-c8ad-4fed-bc95-dbb78d8ab27b service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:23.292588 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-94a9fe07-22d5-4407-888f-4893226c4762 req-cb69f235-c8ad-4fed-bc95-dbb78d8ab27b service nova] Creating event network-changed:fa2818f3-6dd4-4c2e-8c03-d124c2ac8ac8 for instance 512c1f04-399e-4647-8bfe-f2c295397df2 on hv-cinder-84027 May 03 08:58:23.297578 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-94a9fe07-22d5-4407-888f-4893226c4762 req-cb69f235-c8ad-4fed-bc95-dbb78d8ab27b service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029832 May 03 08:58:23.298182 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 243/495] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 08:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:58:23.305641 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-56ecbc1c-ba06-4713-beef-902816f6d67d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:23.306790 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-56ecbc1c-ba06-4713-beef-902816f6d67d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:23.313067 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-56ecbc1c-ba06-4713-beef-902816f6d67d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:23.313637 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-56ecbc1c-ba06-4713-beef-902816f6d67d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:23.314510 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-56ecbc1c-ba06-4713-beef-902816f6d67d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:23.315043 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-56ecbc1c-ba06-4713-beef-902816f6d67d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:23.591789 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-56ecbc1c-ba06-4713-beef-902816f6d67d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:23.600507 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-56ecbc1c-ba06-4713-beef-902816f6d67d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1577 microversion: 2.1 time: 0.298735 May 03 08:58:23.601116 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 253/496] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:23 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1577 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:58:24.067840 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-75695b4b-866b-4225-af17-4932ac6870f4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:24.069353 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-75695b4b-866b-4225-af17-4932ac6870f4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:24.077104 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-75695b4b-866b-4225-af17-4932ac6870f4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:24.077547 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-75695b4b-866b-4225-af17-4932ac6870f4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:24.078308 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-75695b4b-866b-4225-af17-4932ac6870f4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:24.078741 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-75695b4b-866b-4225-af17-4932ac6870f4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:24.125795 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-75695b4b-866b-4225-af17-4932ac6870f4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062266 May 03 08:58:24.133403 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 244/497] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:24 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:24.618565 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a90da23d-452d-41ed-8f26-0100d644f6da tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:24.619213 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a90da23d-452d-41ed-8f26-0100d644f6da tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:24.625939 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a90da23d-452d-41ed-8f26-0100d644f6da tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:24.626619 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a90da23d-452d-41ed-8f26-0100d644f6da tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:24.627411 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a90da23d-452d-41ed-8f26-0100d644f6da tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:24.627876 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a90da23d-452d-41ed-8f26-0100d644f6da tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:24.694431 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a90da23d-452d-41ed-8f26-0100d644f6da tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:24.703063 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a90da23d-452d-41ed-8f26-0100d644f6da tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.088426 May 03 08:58:24.703991 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 254/498] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:24 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:58:25.141088 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b0a997be-ae0b-450b-85de-58897724b98b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:25.142826 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b0a997be-ae0b-450b-85de-58897724b98b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:25.149667 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b0a997be-ae0b-450b-85de-58897724b98b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:25.150202 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b0a997be-ae0b-450b-85de-58897724b98b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:25.150990 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b0a997be-ae0b-450b-85de-58897724b98b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:25.151432 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b0a997be-ae0b-450b-85de-58897724b98b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:25.186766 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b0a997be-ae0b-450b-85de-58897724b98b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049800 May 03 08:58:25.187355 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 245/499] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:25 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:25.317811 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [req-2a115554-a1d1-4dd6-a102-9a0d3c338230 req-b86f10d1-094a-4538-b56c-b1db2ab62857 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a53f83a8-c719-47a0-969f-5b1305f839df", "name": "network-vif-deleted", "tag": "4e301bfe-acfc-48d5-af98-78513570286c"}]} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 08:58:25.326386 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-2a115554-a1d1-4dd6-a102-9a0d3c338230 req-b86f10d1-094a-4538-b56c-b1db2ab62857 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:25.326826 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-2a115554-a1d1-4dd6-a102-9a0d3c338230 req-b86f10d1-094a-4538-b56c-b1db2ab62857 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:25.338768 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.compute.server_external_events [req-2a115554-a1d1-4dd6-a102-9a0d3c338230 req-b86f10d1-094a-4538-b56c-b1db2ab62857 service nova] Creating event network-vif-deleted:4e301bfe-acfc-48d5-af98-78513570286c for instance a53f83a8-c719-47a0-969f-5b1305f839df on hv-cinder-84027 May 03 08:58:25.343755 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [req-2a115554-a1d1-4dd6-a102-9a0d3c338230 req-b86f10d1-094a-4538-b56c-b1db2ab62857 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029714 May 03 08:58:25.344415 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 255/500] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 08:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 08:58:25.719927 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-384db2d9-00ae-41cc-bb42-1ff3d0714a56 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:25.720538 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-384db2d9-00ae-41cc-bb42-1ff3d0714a56 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:25.727820 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-384db2d9-00ae-41cc-bb42-1ff3d0714a56 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:25.728497 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-384db2d9-00ae-41cc-bb42-1ff3d0714a56 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:25.729256 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-384db2d9-00ae-41cc-bb42-1ff3d0714a56 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:25.729726 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-384db2d9-00ae-41cc-bb42-1ff3d0714a56 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:25.793028 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-384db2d9-00ae-41cc-bb42-1ff3d0714a56 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:25.803639 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-384db2d9-00ae-41cc-bb42-1ff3d0714a56 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.087511 May 03 08:58:25.804288 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 246/501] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:25 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:58:26.199870 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-403fb914-3351-4b88-b836-36b18a49fd3b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:26.201124 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-403fb914-3351-4b88-b836-36b18a49fd3b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:26.207682 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-403fb914-3351-4b88-b836-36b18a49fd3b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:26.208243 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-403fb914-3351-4b88-b836-36b18a49fd3b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:26.209031 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-403fb914-3351-4b88-b836-36b18a49fd3b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:26.209470 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-403fb914-3351-4b88-b836-36b18a49fd3b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:26.246845 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-403fb914-3351-4b88-b836-36b18a49fd3b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051906 May 03 08:58:26.247396 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 256/502] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:26 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:26.820850 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4b4e5f51-17de-4d3d-956d-51ef6ca3d7df tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:26.821451 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4b4e5f51-17de-4d3d-956d-51ef6ca3d7df tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:26.828162 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4b4e5f51-17de-4d3d-956d-51ef6ca3d7df tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:26.828602 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4b4e5f51-17de-4d3d-956d-51ef6ca3d7df tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:26.829354 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4b4e5f51-17de-4d3d-956d-51ef6ca3d7df tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:26.829777 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4b4e5f51-17de-4d3d-956d-51ef6ca3d7df tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:26.892815 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-4b4e5f51-17de-4d3d-956d-51ef6ca3d7df tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:26.900269 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-4b4e5f51-17de-4d3d-956d-51ef6ca3d7df tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.083356 May 03 08:58:26.900828 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 247/503] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:26 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:58:27.109163 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 08:58:27.109452 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: Tue May 3 08:58:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 03 08:58:27.263091 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b61acf96-74b1-4482-b77d-90f796666fab tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:27.264650 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b61acf96-74b1-4482-b77d-90f796666fab tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:27.276193 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b61acf96-74b1-4482-b77d-90f796666fab tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:27.276640 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b61acf96-74b1-4482-b77d-90f796666fab tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:27.277415 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b61acf96-74b1-4482-b77d-90f796666fab tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:27.277840 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b61acf96-74b1-4482-b77d-90f796666fab tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:27.307347 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b61acf96-74b1-4482-b77d-90f796666fab tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051021 May 03 08:58:27.307960 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 257/504] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:27 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:27.921596 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-02a89e63-08c5-415f-a3ba-0f828aa61cad tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:27.922582 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-02a89e63-08c5-415f-a3ba-0f828aa61cad tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:27.932572 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-02a89e63-08c5-415f-a3ba-0f828aa61cad tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:27.933019 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-02a89e63-08c5-415f-a3ba-0f828aa61cad tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:27.933784 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-02a89e63-08c5-415f-a3ba-0f828aa61cad tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:27.934219 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-02a89e63-08c5-415f-a3ba-0f828aa61cad tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:28.000125 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-02a89e63-08c5-415f-a3ba-0f828aa61cad tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:28.007942 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-02a89e63-08c5-415f-a3ba-0f828aa61cad tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.092745 May 03 08:58:28.008480 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 248/505] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:27 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:58:28.322221 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-be15d108-bf16-4eab-81bb-c28e279b8842 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:28.323137 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-be15d108-bf16-4eab-81bb-c28e279b8842 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:28.330121 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-be15d108-bf16-4eab-81bb-c28e279b8842 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:28.330564 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-be15d108-bf16-4eab-81bb-c28e279b8842 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:28.331319 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-be15d108-bf16-4eab-81bb-c28e279b8842 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:28.331797 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-be15d108-bf16-4eab-81bb-c28e279b8842 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:28.366631 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-be15d108-bf16-4eab-81bb-c28e279b8842 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049785 May 03 08:58:28.367337 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 258/506] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:28 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:29.027447 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-fb6f7cd8-f158-4815-85f0-64179b3e3ee6 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:29.028093 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-fb6f7cd8-f158-4815-85f0-64179b3e3ee6 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:29.034996 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fb6f7cd8-f158-4815-85f0-64179b3e3ee6 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:29.035445 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fb6f7cd8-f158-4815-85f0-64179b3e3ee6 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:29.036249 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fb6f7cd8-f158-4815-85f0-64179b3e3ee6 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:29.036680 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fb6f7cd8-f158-4815-85f0-64179b3e3ee6 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:29.100486 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-fb6f7cd8-f158-4815-85f0-64179b3e3ee6 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:29.108650 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-fb6f7cd8-f158-4815-85f0-64179b3e3ee6 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.086439 May 03 08:58:29.109221 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 249/507] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:29 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:58:29.384820 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-56dc9834-7812-4ce0-8551-d39181bb8c01 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:29.385854 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-56dc9834-7812-4ce0-8551-d39181bb8c01 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:29.394468 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-56dc9834-7812-4ce0-8551-d39181bb8c01 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:29.395089 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-56dc9834-7812-4ce0-8551-d39181bb8c01 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:29.396216 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-56dc9834-7812-4ce0-8551-d39181bb8c01 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:29.396762 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-56dc9834-7812-4ce0-8551-d39181bb8c01 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:29.426770 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-56dc9834-7812-4ce0-8551-d39181bb8c01 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048972 May 03 08:58:29.427544 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 259/508] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:29 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:30.129193 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-26715360-8b3e-469f-bf8f-dd753540484c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:30.130190 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-26715360-8b3e-469f-bf8f-dd753540484c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:30.138671 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-26715360-8b3e-469f-bf8f-dd753540484c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:30.139128 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-26715360-8b3e-469f-bf8f-dd753540484c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:30.139920 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-26715360-8b3e-469f-bf8f-dd753540484c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:30.140351 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-26715360-8b3e-469f-bf8f-dd753540484c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:30.201053 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-26715360-8b3e-469f-bf8f-dd753540484c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:30.208809 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-26715360-8b3e-469f-bf8f-dd753540484c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.086201 May 03 08:58:30.209390 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 250/509] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:30 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:58:30.442324 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-26f0bb09-7ddf-4424-bcb0-8003392d0736 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:30.443858 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-26f0bb09-7ddf-4424-bcb0-8003392d0736 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:30.454520 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-26f0bb09-7ddf-4424-bcb0-8003392d0736 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:30.455163 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-26f0bb09-7ddf-4424-bcb0-8003392d0736 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:30.456492 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-26f0bb09-7ddf-4424-bcb0-8003392d0736 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:30.457216 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-26f0bb09-7ddf-4424-bcb0-8003392d0736 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:30.488686 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-26f0bb09-7ddf-4424-bcb0-8003392d0736 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053086 May 03 08:58:30.489232 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 260/510] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:30 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:31.226135 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2897a52f-0431-4b6d-90d5-2326ada673dc tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:31.226750 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-2897a52f-0431-4b6d-90d5-2326ada673dc tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:31.233762 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2897a52f-0431-4b6d-90d5-2326ada673dc tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:31.234205 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2897a52f-0431-4b6d-90d5-2326ada673dc tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:31.234968 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2897a52f-0431-4b6d-90d5-2326ada673dc tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:31.235400 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2897a52f-0431-4b6d-90d5-2326ada673dc tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:31.297310 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2897a52f-0431-4b6d-90d5-2326ada673dc tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:31.305143 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-2897a52f-0431-4b6d-90d5-2326ada673dc tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.083078 May 03 08:58:31.305719 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 251/511] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:31 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:58:31.504481 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-73c74288-ce3b-44b4-9be1-a01f7e7cdc35 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:31.505957 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-73c74288-ce3b-44b4-9be1-a01f7e7cdc35 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:31.514071 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-73c74288-ce3b-44b4-9be1-a01f7e7cdc35 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:31.514488 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-73c74288-ce3b-44b4-9be1-a01f7e7cdc35 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:31.515245 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-73c74288-ce3b-44b4-9be1-a01f7e7cdc35 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:31.515673 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-73c74288-ce3b-44b4-9be1-a01f7e7cdc35 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:31.543940 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-73c74288-ce3b-44b4-9be1-a01f7e7cdc35 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046134 May 03 08:58:31.544466 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 261/512] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:31 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:32.322424 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-44cd8765-b3b9-4fab-aef7-f0d5f1551e47 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:32.322982 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-44cd8765-b3b9-4fab-aef7-f0d5f1551e47 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:32.329849 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-44cd8765-b3b9-4fab-aef7-f0d5f1551e47 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:32.330289 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-44cd8765-b3b9-4fab-aef7-f0d5f1551e47 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:32.331048 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-44cd8765-b3b9-4fab-aef7-f0d5f1551e47 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:32.331478 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-44cd8765-b3b9-4fab-aef7-f0d5f1551e47 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:32.394569 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-44cd8765-b3b9-4fab-aef7-f0d5f1551e47 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:32.402264 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-44cd8765-b3b9-4fab-aef7-f0d5f1551e47 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.084020 May 03 08:58:32.402827 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 252/513] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:32 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:58:32.561624 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-bfe993ac-4f88-475e-ab28-4a191cc1779d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:32.562970 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-bfe993ac-4f88-475e-ab28-4a191cc1779d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:32.573407 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bfe993ac-4f88-475e-ab28-4a191cc1779d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:32.574147 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bfe993ac-4f88-475e-ab28-4a191cc1779d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:32.575389 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bfe993ac-4f88-475e-ab28-4a191cc1779d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:32.576192 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bfe993ac-4f88-475e-ab28-4a191cc1779d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:32.610014 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-bfe993ac-4f88-475e-ab28-4a191cc1779d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056887 May 03 08:58:32.610547 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 262/514] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:32 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:33.423214 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4a1ee5d4-f424-4aff-bfb3-751eb189b548 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:33.424229 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4a1ee5d4-f424-4aff-bfb3-751eb189b548 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:33.433520 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4a1ee5d4-f424-4aff-bfb3-751eb189b548 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:33.433968 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4a1ee5d4-f424-4aff-bfb3-751eb189b548 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:33.434722 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4a1ee5d4-f424-4aff-bfb3-751eb189b548 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:33.435148 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4a1ee5d4-f424-4aff-bfb3-751eb189b548 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:33.504990 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-4a1ee5d4-f424-4aff-bfb3-751eb189b548 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:33.512501 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-4a1ee5d4-f424-4aff-bfb3-751eb189b548 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.095798 May 03 08:58:33.513062 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 253/515] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:33 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:58:33.625185 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f4539928-797e-4be5-af7b-952c6f6f7ae4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:33.626656 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f4539928-797e-4be5-af7b-952c6f6f7ae4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:33.636357 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f4539928-797e-4be5-af7b-952c6f6f7ae4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:33.636800 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f4539928-797e-4be5-af7b-952c6f6f7ae4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:33.637558 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f4539928-797e-4be5-af7b-952c6f6f7ae4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:33.637987 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f4539928-797e-4be5-af7b-952c6f6f7ae4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:33.666325 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f4539928-797e-4be5-af7b-952c6f6f7ae4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047893 May 03 08:58:33.666858 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 263/516] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:33 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:34.533477 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-331f4001-b04a-45b8-b847-6d922b75f2b2 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:34.534353 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-331f4001-b04a-45b8-b847-6d922b75f2b2 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:34.543018 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-331f4001-b04a-45b8-b847-6d922b75f2b2 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:34.543462 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-331f4001-b04a-45b8-b847-6d922b75f2b2 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:34.544287 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-331f4001-b04a-45b8-b847-6d922b75f2b2 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:34.544717 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-331f4001-b04a-45b8-b847-6d922b75f2b2 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:34.614202 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-331f4001-b04a-45b8-b847-6d922b75f2b2 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:34.622219 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-331f4001-b04a-45b8-b847-6d922b75f2b2 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.095416 May 03 08:58:34.622791 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 254/517] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:34 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:58:34.682196 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d67889f5-b347-4ad6-bae8-d91dc3ea100d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:34.683394 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d67889f5-b347-4ad6-bae8-d91dc3ea100d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:34.692154 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d67889f5-b347-4ad6-bae8-d91dc3ea100d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:34.692794 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d67889f5-b347-4ad6-bae8-d91dc3ea100d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:34.693805 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d67889f5-b347-4ad6-bae8-d91dc3ea100d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:34.694384 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d67889f5-b347-4ad6-bae8-d91dc3ea100d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:34.728339 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d67889f5-b347-4ad6-bae8-d91dc3ea100d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052817 May 03 08:58:34.728877 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 264/518] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:34 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:35.640146 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ac73d821-2771-461d-9235-8302abedb809 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:35.640902 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ac73d821-2771-461d-9235-8302abedb809 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:35.649222 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ac73d821-2771-461d-9235-8302abedb809 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:35.649868 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ac73d821-2771-461d-9235-8302abedb809 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:35.650631 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ac73d821-2771-461d-9235-8302abedb809 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:35.651057 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ac73d821-2771-461d-9235-8302abedb809 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:35.713841 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ac73d821-2771-461d-9235-8302abedb809 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:35.722086 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ac73d821-2771-461d-9235-8302abedb809 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.086851 May 03 08:58:35.722649 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 255/519] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:35 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:58:35.743904 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-0a1d9701-3b71-44b5-bdfd-f7c0f797b229 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:35.744832 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-0a1d9701-3b71-44b5-bdfd-f7c0f797b229 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:35.751585 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0a1d9701-3b71-44b5-bdfd-f7c0f797b229 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:35.752069 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0a1d9701-3b71-44b5-bdfd-f7c0f797b229 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:35.752843 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0a1d9701-3b71-44b5-bdfd-f7c0f797b229 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:35.753277 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0a1d9701-3b71-44b5-bdfd-f7c0f797b229 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:35.782586 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-0a1d9701-3b71-44b5-bdfd-f7c0f797b229 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045187 May 03 08:58:35.783134 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 265/520] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:35 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:36.742468 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-fb1fabfe-17f4-49ca-9786-68826fd9a63e tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:36.743468 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-fb1fabfe-17f4-49ca-9786-68826fd9a63e tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:36.754063 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fb1fabfe-17f4-49ca-9786-68826fd9a63e tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:36.754816 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fb1fabfe-17f4-49ca-9786-68826fd9a63e tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:36.756121 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fb1fabfe-17f4-49ca-9786-68826fd9a63e tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:36.756844 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fb1fabfe-17f4-49ca-9786-68826fd9a63e tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:36.794724 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b6f94284-4083-4ae9-81d5-d8092207979d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:36.795573 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b6f94284-4083-4ae9-81d5-d8092207979d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:36.802056 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b6f94284-4083-4ae9-81d5-d8092207979d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:36.802499 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b6f94284-4083-4ae9-81d5-d8092207979d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:36.803284 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b6f94284-4083-4ae9-81d5-d8092207979d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:36.803695 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b6f94284-4083-4ae9-81d5-d8092207979d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:36.833723 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b6f94284-4083-4ae9-81d5-d8092207979d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043458 May 03 08:58:36.834292 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 266/521] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:36 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:36.873031 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-fb1fabfe-17f4-49ca-9786-68826fd9a63e tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:36.880792 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-fb1fabfe-17f4-49ca-9786-68826fd9a63e tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.145009 May 03 08:58:36.881365 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 256/522] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:36 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:58:37.846158 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a0b2a205-610f-48b9-a5d5-01754912d6a5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:37.847088 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a0b2a205-610f-48b9-a5d5-01754912d6a5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:37.853740 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a0b2a205-610f-48b9-a5d5-01754912d6a5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:37.854177 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a0b2a205-610f-48b9-a5d5-01754912d6a5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:37.854939 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a0b2a205-610f-48b9-a5d5-01754912d6a5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:37.855369 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a0b2a205-610f-48b9-a5d5-01754912d6a5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:37.884081 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a0b2a205-610f-48b9-a5d5-01754912d6a5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042404 May 03 08:58:37.884672 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 267/523] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:37 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:37.898221 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7b86236c-23e3-4db9-a346-2b89676df89a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:37.898846 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7b86236c-23e3-4db9-a346-2b89676df89a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:37.905734 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7b86236c-23e3-4db9-a346-2b89676df89a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:37.906211 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7b86236c-23e3-4db9-a346-2b89676df89a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:37.906967 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7b86236c-23e3-4db9-a346-2b89676df89a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:37.907397 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7b86236c-23e3-4db9-a346-2b89676df89a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:37.976439 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7b86236c-23e3-4db9-a346-2b89676df89a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:37.984182 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7b86236c-23e3-4db9-a346-2b89676df89a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.089875 May 03 08:58:37.984786 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 257/524] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:37 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:58:38.900581 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-47d19729-dbc7-45f0-a474-4e2e1419a7a1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:38.902109 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-47d19729-dbc7-45f0-a474-4e2e1419a7a1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:38.912794 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-47d19729-dbc7-45f0-a474-4e2e1419a7a1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:38.913525 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-47d19729-dbc7-45f0-a474-4e2e1419a7a1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:38.914779 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-47d19729-dbc7-45f0-a474-4e2e1419a7a1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:38.915491 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-47d19729-dbc7-45f0-a474-4e2e1419a7a1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:38.944614 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-47d19729-dbc7-45f0-a474-4e2e1419a7a1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050808 May 03 08:58:38.945151 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 268/525] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:38 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:39.005047 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-148acf22-c8bf-492c-b42c-888bacaec775 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:39.006054 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-148acf22-c8bf-492c-b42c-888bacaec775 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:39.014324 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-148acf22-c8bf-492c-b42c-888bacaec775 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:39.014775 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-148acf22-c8bf-492c-b42c-888bacaec775 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:39.015537 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-148acf22-c8bf-492c-b42c-888bacaec775 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:39.016011 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-148acf22-c8bf-492c-b42c-888bacaec775 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:39.089532 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-148acf22-c8bf-492c-b42c-888bacaec775 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:39.097743 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-148acf22-c8bf-492c-b42c-888bacaec775 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.099271 May 03 08:58:39.098326 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 258/526] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:38 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:58:39.962155 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-dc47b632-3adb-4a10-a0f6-61491715b705 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:39.963390 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-dc47b632-3adb-4a10-a0f6-61491715b705 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:39.971156 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dc47b632-3adb-4a10-a0f6-61491715b705 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:39.971597 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dc47b632-3adb-4a10-a0f6-61491715b705 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:39.972387 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dc47b632-3adb-4a10-a0f6-61491715b705 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:39.972814 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dc47b632-3adb-4a10-a0f6-61491715b705 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:40.005212 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-dc47b632-3adb-4a10-a0f6-61491715b705 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049999 May 03 08:58:40.005783 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 269/527] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:39 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:40.115981 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-aa5613df-1aa6-4d47-a88b-8b6ff383b1c3 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:40.116643 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-aa5613df-1aa6-4d47-a88b-8b6ff383b1c3 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:40.123803 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aa5613df-1aa6-4d47-a88b-8b6ff383b1c3 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:40.124288 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aa5613df-1aa6-4d47-a88b-8b6ff383b1c3 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:40.125045 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aa5613df-1aa6-4d47-a88b-8b6ff383b1c3 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:40.125471 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aa5613df-1aa6-4d47-a88b-8b6ff383b1c3 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:40.191894 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-aa5613df-1aa6-4d47-a88b-8b6ff383b1c3 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:40.199672 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-aa5613df-1aa6-4d47-a88b-8b6ff383b1c3 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.088323 May 03 08:58:40.200276 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 259/528] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:40 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:58:41.021394 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-bcc004a1-19fa-4eb0-8884-5803e4305f3f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:41.022822 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-bcc004a1-19fa-4eb0-8884-5803e4305f3f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:41.033366 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bcc004a1-19fa-4eb0-8884-5803e4305f3f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:41.034109 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bcc004a1-19fa-4eb0-8884-5803e4305f3f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:41.035357 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bcc004a1-19fa-4eb0-8884-5803e4305f3f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:41.036125 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bcc004a1-19fa-4eb0-8884-5803e4305f3f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:41.067107 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-bcc004a1-19fa-4eb0-8884-5803e4305f3f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052464 May 03 08:58:41.067639 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 270/529] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:41 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:41.221284 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-17a632d3-faf1-4453-8961-0a4575d2ad07 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:41.222295 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-17a632d3-faf1-4453-8961-0a4575d2ad07 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:41.231242 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-17a632d3-faf1-4453-8961-0a4575d2ad07 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:41.231689 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-17a632d3-faf1-4453-8961-0a4575d2ad07 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:41.232499 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-17a632d3-faf1-4453-8961-0a4575d2ad07 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:41.232933 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-17a632d3-faf1-4453-8961-0a4575d2ad07 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:41.293448 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-17a632d3-faf1-4453-8961-0a4575d2ad07 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:41.301022 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-17a632d3-faf1-4453-8961-0a4575d2ad07 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.086761 May 03 08:58:41.301584 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 260/530] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:41 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:58:42.083249 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-87c5e865-14ce-40fe-a810-de64c9b9cb77 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:42.084768 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-87c5e865-14ce-40fe-a810-de64c9b9cb77 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:42.096041 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-87c5e865-14ce-40fe-a810-de64c9b9cb77 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:42.096791 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-87c5e865-14ce-40fe-a810-de64c9b9cb77 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:42.098154 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-87c5e865-14ce-40fe-a810-de64c9b9cb77 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:42.098964 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-87c5e865-14ce-40fe-a810-de64c9b9cb77 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:42.130143 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-87c5e865-14ce-40fe-a810-de64c9b9cb77 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053552 May 03 08:58:42.130705 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 271/531] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:42 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:42.318238 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-960a7963-d45c-4680-aa0c-cfff7cc5f2d0 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:42.318823 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-960a7963-d45c-4680-aa0c-cfff7cc5f2d0 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:42.324880 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-960a7963-d45c-4680-aa0c-cfff7cc5f2d0 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:42.325325 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-960a7963-d45c-4680-aa0c-cfff7cc5f2d0 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:42.326083 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-960a7963-d45c-4680-aa0c-cfff7cc5f2d0 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:42.326513 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-960a7963-d45c-4680-aa0c-cfff7cc5f2d0 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:42.389692 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-960a7963-d45c-4680-aa0c-cfff7cc5f2d0 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:42.397305 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-960a7963-d45c-4680-aa0c-cfff7cc5f2d0 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.083078 May 03 08:58:42.397868 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 261/532] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:42 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:58:43.146309 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-0e0e6697-da1e-48fa-9bfc-179c6b691ad3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:43.147833 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-0e0e6697-da1e-48fa-9bfc-179c6b691ad3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:43.155322 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0e0e6697-da1e-48fa-9bfc-179c6b691ad3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:43.155797 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0e0e6697-da1e-48fa-9bfc-179c6b691ad3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:43.156554 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0e0e6697-da1e-48fa-9bfc-179c6b691ad3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:43.156980 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0e0e6697-da1e-48fa-9bfc-179c6b691ad3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:43.185627 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-0e0e6697-da1e-48fa-9bfc-179c6b691ad3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045955 May 03 08:58:43.186164 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 272/533] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:43 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:43.417629 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-25cbe49c-e645-4d1b-8c9d-6f46953dddc7 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:43.418289 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-25cbe49c-e645-4d1b-8c9d-6f46953dddc7 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:43.426341 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-25cbe49c-e645-4d1b-8c9d-6f46953dddc7 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:43.426894 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-25cbe49c-e645-4d1b-8c9d-6f46953dddc7 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:43.427872 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-25cbe49c-e645-4d1b-8c9d-6f46953dddc7 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:43.428403 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-25cbe49c-e645-4d1b-8c9d-6f46953dddc7 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:43.498135 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-25cbe49c-e645-4d1b-8c9d-6f46953dddc7 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:43.505622 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-25cbe49c-e645-4d1b-8c9d-6f46953dddc7 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.094144 May 03 08:58:43.506187 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 262/534] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:43 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:58:43.547049 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 08:58:43.547240 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: Tue May 3 08:58:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 03 08:58:44.200645 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3bddc787-2bfe-408c-b402-285562543f5d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:44.201783 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-3bddc787-2bfe-408c-b402-285562543f5d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:44.210168 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3bddc787-2bfe-408c-b402-285562543f5d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:44.210725 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3bddc787-2bfe-408c-b402-285562543f5d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:44.211966 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3bddc787-2bfe-408c-b402-285562543f5d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:44.212813 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3bddc787-2bfe-408c-b402-285562543f5d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:44.245740 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-3bddc787-2bfe-408c-b402-285562543f5d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050733 May 03 08:58:44.246294 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 273/535] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:44 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:44.526565 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-039a87ce-517e-43a8-a3cd-8691fd1145ff tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:44.527294 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-039a87ce-517e-43a8-a3cd-8691fd1145ff tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:44.536657 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-039a87ce-517e-43a8-a3cd-8691fd1145ff tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:44.537251 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-039a87ce-517e-43a8-a3cd-8691fd1145ff tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:44.538268 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-039a87ce-517e-43a8-a3cd-8691fd1145ff tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:44.538883 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-039a87ce-517e-43a8-a3cd-8691fd1145ff tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:44.614377 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-039a87ce-517e-43a8-a3cd-8691fd1145ff tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:44.623742 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-039a87ce-517e-43a8-a3cd-8691fd1145ff tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.103565 May 03 08:58:44.624348 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 263/536] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:44 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:58:45.259721 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-50941919-7456-45e6-ac52-7e8822fc4b63 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:45.261021 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-50941919-7456-45e6-ac52-7e8822fc4b63 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:45.269704 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-50941919-7456-45e6-ac52-7e8822fc4b63 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:45.270379 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-50941919-7456-45e6-ac52-7e8822fc4b63 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:45.271449 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-50941919-7456-45e6-ac52-7e8822fc4b63 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:45.272268 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-50941919-7456-45e6-ac52-7e8822fc4b63 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:45.302250 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-50941919-7456-45e6-ac52-7e8822fc4b63 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047834 May 03 08:58:45.302797 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 274/537] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:45 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:45.640625 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2d99cac4-c86b-4dbd-bc5b-b7f21d8016fe tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:45.641227 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-2d99cac4-c86b-4dbd-bc5b-b7f21d8016fe tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:45.648043 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2d99cac4-c86b-4dbd-bc5b-b7f21d8016fe tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:45.648486 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2d99cac4-c86b-4dbd-bc5b-b7f21d8016fe tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:45.649243 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2d99cac4-c86b-4dbd-bc5b-b7f21d8016fe tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:45.649670 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2d99cac4-c86b-4dbd-bc5b-b7f21d8016fe tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:45.715069 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2d99cac4-c86b-4dbd-bc5b-b7f21d8016fe tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:45.722867 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-2d99cac4-c86b-4dbd-bc5b-b7f21d8016fe tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.086250 May 03 08:58:45.723425 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 264/538] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:45 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:58:46.319483 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-25f44249-00fc-4abc-ab90-0cb5fb451222 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:46.321410 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-25f44249-00fc-4abc-ab90-0cb5fb451222 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:46.329731 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-25f44249-00fc-4abc-ab90-0cb5fb451222 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:46.330169 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-25f44249-00fc-4abc-ab90-0cb5fb451222 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:46.330932 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-25f44249-00fc-4abc-ab90-0cb5fb451222 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:46.331364 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-25f44249-00fc-4abc-ab90-0cb5fb451222 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:46.360772 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-25f44249-00fc-4abc-ab90-0cb5fb451222 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048869 May 03 08:58:46.361316 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 275/539] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:46 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:46.739407 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b3322267-3527-48a5-bbdc-e6bbefb87fdf tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:46.740030 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b3322267-3527-48a5-bbdc-e6bbefb87fdf tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:46.746807 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b3322267-3527-48a5-bbdc-e6bbefb87fdf tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:46.747255 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b3322267-3527-48a5-bbdc-e6bbefb87fdf tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:46.748052 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b3322267-3527-48a5-bbdc-e6bbefb87fdf tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:46.748490 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b3322267-3527-48a5-bbdc-e6bbefb87fdf tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:46.819808 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b3322267-3527-48a5-bbdc-e6bbefb87fdf tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:46.827368 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b3322267-3527-48a5-bbdc-e6bbefb87fdf tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.091959 May 03 08:58:46.827959 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 265/540] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:46 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:58:47.377126 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c6c2053e-eeaa-47fc-8b98-c55900ae1b29 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:47.378588 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c6c2053e-eeaa-47fc-8b98-c55900ae1b29 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:47.389075 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c6c2053e-eeaa-47fc-8b98-c55900ae1b29 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:47.389806 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c6c2053e-eeaa-47fc-8b98-c55900ae1b29 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:47.391048 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c6c2053e-eeaa-47fc-8b98-c55900ae1b29 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:47.391736 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c6c2053e-eeaa-47fc-8b98-c55900ae1b29 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:47.424238 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c6c2053e-eeaa-47fc-8b98-c55900ae1b29 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053683 May 03 08:58:47.424788 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 276/541] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:47 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 03 08:58:47.848368 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c7c04e24-fec5-4abc-afe3-488015d6437a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:47.849349 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c7c04e24-fec5-4abc-afe3-488015d6437a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:47.857586 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c7c04e24-fec5-4abc-afe3-488015d6437a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:47.858034 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c7c04e24-fec5-4abc-afe3-488015d6437a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:47.858798 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c7c04e24-fec5-4abc-afe3-488015d6437a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:47.859252 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c7c04e24-fec5-4abc-afe3-488015d6437a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:47.928028 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c7c04e24-fec5-4abc-afe3-488015d6437a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:47.936130 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c7c04e24-fec5-4abc-afe3-488015d6437a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.094552 May 03 08:58:47.936696 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 266/542] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:47 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:58:48.440919 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-fcd87b6c-9ca6-44c6-b987-d49b1ae94e82 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:48.442403 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-fcd87b6c-9ca6-44c6-b987-d49b1ae94e82 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:48.451984 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fcd87b6c-9ca6-44c6-b987-d49b1ae94e82 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:48.452441 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fcd87b6c-9ca6-44c6-b987-d49b1ae94e82 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:48.453216 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fcd87b6c-9ca6-44c6-b987-d49b1ae94e82 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:48.453649 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fcd87b6c-9ca6-44c6-b987-d49b1ae94e82 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:48.483501 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-fcd87b6c-9ca6-44c6-b987-d49b1ae94e82 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049608 May 03 08:58:48.484007 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 277/543] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:48 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:48.956811 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-dda30700-562b-4df6-948a-760f4b0f4868 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:48.957817 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-dda30700-562b-4df6-948a-760f4b0f4868 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:48.967048 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dda30700-562b-4df6-948a-760f4b0f4868 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:48.967497 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dda30700-562b-4df6-948a-760f4b0f4868 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:48.968295 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dda30700-562b-4df6-948a-760f4b0f4868 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:48.968730 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dda30700-562b-4df6-948a-760f4b0f4868 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:49.042028 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-dda30700-562b-4df6-948a-760f4b0f4868 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:49.051968 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-dda30700-562b-4df6-948a-760f4b0f4868 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.101387 May 03 08:58:49.052761 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 267/544] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:48 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:58:49.500603 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-951f0a98-6675-4364-8772-c3ca11db9efa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:49.502025 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-951f0a98-6675-4364-8772-c3ca11db9efa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:49.512782 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-951f0a98-6675-4364-8772-c3ca11db9efa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:49.513240 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-951f0a98-6675-4364-8772-c3ca11db9efa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:49.514016 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-951f0a98-6675-4364-8772-c3ca11db9efa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:49.514455 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-951f0a98-6675-4364-8772-c3ca11db9efa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:49.544454 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-951f0a98-6675-4364-8772-c3ca11db9efa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051456 May 03 08:58:49.545026 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 278/545] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:49 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:50.074871 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ad6b20f0-9a86-41cb-ae99-66ff2b9f951a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:50.075757 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ad6b20f0-9a86-41cb-ae99-66ff2b9f951a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:50.084046 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ad6b20f0-9a86-41cb-ae99-66ff2b9f951a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:50.084668 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ad6b20f0-9a86-41cb-ae99-66ff2b9f951a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:50.085676 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ad6b20f0-9a86-41cb-ae99-66ff2b9f951a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:50.086223 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ad6b20f0-9a86-41cb-ae99-66ff2b9f951a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:50.151143 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ad6b20f0-9a86-41cb-ae99-66ff2b9f951a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:50.159040 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ad6b20f0-9a86-41cb-ae99-66ff2b9f951a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.090838 May 03 08:58:50.159606 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 268/546] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:50 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:58:50.561271 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-6e82dde1-c311-4915-8e01-2c86aaa4bee0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:50.562739 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-6e82dde1-c311-4915-8e01-2c86aaa4bee0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:50.573313 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6e82dde1-c311-4915-8e01-2c86aaa4bee0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:50.574047 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6e82dde1-c311-4915-8e01-2c86aaa4bee0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:50.575288 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6e82dde1-c311-4915-8e01-2c86aaa4bee0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:50.576039 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6e82dde1-c311-4915-8e01-2c86aaa4bee0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:50.611223 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-6e82dde1-c311-4915-8e01-2c86aaa4bee0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056917 May 03 08:58:50.611796 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 279/547] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:50 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:51.177855 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4757b740-8b61-4a8a-9b5c-38c2e004e713 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:51.178552 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4757b740-8b61-4a8a-9b5c-38c2e004e713 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:51.186146 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4757b740-8b61-4a8a-9b5c-38c2e004e713 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:51.186592 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4757b740-8b61-4a8a-9b5c-38c2e004e713 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:51.187344 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4757b740-8b61-4a8a-9b5c-38c2e004e713 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:51.187799 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4757b740-8b61-4a8a-9b5c-38c2e004e713 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:51.251331 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-4757b740-8b61-4a8a-9b5c-38c2e004e713 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:51.259462 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-4757b740-8b61-4a8a-9b5c-38c2e004e713 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.086282 May 03 08:58:51.260073 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 269/548] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:51 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:58:51.627026 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ceabc983-b09d-497d-98a5-1668fd879a21 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:51.628564 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ceabc983-b09d-497d-98a5-1668fd879a21 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:51.638618 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ceabc983-b09d-497d-98a5-1668fd879a21 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:51.639062 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ceabc983-b09d-497d-98a5-1668fd879a21 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:51.639929 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ceabc983-b09d-497d-98a5-1668fd879a21 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:51.640366 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ceabc983-b09d-497d-98a5-1668fd879a21 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:51.668914 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ceabc983-b09d-497d-98a5-1668fd879a21 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048628 May 03 08:58:51.669459 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 280/549] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:51 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:52.279858 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-37b44810-ebfb-4e8e-8189-e8e03f6b3c7a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:52.280864 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-37b44810-ebfb-4e8e-8189-e8e03f6b3c7a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:52.291534 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-37b44810-ebfb-4e8e-8189-e8e03f6b3c7a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:52.292731 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-37b44810-ebfb-4e8e-8189-e8e03f6b3c7a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:52.294026 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-37b44810-ebfb-4e8e-8189-e8e03f6b3c7a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:52.294812 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-37b44810-ebfb-4e8e-8189-e8e03f6b3c7a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:52.356829 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-37b44810-ebfb-4e8e-8189-e8e03f6b3c7a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:52.364552 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-37b44810-ebfb-4e8e-8189-e8e03f6b3c7a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.091156 May 03 08:58:52.365117 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 270/550] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:52 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:58:52.685279 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-2d1cc7d5-084b-4cfb-85fc-b42026a6a89a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:52.686690 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-2d1cc7d5-084b-4cfb-85fc-b42026a6a89a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:52.693786 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2d1cc7d5-084b-4cfb-85fc-b42026a6a89a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:52.694263 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2d1cc7d5-084b-4cfb-85fc-b42026a6a89a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:52.695086 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2d1cc7d5-084b-4cfb-85fc-b42026a6a89a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:52.695547 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2d1cc7d5-084b-4cfb-85fc-b42026a6a89a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:52.734205 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-2d1cc7d5-084b-4cfb-85fc-b42026a6a89a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055793 May 03 08:58:52.734771 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 281/551] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:52 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:53.383596 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b3b4ac22-edcf-412d-88d8-4123c3971445 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:53.384426 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b3b4ac22-edcf-412d-88d8-4123c3971445 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:53.392642 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b3b4ac22-edcf-412d-88d8-4123c3971445 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:53.393190 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b3b4ac22-edcf-412d-88d8-4123c3971445 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:53.394143 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b3b4ac22-edcf-412d-88d8-4123c3971445 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:53.394666 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b3b4ac22-edcf-412d-88d8-4123c3971445 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:53.464377 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b3b4ac22-edcf-412d-88d8-4123c3971445 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:53.472873 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b3b4ac22-edcf-412d-88d8-4123c3971445 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.094133 May 03 08:58:53.473434 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 271/552] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:53 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:58:53.750329 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d5ae97ed-9148-4db5-9a29-67444a2a2fd5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:53.751678 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d5ae97ed-9148-4db5-9a29-67444a2a2fd5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:53.762583 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d5ae97ed-9148-4db5-9a29-67444a2a2fd5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:53.763331 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d5ae97ed-9148-4db5-9a29-67444a2a2fd5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:53.764629 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d5ae97ed-9148-4db5-9a29-67444a2a2fd5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:53.765076 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d5ae97ed-9148-4db5-9a29-67444a2a2fd5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:53.793973 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d5ae97ed-9148-4db5-9a29-67444a2a2fd5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050438 May 03 08:58:53.794532 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 282/553] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:53 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:54.494354 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-bcfc2734-636d-4583-8919-a88b42809ba8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:54.495209 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-bcfc2734-636d-4583-8919-a88b42809ba8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:54.505511 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bcfc2734-636d-4583-8919-a88b42809ba8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:54.506275 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bcfc2734-636d-4583-8919-a88b42809ba8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:54.507530 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bcfc2734-636d-4583-8919-a88b42809ba8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:54.508299 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bcfc2734-636d-4583-8919-a88b42809ba8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:54.574767 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-bcfc2734-636d-4583-8919-a88b42809ba8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:54.582622 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-bcfc2734-636d-4583-8919-a88b42809ba8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.095392 May 03 08:58:54.583188 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 272/554] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:54 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:58:54.806238 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-78d85956-1634-47b3-9f49-dbcbb5482f7a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:54.807159 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-78d85956-1634-47b3-9f49-dbcbb5482f7a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:54.814216 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-78d85956-1634-47b3-9f49-dbcbb5482f7a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:54.814668 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-78d85956-1634-47b3-9f49-dbcbb5482f7a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:54.815482 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-78d85956-1634-47b3-9f49-dbcbb5482f7a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:54.815933 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-78d85956-1634-47b3-9f49-dbcbb5482f7a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:54.844324 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-78d85956-1634-47b3-9f49-dbcbb5482f7a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042155 May 03 08:58:54.845278 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 283/555] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:54 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:55.603291 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e5bf12af-cf55-4ae9-901a-6bcda5d77d6e tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:55.604239 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e5bf12af-cf55-4ae9-901a-6bcda5d77d6e tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:55.614919 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e5bf12af-cf55-4ae9-901a-6bcda5d77d6e tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:55.615664 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e5bf12af-cf55-4ae9-901a-6bcda5d77d6e tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:55.617059 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e5bf12af-cf55-4ae9-901a-6bcda5d77d6e tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:55.618144 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e5bf12af-cf55-4ae9-901a-6bcda5d77d6e tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:55.682582 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e5bf12af-cf55-4ae9-901a-6bcda5d77d6e tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:55.690255 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e5bf12af-cf55-4ae9-901a-6bcda5d77d6e tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.093522 May 03 08:58:55.690829 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 273/556] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:55 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:58:55.758157 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 08:58:55.758399 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: Tue May 3 08:58:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 03 08:58:55.860217 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ad0c43df-3d53-49b5-b8dd-1b935fbb6c06 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:55.861138 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ad0c43df-3d53-49b5-b8dd-1b935fbb6c06 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:55.868267 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ad0c43df-3d53-49b5-b8dd-1b935fbb6c06 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:55.868754 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ad0c43df-3d53-49b5-b8dd-1b935fbb6c06 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:55.869604 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ad0c43df-3d53-49b5-b8dd-1b935fbb6c06 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:55.870083 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ad0c43df-3d53-49b5-b8dd-1b935fbb6c06 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:55.901925 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ad0c43df-3d53-49b5-b8dd-1b935fbb6c06 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047678 May 03 08:58:55.902468 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 284/557] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:55 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:56.707857 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-27ea003b-5a28-46e7-957f-cd183b5db6df tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:56.708471 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-27ea003b-5a28-46e7-957f-cd183b5db6df tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:56.715205 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-27ea003b-5a28-46e7-957f-cd183b5db6df tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:56.715651 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-27ea003b-5a28-46e7-957f-cd183b5db6df tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:56.716445 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-27ea003b-5a28-46e7-957f-cd183b5db6df tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:56.716905 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-27ea003b-5a28-46e7-957f-cd183b5db6df tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:56.777190 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-27ea003b-5a28-46e7-957f-cd183b5db6df tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:56.784683 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-27ea003b-5a28-46e7-957f-cd183b5db6df tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.080860 May 03 08:58:56.785255 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 274/558] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:56 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:58:56.918196 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c4b76147-1159-47f4-b4b4-0f19cb92a575 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:56.919675 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c4b76147-1159-47f4-b4b4-0f19cb92a575 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:56.927269 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c4b76147-1159-47f4-b4b4-0f19cb92a575 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:56.927734 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c4b76147-1159-47f4-b4b4-0f19cb92a575 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:56.928575 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c4b76147-1159-47f4-b4b4-0f19cb92a575 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:56.929029 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c4b76147-1159-47f4-b4b4-0f19cb92a575 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:56.959654 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c4b76147-1159-47f4-b4b4-0f19cb92a575 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048351 May 03 08:58:56.960250 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 285/559] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:56 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:57.806274 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-8fa9ff0c-1977-4b14-a76a-7b565b4a5983 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:57.807711 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-8fa9ff0c-1977-4b14-a76a-7b565b4a5983 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:57.816691 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8fa9ff0c-1977-4b14-a76a-7b565b4a5983 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:57.817136 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8fa9ff0c-1977-4b14-a76a-7b565b4a5983 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:57.817885 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8fa9ff0c-1977-4b14-a76a-7b565b4a5983 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:57.818307 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8fa9ff0c-1977-4b14-a76a-7b565b4a5983 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:57.888233 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-8fa9ff0c-1977-4b14-a76a-7b565b4a5983 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:57.899117 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-8fa9ff0c-1977-4b14-a76a-7b565b4a5983 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.099760 May 03 08:58:57.899888 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 275/560] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:57 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:58:58.092341 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-2196f08e-f3f7-4685-8715-78fbd4e1d238 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:58.093282 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-2196f08e-f3f7-4685-8715-78fbd4e1d238 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:58.099784 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2196f08e-f3f7-4685-8715-78fbd4e1d238 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:58.100243 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2196f08e-f3f7-4685-8715-78fbd4e1d238 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:58.101037 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2196f08e-f3f7-4685-8715-78fbd4e1d238 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:58.101470 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2196f08e-f3f7-4685-8715-78fbd4e1d238 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:58.133958 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-2196f08e-f3f7-4685-8715-78fbd4e1d238 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.162738 May 03 08:58:58.134531 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 286/561] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:57 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:58:58.922494 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0d618aa1-ba5c-4e72-ba10-1a69766cfa70 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:58.923463 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0d618aa1-ba5c-4e72-ba10-1a69766cfa70 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:58.931971 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0d618aa1-ba5c-4e72-ba10-1a69766cfa70 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:58.932525 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0d618aa1-ba5c-4e72-ba10-1a69766cfa70 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:58.933472 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0d618aa1-ba5c-4e72-ba10-1a69766cfa70 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:58.934004 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0d618aa1-ba5c-4e72-ba10-1a69766cfa70 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:59.006657 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0d618aa1-ba5c-4e72-ba10-1a69766cfa70 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:58:59.014495 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0d618aa1-ba5c-4e72-ba10-1a69766cfa70 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.098604 May 03 08:58:59.015022 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 276/562] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:58:58 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:58:59.152766 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-507757aa-f87a-4c25-9851-64fb5af4a389 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:58:59.154292 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-507757aa-f87a-4c25-9851-64fb5af4a389 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:58:59.175947 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-507757aa-f87a-4c25-9851-64fb5af4a389 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:59.176321 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-507757aa-f87a-4c25-9851-64fb5af4a389 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:59.177104 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-507757aa-f87a-4c25-9851-64fb5af4a389 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:58:59.177543 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-507757aa-f87a-4c25-9851-64fb5af4a389 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:58:59.207815 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-507757aa-f87a-4c25-9851-64fb5af4a389 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062048 May 03 08:58:59.208395 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 287/563] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:58:59 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:00.034625 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-30637074-fb24-44a5-bdaf-0f31d1509aa2 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:00.035440 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-30637074-fb24-44a5-bdaf-0f31d1509aa2 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:00.044216 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-30637074-fb24-44a5-bdaf-0f31d1509aa2 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:00.044824 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-30637074-fb24-44a5-bdaf-0f31d1509aa2 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:00.045838 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-30637074-fb24-44a5-bdaf-0f31d1509aa2 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:00.046420 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-30637074-fb24-44a5-bdaf-0f31d1509aa2 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:00.111326 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-30637074-fb24-44a5-bdaf-0f31d1509aa2 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:00.119249 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-30637074-fb24-44a5-bdaf-0f31d1509aa2 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.090729 May 03 08:59:00.119801 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 277/564] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:00 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:00.221478 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-aebfe356-8c59-4ba0-aba3-abae35d79d8b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:00.222401 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-aebfe356-8c59-4ba0-aba3-abae35d79d8b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:00.229127 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-aebfe356-8c59-4ba0-aba3-abae35d79d8b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:00.229578 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-aebfe356-8c59-4ba0-aba3-abae35d79d8b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:00.230348 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-aebfe356-8c59-4ba0-aba3-abae35d79d8b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:00.230758 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-aebfe356-8c59-4ba0-aba3-abae35d79d8b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:00.260492 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-aebfe356-8c59-4ba0-aba3-abae35d79d8b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045001 May 03 08:59:00.261057 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 288/565] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:00 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:01.139822 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-fad857f9-e955-4314-a382-ed17d8a8dc03 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:01.140842 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-fad857f9-e955-4314-a382-ed17d8a8dc03 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:01.148343 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fad857f9-e955-4314-a382-ed17d8a8dc03 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:01.148812 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fad857f9-e955-4314-a382-ed17d8a8dc03 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:01.149616 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fad857f9-e955-4314-a382-ed17d8a8dc03 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:01.150066 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fad857f9-e955-4314-a382-ed17d8a8dc03 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:01.220978 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-fad857f9-e955-4314-a382-ed17d8a8dc03 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:01.231117 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-fad857f9-e955-4314-a382-ed17d8a8dc03 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.097898 May 03 08:59:01.231713 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 278/566] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:01 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:01.272345 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-89042b7a-c03a-41a8-b999-f19ceb7e818c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:01.273170 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-89042b7a-c03a-41a8-b999-f19ceb7e818c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:01.279939 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-89042b7a-c03a-41a8-b999-f19ceb7e818c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:01.280387 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-89042b7a-c03a-41a8-b999-f19ceb7e818c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:01.281157 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-89042b7a-c03a-41a8-b999-f19ceb7e818c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:01.281590 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-89042b7a-c03a-41a8-b999-f19ceb7e818c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:01.310775 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-89042b7a-c03a-41a8-b999-f19ceb7e818c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042557 May 03 08:59:01.311305 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 289/567] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:01 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:02.256587 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f1689701-f62a-4a4f-b041-df8f53220a41 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:02.257570 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f1689701-f62a-4a4f-b041-df8f53220a41 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:02.267393 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f1689701-f62a-4a4f-b041-df8f53220a41 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:02.268125 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f1689701-f62a-4a4f-b041-df8f53220a41 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:02.269282 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f1689701-f62a-4a4f-b041-df8f53220a41 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:02.269942 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f1689701-f62a-4a4f-b041-df8f53220a41 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:02.322786 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d51f9b99-b853-4371-935d-5f424bcf29b8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:02.323731 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d51f9b99-b853-4371-935d-5f424bcf29b8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:02.330191 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d51f9b99-b853-4371-935d-5f424bcf29b8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:02.330637 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d51f9b99-b853-4371-935d-5f424bcf29b8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:02.331402 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d51f9b99-b853-4371-935d-5f424bcf29b8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:02.331864 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d51f9b99-b853-4371-935d-5f424bcf29b8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:02.338455 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f1689701-f62a-4a4f-b041-df8f53220a41 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:02.346400 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f1689701-f62a-4a4f-b041-df8f53220a41 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.095614 May 03 08:59:02.346956 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 279/568] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:02 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:02.363304 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d51f9b99-b853-4371-935d-5f424bcf29b8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044627 May 03 08:59:02.363894 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 290/569] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:02 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 03 08:59:03.366280 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-1f5ed1f9-bd80-49c4-95a8-18029521ae87 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:03.367045 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-1f5ed1f9-bd80-49c4-95a8-18029521ae87 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:03.375548 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1f5ed1f9-bd80-49c4-95a8-18029521ae87 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:03.376153 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1f5ed1f9-bd80-49c4-95a8-18029521ae87 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:03.376717 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-79df3a14-519f-403f-901d-ab3862d5a349 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:03.377280 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1f5ed1f9-bd80-49c4-95a8-18029521ae87 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:03.377645 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1f5ed1f9-bd80-49c4-95a8-18029521ae87 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:03.377823 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-79df3a14-519f-403f-901d-ab3862d5a349 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:03.385938 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-79df3a14-519f-403f-901d-ab3862d5a349 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:03.386491 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-79df3a14-519f-403f-901d-ab3862d5a349 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:03.387430 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-79df3a14-519f-403f-901d-ab3862d5a349 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:03.388025 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-79df3a14-519f-403f-901d-ab3862d5a349 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:03.418869 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-79df3a14-519f-403f-901d-ab3862d5a349 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047164 May 03 08:59:03.419443 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 291/570] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:03 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:03.448895 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-1f5ed1f9-bd80-49c4-95a8-18029521ae87 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:03.457177 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-1f5ed1f9-bd80-49c4-95a8-18029521ae87 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.095824 May 03 08:59:03.457736 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 280/571] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:03 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:04.435370 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-50067043-52ee-4af8-b8b7-61e7608a0eee tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:04.436919 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-50067043-52ee-4af8-b8b7-61e7608a0eee tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:04.444590 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-50067043-52ee-4af8-b8b7-61e7608a0eee tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:04.445039 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-50067043-52ee-4af8-b8b7-61e7608a0eee tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:04.445810 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-50067043-52ee-4af8-b8b7-61e7608a0eee tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:04.446246 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-50067043-52ee-4af8-b8b7-61e7608a0eee tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:04.476288 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-50067043-52ee-4af8-b8b7-61e7608a0eee tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047643 May 03 08:59:04.477162 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 292/572] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:04 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:04.478520 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5691b3ed-0910-4b79-b61c-77bbb2be2414 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:04.479135 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5691b3ed-0910-4b79-b61c-77bbb2be2414 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:04.486129 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5691b3ed-0910-4b79-b61c-77bbb2be2414 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:04.486576 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5691b3ed-0910-4b79-b61c-77bbb2be2414 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:04.487351 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5691b3ed-0910-4b79-b61c-77bbb2be2414 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:04.487796 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5691b3ed-0910-4b79-b61c-77bbb2be2414 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:04.559018 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5691b3ed-0910-4b79-b61c-77bbb2be2414 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:04.568340 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5691b3ed-0910-4b79-b61c-77bbb2be2414 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.093253 May 03 08:59:04.569153 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 281/573] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:04 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:05.491094 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-250de188-86cc-4599-ac9b-00cb57384217 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:05.492221 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-250de188-86cc-4599-ac9b-00cb57384217 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:05.500423 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-250de188-86cc-4599-ac9b-00cb57384217 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:05.500981 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-250de188-86cc-4599-ac9b-00cb57384217 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:05.501931 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-250de188-86cc-4599-ac9b-00cb57384217 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:05.502459 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-250de188-86cc-4599-ac9b-00cb57384217 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:05.534212 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-250de188-86cc-4599-ac9b-00cb57384217 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048265 May 03 08:59:05.534744 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 293/574] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:05 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:05.592845 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-3f5fedb1-e9bd-4b04-974e-3dc830c17955 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:05.593826 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-3f5fedb1-e9bd-4b04-974e-3dc830c17955 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:05.601088 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3f5fedb1-e9bd-4b04-974e-3dc830c17955 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:05.601538 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3f5fedb1-e9bd-4b04-974e-3dc830c17955 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:05.602294 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3f5fedb1-e9bd-4b04-974e-3dc830c17955 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:05.602718 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3f5fedb1-e9bd-4b04-974e-3dc830c17955 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:05.663341 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-3f5fedb1-e9bd-4b04-974e-3dc830c17955 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:05.670872 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-3f5fedb1-e9bd-4b04-974e-3dc830c17955 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.084492 May 03 08:59:05.671432 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 282/575] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:05 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:06.549979 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-2a38594f-86b4-4691-86d4-e8611a496241 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:06.551335 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-2a38594f-86b4-4691-86d4-e8611a496241 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:06.562021 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2a38594f-86b4-4691-86d4-e8611a496241 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:06.562766 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2a38594f-86b4-4691-86d4-e8611a496241 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:06.563871 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2a38594f-86b4-4691-86d4-e8611a496241 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:06.564305 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2a38594f-86b4-4691-86d4-e8611a496241 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:06.593156 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-2a38594f-86b4-4691-86d4-e8611a496241 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050252 May 03 08:59:06.593694 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 294/576] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:06 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:06.690499 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-28fdd03d-b8fa-4a5a-a957-2ccc0ef29530 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:06.691323 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-28fdd03d-b8fa-4a5a-a957-2ccc0ef29530 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:06.698058 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-28fdd03d-b8fa-4a5a-a957-2ccc0ef29530 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:06.698506 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-28fdd03d-b8fa-4a5a-a957-2ccc0ef29530 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:06.699265 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-28fdd03d-b8fa-4a5a-a957-2ccc0ef29530 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:06.699690 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-28fdd03d-b8fa-4a5a-a957-2ccc0ef29530 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:06.762416 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-28fdd03d-b8fa-4a5a-a957-2ccc0ef29530 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:06.770364 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-28fdd03d-b8fa-4a5a-a957-2ccc0ef29530 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.085006 May 03 08:59:06.770941 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 283/577] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:06 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:07.610023 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-06cea803-abaa-48ab-a184-9173bcfe3a7d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:07.611382 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-06cea803-abaa-48ab-a184-9173bcfe3a7d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:07.618534 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-06cea803-abaa-48ab-a184-9173bcfe3a7d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:07.619000 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-06cea803-abaa-48ab-a184-9173bcfe3a7d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:07.619803 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-06cea803-abaa-48ab-a184-9173bcfe3a7d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:07.620273 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-06cea803-abaa-48ab-a184-9173bcfe3a7d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:07.651080 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-06cea803-abaa-48ab-a184-9173bcfe3a7d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048069 May 03 08:59:07.651622 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 295/578] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:07 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:07.790932 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-cb6930ce-7dde-4967-bd42-25fcf9395afa tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:07.791987 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-cb6930ce-7dde-4967-bd42-25fcf9395afa tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:07.802759 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cb6930ce-7dde-4967-bd42-25fcf9395afa tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:07.803503 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cb6930ce-7dde-4967-bd42-25fcf9395afa tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:07.804813 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cb6930ce-7dde-4967-bd42-25fcf9395afa tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:07.805563 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cb6930ce-7dde-4967-bd42-25fcf9395afa tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:07.874536 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-cb6930ce-7dde-4967-bd42-25fcf9395afa tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:07.882520 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-cb6930ce-7dde-4967-bd42-25fcf9395afa tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.098164 May 03 08:59:07.883105 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 284/579] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:07 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:08.667448 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5f82dd5d-3a8b-4e9b-9f23-e7a1cad89d51 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:08.668956 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5f82dd5d-3a8b-4e9b-9f23-e7a1cad89d51 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:08.679611 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5f82dd5d-3a8b-4e9b-9f23-e7a1cad89d51 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:08.680409 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5f82dd5d-3a8b-4e9b-9f23-e7a1cad89d51 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:08.681624 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5f82dd5d-3a8b-4e9b-9f23-e7a1cad89d51 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:08.682363 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5f82dd5d-3a8b-4e9b-9f23-e7a1cad89d51 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:08.716150 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5f82dd5d-3a8b-4e9b-9f23-e7a1cad89d51 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055358 May 03 08:59:08.716701 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 296/580] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:08 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:08.903455 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-854d14e5-2f8a-4c70-934e-44448689544a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:08.904512 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-854d14e5-2f8a-4c70-934e-44448689544a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:08.912613 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-854d14e5-2f8a-4c70-934e-44448689544a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:08.913061 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-854d14e5-2f8a-4c70-934e-44448689544a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:08.913821 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-854d14e5-2f8a-4c70-934e-44448689544a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:08.914255 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-854d14e5-2f8a-4c70-934e-44448689544a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:09.234660 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-854d14e5-2f8a-4c70-934e-44448689544a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:09.242925 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-854d14e5-2f8a-4c70-934e-44448689544a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.346000 May 03 08:59:09.243509 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 285/581] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:08 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:09.733848 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ac41ec78-389e-4035-90b1-84fb0c7bdf07 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:09.735350 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ac41ec78-389e-4035-90b1-84fb0c7bdf07 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:09.742451 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ac41ec78-389e-4035-90b1-84fb0c7bdf07 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:09.742905 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ac41ec78-389e-4035-90b1-84fb0c7bdf07 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:09.743670 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ac41ec78-389e-4035-90b1-84fb0c7bdf07 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:09.744140 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ac41ec78-389e-4035-90b1-84fb0c7bdf07 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:09.773226 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ac41ec78-389e-4035-90b1-84fb0c7bdf07 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046278 May 03 08:59:09.773772 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 297/582] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:09 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:10.263014 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d8163c47-4fa8-43c8-8117-8e4d028a9471 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:10.263986 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d8163c47-4fa8-43c8-8117-8e4d028a9471 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:10.273895 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d8163c47-4fa8-43c8-8117-8e4d028a9471 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:10.274587 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d8163c47-4fa8-43c8-8117-8e4d028a9471 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:10.275754 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d8163c47-4fa8-43c8-8117-8e4d028a9471 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:10.276431 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d8163c47-4fa8-43c8-8117-8e4d028a9471 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:10.368238 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d8163c47-4fa8-43c8-8117-8e4d028a9471 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:10.376461 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d8163c47-4fa8-43c8-8117-8e4d028a9471 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.119432 May 03 08:59:10.377183 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 286/583] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:10 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:10.787641 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e61ecfbe-ca1c-4a4b-8c4d-43b56a64fe41 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:10.788749 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e61ecfbe-ca1c-4a4b-8c4d-43b56a64fe41 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:10.796506 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e61ecfbe-ca1c-4a4b-8c4d-43b56a64fe41 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:10.797033 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e61ecfbe-ca1c-4a4b-8c4d-43b56a64fe41 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:10.797972 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e61ecfbe-ca1c-4a4b-8c4d-43b56a64fe41 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:10.798482 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e61ecfbe-ca1c-4a4b-8c4d-43b56a64fe41 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:10.830396 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e61ecfbe-ca1c-4a4b-8c4d-43b56a64fe41 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047759 May 03 08:59:10.830948 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 298/584] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:10 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:11.397711 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f3ac41aa-f4ad-46d2-bc05-443ca86433b1 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:11.398671 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f3ac41aa-f4ad-46d2-bc05-443ca86433b1 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:11.409689 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f3ac41aa-f4ad-46d2-bc05-443ca86433b1 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:11.410426 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f3ac41aa-f4ad-46d2-bc05-443ca86433b1 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:11.411720 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f3ac41aa-f4ad-46d2-bc05-443ca86433b1 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:11.412493 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f3ac41aa-f4ad-46d2-bc05-443ca86433b1 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:11.479166 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f3ac41aa-f4ad-46d2-bc05-443ca86433b1 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:11.487155 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f3ac41aa-f4ad-46d2-bc05-443ca86433b1 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.096265 May 03 08:59:11.487705 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 287/585] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:11 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:11.846527 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-2a445264-9a13-46ce-a36a-eaa8e8053021 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:11.847442 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-2a445264-9a13-46ce-a36a-eaa8e8053021 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:11.854813 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2a445264-9a13-46ce-a36a-eaa8e8053021 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:11.855312 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2a445264-9a13-46ce-a36a-eaa8e8053021 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:11.856204 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2a445264-9a13-46ce-a36a-eaa8e8053021 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:11.856685 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2a445264-9a13-46ce-a36a-eaa8e8053021 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:11.887087 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-2a445264-9a13-46ce-a36a-eaa8e8053021 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047575 May 03 08:59:11.887627 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 299/586] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:11 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:12.507374 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5ec58a9c-c1b6-4882-9b56-2a6d1bcb22a9 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:12.508428 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5ec58a9c-c1b6-4882-9b56-2a6d1bcb22a9 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:12.518961 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5ec58a9c-c1b6-4882-9b56-2a6d1bcb22a9 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:12.519725 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5ec58a9c-c1b6-4882-9b56-2a6d1bcb22a9 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:12.521039 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5ec58a9c-c1b6-4882-9b56-2a6d1bcb22a9 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:12.521764 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5ec58a9c-c1b6-4882-9b56-2a6d1bcb22a9 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:12.585192 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5ec58a9c-c1b6-4882-9b56-2a6d1bcb22a9 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:12.593030 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5ec58a9c-c1b6-4882-9b56-2a6d1bcb22a9 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.092392 May 03 08:59:12.593571 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 288/587] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:12 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:12.903700 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-405889b9-2160-48b5-b930-2efaa4519b9e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:12.905258 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-405889b9-2160-48b5-b930-2efaa4519b9e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:12.916248 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-405889b9-2160-48b5-b930-2efaa4519b9e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:12.916983 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-405889b9-2160-48b5-b930-2efaa4519b9e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:12.918232 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-405889b9-2160-48b5-b930-2efaa4519b9e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:12.918947 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-405889b9-2160-48b5-b930-2efaa4519b9e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:12.950160 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-405889b9-2160-48b5-b930-2efaa4519b9e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053573 May 03 08:59:12.950716 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 300/588] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:12 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:13.614853 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ca28e292-24b1-4757-96fa-412295fd1fc6 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:13.615727 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ca28e292-24b1-4757-96fa-412295fd1fc6 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:13.627508 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ca28e292-24b1-4757-96fa-412295fd1fc6 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:13.627508 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ca28e292-24b1-4757-96fa-412295fd1fc6 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:13.628671 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ca28e292-24b1-4757-96fa-412295fd1fc6 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:13.629408 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ca28e292-24b1-4757-96fa-412295fd1fc6 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:13.698804 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ca28e292-24b1-4757-96fa-412295fd1fc6 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:13.707934 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ca28e292-24b1-4757-96fa-412295fd1fc6 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.099913 May 03 08:59:13.708659 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 289/589] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:13 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:13.966381 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d1d4ca69-23dc-40d5-a2db-445dc383e32d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:13.967889 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d1d4ca69-23dc-40d5-a2db-445dc383e32d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:13.975810 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d1d4ca69-23dc-40d5-a2db-445dc383e32d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:13.976266 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d1d4ca69-23dc-40d5-a2db-445dc383e32d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:13.977030 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d1d4ca69-23dc-40d5-a2db-445dc383e32d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:13.977470 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d1d4ca69-23dc-40d5-a2db-445dc383e32d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:14.006671 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d1d4ca69-23dc-40d5-a2db-445dc383e32d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047142 May 03 08:59:14.007220 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 301/590] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:13 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:14.729617 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0f86ed11-9c04-45e0-8ffb-855cbd693ba3 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:14.730603 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0f86ed11-9c04-45e0-8ffb-855cbd693ba3 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:14.741323 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0f86ed11-9c04-45e0-8ffb-855cbd693ba3 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:14.742062 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0f86ed11-9c04-45e0-8ffb-855cbd693ba3 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:14.743333 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0f86ed11-9c04-45e0-8ffb-855cbd693ba3 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:14.744113 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0f86ed11-9c04-45e0-8ffb-855cbd693ba3 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:14.808098 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0f86ed11-9c04-45e0-8ffb-855cbd693ba3 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:14.816440 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0f86ed11-9c04-45e0-8ffb-855cbd693ba3 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.093426 May 03 08:59:14.817007 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 290/591] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:14 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:15.023170 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e8ee180f-c2be-426c-8706-e798ddf525f4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:15.024580 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e8ee180f-c2be-426c-8706-e798ddf525f4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:15.035116 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e8ee180f-c2be-426c-8706-e798ddf525f4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:15.035871 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e8ee180f-c2be-426c-8706-e798ddf525f4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:15.037150 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e8ee180f-c2be-426c-8706-e798ddf525f4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:15.037857 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e8ee180f-c2be-426c-8706-e798ddf525f4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:15.071404 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e8ee180f-c2be-426c-8706-e798ddf525f4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055366 May 03 08:59:15.072007 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 302/592] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:15 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:15.834533 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-926a389b-55f2-4f19-9027-988293aa3211 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:15.835155 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-926a389b-55f2-4f19-9027-988293aa3211 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:15.842401 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-926a389b-55f2-4f19-9027-988293aa3211 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:15.842868 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-926a389b-55f2-4f19-9027-988293aa3211 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:15.843681 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-926a389b-55f2-4f19-9027-988293aa3211 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:15.844485 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-926a389b-55f2-4f19-9027-988293aa3211 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:15.928080 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-926a389b-55f2-4f19-9027-988293aa3211 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:15.939353 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-926a389b-55f2-4f19-9027-988293aa3211 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.108698 May 03 08:59:15.940120 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 291/593] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:15 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:16.082868 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b0836952-110a-4302-af1c-aefbbcd69a66 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:16.083805 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b0836952-110a-4302-af1c-aefbbcd69a66 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:16.090401 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b0836952-110a-4302-af1c-aefbbcd69a66 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:16.090851 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b0836952-110a-4302-af1c-aefbbcd69a66 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:16.091606 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b0836952-110a-4302-af1c-aefbbcd69a66 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:16.092068 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b0836952-110a-4302-af1c-aefbbcd69a66 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:16.121230 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b0836952-110a-4302-af1c-aefbbcd69a66 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042386 May 03 08:59:16.121771 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 303/594] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:16 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:16.960939 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-efc4c698-6494-40e0-949e-1a3200b12bbb tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:16.961940 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-efc4c698-6494-40e0-949e-1a3200b12bbb tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:16.972053 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-efc4c698-6494-40e0-949e-1a3200b12bbb tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:16.972502 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-efc4c698-6494-40e0-949e-1a3200b12bbb tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:16.973260 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-efc4c698-6494-40e0-949e-1a3200b12bbb tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:16.973691 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-efc4c698-6494-40e0-949e-1a3200b12bbb tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:17.043708 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-efc4c698-6494-40e0-949e-1a3200b12bbb tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:17.051225 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-efc4c698-6494-40e0-949e-1a3200b12bbb tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.096976 May 03 08:59:17.051789 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 292/595] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:16 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:17.137167 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-099cdc65-a182-400f-8ef2-b0c8549be369 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:17.138659 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-099cdc65-a182-400f-8ef2-b0c8549be369 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:17.149312 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-099cdc65-a182-400f-8ef2-b0c8549be369 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:17.150060 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-099cdc65-a182-400f-8ef2-b0c8549be369 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:17.151342 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-099cdc65-a182-400f-8ef2-b0c8549be369 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:17.152145 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-099cdc65-a182-400f-8ef2-b0c8549be369 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:17.183581 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-099cdc65-a182-400f-8ef2-b0c8549be369 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053100 May 03 08:59:17.184188 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 304/596] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:17 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:18.072288 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-48e1c4cc-847c-4ffe-af0b-b72bf4662b7c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:18.073534 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-48e1c4cc-847c-4ffe-af0b-b72bf4662b7c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:18.082604 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-48e1c4cc-847c-4ffe-af0b-b72bf4662b7c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:18.083048 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-48e1c4cc-847c-4ffe-af0b-b72bf4662b7c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:18.083821 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-48e1c4cc-847c-4ffe-af0b-b72bf4662b7c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:18.084286 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-48e1c4cc-847c-4ffe-af0b-b72bf4662b7c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:18.154065 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-48e1c4cc-847c-4ffe-af0b-b72bf4662b7c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:18.162029 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-48e1c4cc-847c-4ffe-af0b-b72bf4662b7c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.096372 May 03 08:59:18.162628 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 293/597] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:18 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:18.196176 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9eefd98b-7931-4cf5-814b-655c3c4a3a98 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:18.197103 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9eefd98b-7931-4cf5-814b-655c3c4a3a98 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:18.205316 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9eefd98b-7931-4cf5-814b-655c3c4a3a98 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:18.206061 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9eefd98b-7931-4cf5-814b-655c3c4a3a98 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:18.206925 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9eefd98b-7931-4cf5-814b-655c3c4a3a98 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:18.207532 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9eefd98b-7931-4cf5-814b-655c3c4a3a98 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:18.238877 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9eefd98b-7931-4cf5-814b-655c3c4a3a98 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047997 May 03 08:59:18.239463 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 305/598] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:18 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:19.183034 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c0c91deb-1814-4a42-8578-ea77c100c576 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:19.184011 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c0c91deb-1814-4a42-8578-ea77c100c576 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:19.192509 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c0c91deb-1814-4a42-8578-ea77c100c576 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:19.192954 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c0c91deb-1814-4a42-8578-ea77c100c576 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:19.193706 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c0c91deb-1814-4a42-8578-ea77c100c576 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:19.194130 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c0c91deb-1814-4a42-8578-ea77c100c576 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:19.251099 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-39db23c1-4526-4152-81e7-df45d963f127 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:19.252084 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-39db23c1-4526-4152-81e7-df45d963f127 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:19.259717 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-39db23c1-4526-4152-81e7-df45d963f127 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:19.260203 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-39db23c1-4526-4152-81e7-df45d963f127 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:19.260432 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c0c91deb-1814-4a42-8578-ea77c100c576 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:19.260992 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-39db23c1-4526-4152-81e7-df45d963f127 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:19.261415 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-39db23c1-4526-4152-81e7-df45d963f127 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:19.267987 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c0c91deb-1814-4a42-8578-ea77c100c576 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.091655 May 03 08:59:19.268554 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 294/599] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:19 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:19.291937 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-39db23c1-4526-4152-81e7-df45d963f127 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044876 May 03 08:59:19.292492 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 306/600] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:19 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:20.287416 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9346e555-d56c-48db-9791-1b9a952d168c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:20.288073 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9346e555-d56c-48db-9791-1b9a952d168c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:20.295038 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9346e555-d56c-48db-9791-1b9a952d168c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:20.295484 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9346e555-d56c-48db-9791-1b9a952d168c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:20.296307 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9346e555-d56c-48db-9791-1b9a952d168c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:20.296739 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9346e555-d56c-48db-9791-1b9a952d168c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:20.302847 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-451f9259-a2c5-4772-81c8-6444219980c6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:20.303786 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-451f9259-a2c5-4772-81c8-6444219980c6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:20.310401 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-451f9259-a2c5-4772-81c8-6444219980c6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:20.310849 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-451f9259-a2c5-4772-81c8-6444219980c6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:20.311583 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-451f9259-a2c5-4772-81c8-6444219980c6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:20.312110 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-451f9259-a2c5-4772-81c8-6444219980c6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:20.341466 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-451f9259-a2c5-4772-81c8-6444219980c6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042557 May 03 08:59:20.342035 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 307/601] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:20 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:20.358828 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9346e555-d56c-48db-9791-1b9a952d168c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:20.366613 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9346e555-d56c-48db-9791-1b9a952d168c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.084913 May 03 08:59:20.367145 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 295/602] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:20 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:21.355136 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-233d9b8c-50a4-473a-b09f-ea81277cc67c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:21.356235 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-233d9b8c-50a4-473a-b09f-ea81277cc67c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:21.364222 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-233d9b8c-50a4-473a-b09f-ea81277cc67c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:21.364767 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-233d9b8c-50a4-473a-b09f-ea81277cc67c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:21.365704 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-233d9b8c-50a4-473a-b09f-ea81277cc67c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:21.366214 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-233d9b8c-50a4-473a-b09f-ea81277cc67c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:21.382800 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-19df009a-d3fa-4d0d-8f5c-6db38c92a1a3 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:21.383575 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-19df009a-d3fa-4d0d-8f5c-6db38c92a1a3 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:21.390223 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-19df009a-d3fa-4d0d-8f5c-6db38c92a1a3 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:21.390665 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-19df009a-d3fa-4d0d-8f5c-6db38c92a1a3 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:21.391421 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-19df009a-d3fa-4d0d-8f5c-6db38c92a1a3 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:21.391953 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-19df009a-d3fa-4d0d-8f5c-6db38c92a1a3 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:21.401747 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-233d9b8c-50a4-473a-b09f-ea81277cc67c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051434 May 03 08:59:21.403916 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 308/603] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:21 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:21.459796 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-19df009a-d3fa-4d0d-8f5c-6db38c92a1a3 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:21.468010 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-19df009a-d3fa-4d0d-8f5c-6db38c92a1a3 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.088983 May 03 08:59:21.468522 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 296/604] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:21 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:22.413938 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ad9230b9-761b-4428-87ce-037895563a85 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:22.414851 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ad9230b9-761b-4428-87ce-037895563a85 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:22.421617 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ad9230b9-761b-4428-87ce-037895563a85 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:22.422061 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ad9230b9-761b-4428-87ce-037895563a85 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:22.422818 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ad9230b9-761b-4428-87ce-037895563a85 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:22.423246 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ad9230b9-761b-4428-87ce-037895563a85 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:22.452488 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ad9230b9-761b-4428-87ce-037895563a85 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042665 May 03 08:59:22.453038 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 309/605] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:22 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:22.488370 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-8e8ee7e0-38fd-4681-b3e5-a1aedbbdeb55 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:22.488992 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-8e8ee7e0-38fd-4681-b3e5-a1aedbbdeb55 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:22.496475 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8e8ee7e0-38fd-4681-b3e5-a1aedbbdeb55 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:22.496911 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8e8ee7e0-38fd-4681-b3e5-a1aedbbdeb55 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:22.497699 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8e8ee7e0-38fd-4681-b3e5-a1aedbbdeb55 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:22.498133 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8e8ee7e0-38fd-4681-b3e5-a1aedbbdeb55 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:22.562108 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-8e8ee7e0-38fd-4681-b3e5-a1aedbbdeb55 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:22.569650 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-8e8ee7e0-38fd-4681-b3e5-a1aedbbdeb55 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.087845 May 03 08:59:22.570215 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 297/606] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:22 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:23.469829 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-8e70347a-f86e-4337-be7c-d400d05bf141 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:23.471242 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-8e70347a-f86e-4337-be7c-d400d05bf141 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:23.478656 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8e70347a-f86e-4337-be7c-d400d05bf141 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:23.479103 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8e70347a-f86e-4337-be7c-d400d05bf141 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:23.480000 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8e70347a-f86e-4337-be7c-d400d05bf141 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:23.480421 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8e70347a-f86e-4337-be7c-d400d05bf141 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:23.509511 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-8e70347a-f86e-4337-be7c-d400d05bf141 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046911 May 03 08:59:23.510047 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 310/607] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:23 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:23.590969 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7bcf0a40-e057-4232-9e62-5f064d988474 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:23.592306 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7bcf0a40-e057-4232-9e62-5f064d988474 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:23.601979 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7bcf0a40-e057-4232-9e62-5f064d988474 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:23.602645 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7bcf0a40-e057-4232-9e62-5f064d988474 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:23.603731 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7bcf0a40-e057-4232-9e62-5f064d988474 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:23.604214 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7bcf0a40-e057-4232-9e62-5f064d988474 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:23.680939 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7bcf0a40-e057-4232-9e62-5f064d988474 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:23.688639 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7bcf0a40-e057-4232-9e62-5f064d988474 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.104757 May 03 08:59:23.689196 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 298/608] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:23 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:24.526089 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b35018d6-5645-4d23-a04f-ce8fa023655d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:24.527423 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b35018d6-5645-4d23-a04f-ce8fa023655d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:24.537139 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b35018d6-5645-4d23-a04f-ce8fa023655d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:24.537589 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b35018d6-5645-4d23-a04f-ce8fa023655d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:24.538366 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b35018d6-5645-4d23-a04f-ce8fa023655d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:24.538793 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b35018d6-5645-4d23-a04f-ce8fa023655d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:24.575792 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b35018d6-5645-4d23-a04f-ce8fa023655d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056664 May 03 08:59:24.576610 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 311/609] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:24 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:24.709494 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-1e7d18d7-26cc-49fb-9dc7-2c5be60ddc23 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:24.710503 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-1e7d18d7-26cc-49fb-9dc7-2c5be60ddc23 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:24.721572 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1e7d18d7-26cc-49fb-9dc7-2c5be60ddc23 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:24.722329 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1e7d18d7-26cc-49fb-9dc7-2c5be60ddc23 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:24.727436 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1e7d18d7-26cc-49fb-9dc7-2c5be60ddc23 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:24.728180 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1e7d18d7-26cc-49fb-9dc7-2c5be60ddc23 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:24.814734 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-1e7d18d7-26cc-49fb-9dc7-2c5be60ddc23 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:24.822517 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-1e7d18d7-26cc-49fb-9dc7-2c5be60ddc23 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.119642 May 03 08:59:24.823081 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 299/610] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:24 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:25.592723 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c81f6f98-075b-44a1-ac45-4f189de4f9c5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:25.594689 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c81f6f98-075b-44a1-ac45-4f189de4f9c5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:25.605698 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c81f6f98-075b-44a1-ac45-4f189de4f9c5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:25.606447 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c81f6f98-075b-44a1-ac45-4f189de4f9c5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:25.607714 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c81f6f98-075b-44a1-ac45-4f189de4f9c5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:25.608491 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c81f6f98-075b-44a1-ac45-4f189de4f9c5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:25.639323 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c81f6f98-075b-44a1-ac45-4f189de4f9c5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053588 May 03 08:59:25.639908 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 312/611] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:25 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:25.839324 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a1508d48-c7eb-4b3f-9dc3-ba0ed812b271 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:25.839919 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a1508d48-c7eb-4b3f-9dc3-ba0ed812b271 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:25.847148 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a1508d48-c7eb-4b3f-9dc3-ba0ed812b271 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:25.847583 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a1508d48-c7eb-4b3f-9dc3-ba0ed812b271 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:25.848397 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a1508d48-c7eb-4b3f-9dc3-ba0ed812b271 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:25.848839 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a1508d48-c7eb-4b3f-9dc3-ba0ed812b271 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:25.921577 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a1508d48-c7eb-4b3f-9dc3-ba0ed812b271 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:25.932884 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a1508d48-c7eb-4b3f-9dc3-ba0ed812b271 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.097312 May 03 08:59:25.933628 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 300/612] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:25 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:26.655340 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-05edbad3-f12f-4e8a-a7af-4bc4df2cf95e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:26.656881 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-05edbad3-f12f-4e8a-a7af-4bc4df2cf95e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:26.664840 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-05edbad3-f12f-4e8a-a7af-4bc4df2cf95e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:26.665292 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-05edbad3-f12f-4e8a-a7af-4bc4df2cf95e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:26.666103 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-05edbad3-f12f-4e8a-a7af-4bc4df2cf95e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:26.666540 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-05edbad3-f12f-4e8a-a7af-4bc4df2cf95e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:26.696462 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-05edbad3-f12f-4e8a-a7af-4bc4df2cf95e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047683 May 03 08:59:26.697071 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 313/613] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:26 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:26.953499 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7dca48be-745d-41fc-bb97-db8390f28a85 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:26.954344 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7dca48be-745d-41fc-bb97-db8390f28a85 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:26.962154 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7dca48be-745d-41fc-bb97-db8390f28a85 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:26.962609 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7dca48be-745d-41fc-bb97-db8390f28a85 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:26.963385 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7dca48be-745d-41fc-bb97-db8390f28a85 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:26.963822 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7dca48be-745d-41fc-bb97-db8390f28a85 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:27.024553 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7dca48be-745d-41fc-bb97-db8390f28a85 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:27.032386 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7dca48be-745d-41fc-bb97-db8390f28a85 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.085469 May 03 08:59:27.032950 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 301/614] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:26 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:27.708149 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-2f7f2ed5-2127-421b-8a98-4b4ccb8fd349 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:27.709124 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-2f7f2ed5-2127-421b-8a98-4b4ccb8fd349 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:27.715946 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2f7f2ed5-2127-421b-8a98-4b4ccb8fd349 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:27.716398 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2f7f2ed5-2127-421b-8a98-4b4ccb8fd349 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:27.717168 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2f7f2ed5-2127-421b-8a98-4b4ccb8fd349 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:27.717604 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2f7f2ed5-2127-421b-8a98-4b4ccb8fd349 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:27.747581 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-2f7f2ed5-2127-421b-8a98-4b4ccb8fd349 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043665 May 03 08:59:27.748184 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 314/615] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:27 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:28.053581 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d2827980-1ac5-47d7-9f27-0edd5d316665 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:28.054522 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d2827980-1ac5-47d7-9f27-0edd5d316665 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:28.065847 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d2827980-1ac5-47d7-9f27-0edd5d316665 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:28.066681 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d2827980-1ac5-47d7-9f27-0edd5d316665 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:28.067465 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d2827980-1ac5-47d7-9f27-0edd5d316665 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:28.068058 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d2827980-1ac5-47d7-9f27-0edd5d316665 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:28.133065 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d2827980-1ac5-47d7-9f27-0edd5d316665 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:28.140581 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d2827980-1ac5-47d7-9f27-0edd5d316665 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.093571 May 03 08:59:28.141113 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 302/616] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:28 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:28.763929 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5bfd03ec-d6ac-4803-b378-64279ea03a8a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:28.765426 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5bfd03ec-d6ac-4803-b378-64279ea03a8a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:28.776322 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5bfd03ec-d6ac-4803-b378-64279ea03a8a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:28.777067 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5bfd03ec-d6ac-4803-b378-64279ea03a8a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:28.778335 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5bfd03ec-d6ac-4803-b378-64279ea03a8a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:28.779068 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5bfd03ec-d6ac-4803-b378-64279ea03a8a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:28.810578 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5bfd03ec-d6ac-4803-b378-64279ea03a8a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053436 May 03 08:59:28.811136 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 315/617] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:28 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:29.168287 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-23eb91ee-9bfe-41a8-b377-9bdaccc84c0a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:29.169234 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-23eb91ee-9bfe-41a8-b377-9bdaccc84c0a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:29.180388 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-23eb91ee-9bfe-41a8-b377-9bdaccc84c0a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:29.181128 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-23eb91ee-9bfe-41a8-b377-9bdaccc84c0a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:29.182401 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-23eb91ee-9bfe-41a8-b377-9bdaccc84c0a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:29.183122 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-23eb91ee-9bfe-41a8-b377-9bdaccc84c0a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:29.251969 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-23eb91ee-9bfe-41a8-b377-9bdaccc84c0a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:29.260074 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-23eb91ee-9bfe-41a8-b377-9bdaccc84c0a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.098595 May 03 08:59:29.260645 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 303/618] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:29 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:29.826888 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-bba95982-5ddb-4a51-975d-d918010802ff tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:29.828121 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-bba95982-5ddb-4a51-975d-d918010802ff tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:29.836882 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bba95982-5ddb-4a51-975d-d918010802ff tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:29.837475 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bba95982-5ddb-4a51-975d-d918010802ff tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:29.838481 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bba95982-5ddb-4a51-975d-d918010802ff tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:29.839052 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bba95982-5ddb-4a51-975d-d918010802ff tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:29.871289 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-bba95982-5ddb-4a51-975d-d918010802ff tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049769 May 03 08:59:29.872000 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 316/619] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:29 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:30.278641 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d5709078-0ed0-4a70-89fd-3b6e14f433ea tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:30.279253 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d5709078-0ed0-4a70-89fd-3b6e14f433ea tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:30.286614 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d5709078-0ed0-4a70-89fd-3b6e14f433ea tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:30.287109 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d5709078-0ed0-4a70-89fd-3b6e14f433ea tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:30.287992 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d5709078-0ed0-4a70-89fd-3b6e14f433ea tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:30.288524 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d5709078-0ed0-4a70-89fd-3b6e14f433ea tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:30.353007 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d5709078-0ed0-4a70-89fd-3b6e14f433ea tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:30.360603 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d5709078-0ed0-4a70-89fd-3b6e14f433ea tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.086264 May 03 08:59:30.361169 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 304/620] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:30 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:30.887330 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-03bad0b1-8509-4501-a260-9a80f7a7c81b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:30.888855 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-03bad0b1-8509-4501-a260-9a80f7a7c81b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:30.899392 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-03bad0b1-8509-4501-a260-9a80f7a7c81b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:30.900205 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-03bad0b1-8509-4501-a260-9a80f7a7c81b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:30.901458 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-03bad0b1-8509-4501-a260-9a80f7a7c81b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:30.902172 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-03bad0b1-8509-4501-a260-9a80f7a7c81b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:30.935971 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-03bad0b1-8509-4501-a260-9a80f7a7c81b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055610 May 03 08:59:30.936525 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 317/621] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:30 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:31.381699 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6795f95d-2be5-4188-9b7c-087fa16df5f5 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:31.382661 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6795f95d-2be5-4188-9b7c-087fa16df5f5 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:31.390888 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6795f95d-2be5-4188-9b7c-087fa16df5f5 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:31.391479 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6795f95d-2be5-4188-9b7c-087fa16df5f5 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:31.392441 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6795f95d-2be5-4188-9b7c-087fa16df5f5 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:31.392985 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6795f95d-2be5-4188-9b7c-087fa16df5f5 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:31.458827 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6795f95d-2be5-4188-9b7c-087fa16df5f5 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:31.466550 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6795f95d-2be5-4188-9b7c-087fa16df5f5 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.091435 May 03 08:59:31.467040 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 305/622] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:31 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:31.948418 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-bade11a0-a96c-41ae-9d4f-202f189acab4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:31.949358 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-bade11a0-a96c-41ae-9d4f-202f189acab4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:31.956332 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bade11a0-a96c-41ae-9d4f-202f189acab4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:31.956776 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bade11a0-a96c-41ae-9d4f-202f189acab4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:31.957571 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bade11a0-a96c-41ae-9d4f-202f189acab4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:31.958001 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bade11a0-a96c-41ae-9d4f-202f189acab4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:31.987988 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-bade11a0-a96c-41ae-9d4f-202f189acab4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043676 May 03 08:59:31.988729 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 318/623] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:31 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:32.487659 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-dc0dc036-3a62-421c-bc73-674fd9247db7 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:32.488590 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-dc0dc036-3a62-421c-bc73-674fd9247db7 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:32.496868 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dc0dc036-3a62-421c-bc73-674fd9247db7 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:32.497310 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dc0dc036-3a62-421c-bc73-674fd9247db7 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:32.498066 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dc0dc036-3a62-421c-bc73-674fd9247db7 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:32.498493 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dc0dc036-3a62-421c-bc73-674fd9247db7 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:32.561794 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-dc0dc036-3a62-421c-bc73-674fd9247db7 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:32.569401 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-dc0dc036-3a62-421c-bc73-674fd9247db7 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.088427 May 03 08:59:32.569965 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 306/624] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:32 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:33.004352 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c6e86843-c939-4f11-bf74-b087645733d3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:33.005854 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c6e86843-c939-4f11-bf74-b087645733d3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:33.013902 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c6e86843-c939-4f11-bf74-b087645733d3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:33.014348 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c6e86843-c939-4f11-bf74-b087645733d3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:33.015118 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c6e86843-c939-4f11-bf74-b087645733d3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:33.015553 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c6e86843-c939-4f11-bf74-b087645733d3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:33.044497 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c6e86843-c939-4f11-bf74-b087645733d3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046923 May 03 08:59:33.045043 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 319/625] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:32 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:33.590467 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d46553a5-04ac-4f6d-bd52-7752994f1c93 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:33.591522 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d46553a5-04ac-4f6d-bd52-7752994f1c93 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:33.602698 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d46553a5-04ac-4f6d-bd52-7752994f1c93 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:33.603310 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d46553a5-04ac-4f6d-bd52-7752994f1c93 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:33.604118 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d46553a5-04ac-4f6d-bd52-7752994f1c93 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:33.604551 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d46553a5-04ac-4f6d-bd52-7752994f1c93 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:33.674633 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d46553a5-04ac-4f6d-bd52-7752994f1c93 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:33.682184 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d46553a5-04ac-4f6d-bd52-7752994f1c93 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.098294 May 03 08:59:33.682753 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 307/626] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:33 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:34.060479 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c50bdc36-5248-4999-b1ee-bb313ba47f63 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:34.061981 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c50bdc36-5248-4999-b1ee-bb313ba47f63 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:34.072701 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c50bdc36-5248-4999-b1ee-bb313ba47f63 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:34.073517 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c50bdc36-5248-4999-b1ee-bb313ba47f63 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:34.074707 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c50bdc36-5248-4999-b1ee-bb313ba47f63 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:34.075415 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c50bdc36-5248-4999-b1ee-bb313ba47f63 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:34.109186 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c50bdc36-5248-4999-b1ee-bb313ba47f63 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055544 May 03 08:59:34.109722 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 320/627] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:34 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:34.702250 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6cc95fd5-cc90-4503-b0ab-0b76a8b69d4d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:34.703320 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6cc95fd5-cc90-4503-b0ab-0b76a8b69d4d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:34.713358 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6cc95fd5-cc90-4503-b0ab-0b76a8b69d4d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:34.713800 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6cc95fd5-cc90-4503-b0ab-0b76a8b69d4d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:34.714559 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6cc95fd5-cc90-4503-b0ab-0b76a8b69d4d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:34.714982 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6cc95fd5-cc90-4503-b0ab-0b76a8b69d4d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:34.774674 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6cc95fd5-cc90-4503-b0ab-0b76a8b69d4d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:34.782270 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6cc95fd5-cc90-4503-b0ab-0b76a8b69d4d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.086724 May 03 08:59:34.782828 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 308/628] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:34 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:35.125530 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c390a53e-84e2-4e5f-8d99-8a48ab0d2d0c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:35.126921 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c390a53e-84e2-4e5f-8d99-8a48ab0d2d0c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:35.136488 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c390a53e-84e2-4e5f-8d99-8a48ab0d2d0c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:35.136932 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c390a53e-84e2-4e5f-8d99-8a48ab0d2d0c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:35.137702 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c390a53e-84e2-4e5f-8d99-8a48ab0d2d0c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:35.138123 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c390a53e-84e2-4e5f-8d99-8a48ab0d2d0c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:35.167459 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c390a53e-84e2-4e5f-8d99-8a48ab0d2d0c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048852 May 03 08:59:35.168032 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 321/629] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:35 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:35.802435 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e384f8a6-5873-45e2-9db6-bbaadb65510d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:35.803415 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e384f8a6-5873-45e2-9db6-bbaadb65510d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:35.814448 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e384f8a6-5873-45e2-9db6-bbaadb65510d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:35.815281 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e384f8a6-5873-45e2-9db6-bbaadb65510d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:35.816521 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e384f8a6-5873-45e2-9db6-bbaadb65510d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:35.817326 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e384f8a6-5873-45e2-9db6-bbaadb65510d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:35.880009 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e384f8a6-5873-45e2-9db6-bbaadb65510d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:35.887997 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e384f8a6-5873-45e2-9db6-bbaadb65510d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.092026 May 03 08:59:35.888569 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 309/630] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:35 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:36.184888 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-afcf8e27-a5ad-456e-a900-c9cc9a53398a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:36.186094 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-afcf8e27-a5ad-456e-a900-c9cc9a53398a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:36.194952 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-afcf8e27-a5ad-456e-a900-c9cc9a53398a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:36.195553 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-afcf8e27-a5ad-456e-a900-c9cc9a53398a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:36.196734 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-afcf8e27-a5ad-456e-a900-c9cc9a53398a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:36.197314 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-afcf8e27-a5ad-456e-a900-c9cc9a53398a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:36.232084 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-afcf8e27-a5ad-456e-a900-c9cc9a53398a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053534 May 03 08:59:36.232642 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 322/631] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:36 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:36.906998 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-dc5c3b3f-365d-43eb-9530-ed1cc1a26a50 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:36.907948 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-dc5c3b3f-365d-43eb-9530-ed1cc1a26a50 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:36.917783 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dc5c3b3f-365d-43eb-9530-ed1cc1a26a50 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:36.918468 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dc5c3b3f-365d-43eb-9530-ed1cc1a26a50 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:36.919627 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dc5c3b3f-365d-43eb-9530-ed1cc1a26a50 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:36.920333 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dc5c3b3f-365d-43eb-9530-ed1cc1a26a50 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:36.990914 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-dc5c3b3f-365d-43eb-9530-ed1cc1a26a50 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:36.998822 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-dc5c3b3f-365d-43eb-9530-ed1cc1a26a50 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.097832 May 03 08:59:36.999384 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 310/632] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:36 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:37.243622 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f3f18c6d-a624-4338-b5c6-49c19f3d25b1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:37.244568 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f3f18c6d-a624-4338-b5c6-49c19f3d25b1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:37.251046 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f3f18c6d-a624-4338-b5c6-49c19f3d25b1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:37.251494 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f3f18c6d-a624-4338-b5c6-49c19f3d25b1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:37.252297 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f3f18c6d-a624-4338-b5c6-49c19f3d25b1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:37.252735 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f3f18c6d-a624-4338-b5c6-49c19f3d25b1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:37.283195 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f3f18c6d-a624-4338-b5c6-49c19f3d25b1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043606 May 03 08:59:37.283786 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 323/633] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:37 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:38.019467 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2180f005-44cc-4a67-92aa-33c86e2ca43a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:38.020476 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-2180f005-44cc-4a67-92aa-33c86e2ca43a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:38.031207 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2180f005-44cc-4a67-92aa-33c86e2ca43a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:38.032014 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2180f005-44cc-4a67-92aa-33c86e2ca43a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:38.033309 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2180f005-44cc-4a67-92aa-33c86e2ca43a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:38.034023 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2180f005-44cc-4a67-92aa-33c86e2ca43a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:38.099825 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2180f005-44cc-4a67-92aa-33c86e2ca43a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:38.107792 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-2180f005-44cc-4a67-92aa-33c86e2ca43a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.094738 May 03 08:59:38.108312 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 311/634] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:38 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:38.295062 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9f01413a-1a8c-4718-9321-64b273d1fa34 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:38.296164 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9f01413a-1a8c-4718-9321-64b273d1fa34 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:38.302863 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9f01413a-1a8c-4718-9321-64b273d1fa34 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:38.303308 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9f01413a-1a8c-4718-9321-64b273d1fa34 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:38.304112 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9f01413a-1a8c-4718-9321-64b273d1fa34 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:38.304550 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9f01413a-1a8c-4718-9321-64b273d1fa34 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:38.334190 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9f01413a-1a8c-4718-9321-64b273d1fa34 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043194 May 03 08:59:38.334743 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 324/635] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:38 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:39.129298 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-bc0bc56c-c567-4d83-922f-09b0d7e44620 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:39.130266 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-bc0bc56c-c567-4d83-922f-09b0d7e44620 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:39.140915 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bc0bc56c-c567-4d83-922f-09b0d7e44620 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:39.141656 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bc0bc56c-c567-4d83-922f-09b0d7e44620 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:39.142914 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bc0bc56c-c567-4d83-922f-09b0d7e44620 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:39.143616 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bc0bc56c-c567-4d83-922f-09b0d7e44620 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:39.208731 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-bc0bc56c-c567-4d83-922f-09b0d7e44620 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:39.217190 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-bc0bc56c-c567-4d83-922f-09b0d7e44620 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.094520 May 03 08:59:39.217766 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 312/636] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:39 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:39.350127 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-6a20870e-36d8-4be8-ab44-5d0d0fec15f6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:39.351627 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-6a20870e-36d8-4be8-ab44-5d0d0fec15f6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:39.362297 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6a20870e-36d8-4be8-ab44-5d0d0fec15f6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:39.363038 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6a20870e-36d8-4be8-ab44-5d0d0fec15f6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:39.364362 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6a20870e-36d8-4be8-ab44-5d0d0fec15f6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:39.365093 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6a20870e-36d8-4be8-ab44-5d0d0fec15f6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:39.395193 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-6a20870e-36d8-4be8-ab44-5d0d0fec15f6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052433 May 03 08:59:39.395738 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 325/637] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:39 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:40.235100 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-da5174c8-76bb-4787-95bb-2c191809941f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:40.235687 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-da5174c8-76bb-4787-95bb-2c191809941f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:40.243530 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-da5174c8-76bb-4787-95bb-2c191809941f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:40.244476 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-da5174c8-76bb-4787-95bb-2c191809941f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:40.245826 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-da5174c8-76bb-4787-95bb-2c191809941f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:40.246269 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-da5174c8-76bb-4787-95bb-2c191809941f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:40.317481 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-da5174c8-76bb-4787-95bb-2c191809941f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:40.326533 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-da5174c8-76bb-4787-95bb-2c191809941f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.095078 May 03 08:59:40.327755 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 313/638] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:40 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:40.406779 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-727dba6d-b8e7-4159-b500-41d64a6abdd2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:40.407728 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-727dba6d-b8e7-4159-b500-41d64a6abdd2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:40.414691 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-727dba6d-b8e7-4159-b500-41d64a6abdd2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:40.415149 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-727dba6d-b8e7-4159-b500-41d64a6abdd2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:40.416073 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-727dba6d-b8e7-4159-b500-41d64a6abdd2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:40.416512 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-727dba6d-b8e7-4159-b500-41d64a6abdd2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:40.446958 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-727dba6d-b8e7-4159-b500-41d64a6abdd2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044262 May 03 08:59:40.447581 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 326/639] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:40 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:41.350249 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-20529f88-a21f-4291-94f4-6e5e987ce9b8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:41.351222 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-20529f88-a21f-4291-94f4-6e5e987ce9b8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:41.362011 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-20529f88-a21f-4291-94f4-6e5e987ce9b8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:41.362764 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-20529f88-a21f-4291-94f4-6e5e987ce9b8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:41.364155 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-20529f88-a21f-4291-94f4-6e5e987ce9b8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:41.364881 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-20529f88-a21f-4291-94f4-6e5e987ce9b8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:41.430917 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-20529f88-a21f-4291-94f4-6e5e987ce9b8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:41.438763 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-20529f88-a21f-4291-94f4-6e5e987ce9b8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.095072 May 03 08:59:41.439333 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 314/640] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:41 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:41.458759 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-aeb2e057-a110-4b21-83f1-a590e1f55677 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:41.459681 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-aeb2e057-a110-4b21-83f1-a590e1f55677 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:41.466662 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-aeb2e057-a110-4b21-83f1-a590e1f55677 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:41.467044 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-aeb2e057-a110-4b21-83f1-a590e1f55677 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:41.468142 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-aeb2e057-a110-4b21-83f1-a590e1f55677 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:41.468632 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-aeb2e057-a110-4b21-83f1-a590e1f55677 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:41.498442 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-aeb2e057-a110-4b21-83f1-a590e1f55677 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043787 May 03 08:59:41.498985 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 327/641] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:41 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:42.457487 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-3b1b75a1-aac2-4dfd-8a92-519189b00eae tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:42.458225 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-3b1b75a1-aac2-4dfd-8a92-519189b00eae tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:42.465974 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3b1b75a1-aac2-4dfd-8a92-519189b00eae tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:42.466358 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3b1b75a1-aac2-4dfd-8a92-519189b00eae tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:42.467111 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3b1b75a1-aac2-4dfd-8a92-519189b00eae tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:42.467535 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3b1b75a1-aac2-4dfd-8a92-519189b00eae tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:42.510583 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-0996a124-1ecc-40be-91c3-9eee570279dd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:42.511511 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-0996a124-1ecc-40be-91c3-9eee570279dd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:42.518160 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0996a124-1ecc-40be-91c3-9eee570279dd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:42.518614 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0996a124-1ecc-40be-91c3-9eee570279dd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:42.519429 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0996a124-1ecc-40be-91c3-9eee570279dd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:42.519893 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0996a124-1ecc-40be-91c3-9eee570279dd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:42.528604 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-3b1b75a1-aac2-4dfd-8a92-519189b00eae tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:42.536145 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-3b1b75a1-aac2-4dfd-8a92-519189b00eae tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.083606 May 03 08:59:42.536743 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 315/642] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:42 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:42.549451 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-0996a124-1ecc-40be-91c3-9eee570279dd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043055 May 03 08:59:42.550008 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 328/643] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:42 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:43.557297 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-944b729d-5fd6-4abb-b121-3b5f8ad6214d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:43.558134 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-944b729d-5fd6-4abb-b121-3b5f8ad6214d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:43.565223 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e918ec96-9ec3-4d09-b7c1-ee23a092e3f9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:43.566708 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e918ec96-9ec3-4d09-b7c1-ee23a092e3f9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:43.568629 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-944b729d-5fd6-4abb-b121-3b5f8ad6214d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:43.569380 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-944b729d-5fd6-4abb-b121-3b5f8ad6214d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:43.570637 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-944b729d-5fd6-4abb-b121-3b5f8ad6214d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:43.571360 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-944b729d-5fd6-4abb-b121-3b5f8ad6214d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:43.575196 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e918ec96-9ec3-4d09-b7c1-ee23a092e3f9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:43.575652 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e918ec96-9ec3-4d09-b7c1-ee23a092e3f9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:43.577775 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e918ec96-9ec3-4d09-b7c1-ee23a092e3f9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:43.577775 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e918ec96-9ec3-4d09-b7c1-ee23a092e3f9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:43.613155 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e918ec96-9ec3-4d09-b7c1-ee23a092e3f9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054174 May 03 08:59:43.614122 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 329/644] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:43 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:43.645363 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-944b729d-5fd6-4abb-b121-3b5f8ad6214d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:43.653473 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-944b729d-5fd6-4abb-b121-3b5f8ad6214d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.102708 May 03 08:59:43.654038 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 316/645] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:43 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:44.626617 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f8cfdc6c-8858-4e3f-97a0-e6749c15b89b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:44.627436 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f8cfdc6c-8858-4e3f-97a0-e6749c15b89b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:44.633963 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f8cfdc6c-8858-4e3f-97a0-e6749c15b89b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:44.634404 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f8cfdc6c-8858-4e3f-97a0-e6749c15b89b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:44.635164 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f8cfdc6c-8858-4e3f-97a0-e6749c15b89b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:44.635598 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f8cfdc6c-8858-4e3f-97a0-e6749c15b89b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:44.664899 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f8cfdc6c-8858-4e3f-97a0-e6749c15b89b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042395 May 03 08:59:44.665448 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 330/646] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:44 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:44.670069 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-572f1805-ffb6-4080-b45e-b7a119fda192 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:44.670680 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-572f1805-ffb6-4080-b45e-b7a119fda192 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:44.677720 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-572f1805-ffb6-4080-b45e-b7a119fda192 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:44.678167 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-572f1805-ffb6-4080-b45e-b7a119fda192 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:44.678962 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-572f1805-ffb6-4080-b45e-b7a119fda192 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:44.679400 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-572f1805-ffb6-4080-b45e-b7a119fda192 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:44.746566 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-572f1805-ffb6-4080-b45e-b7a119fda192 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:44.754272 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-572f1805-ffb6-4080-b45e-b7a119fda192 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.087992 May 03 08:59:44.754837 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 317/647] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:44 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:45.680952 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a8c768ec-028f-4aa6-b74d-83bbe45a1f6b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:45.682246 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a8c768ec-028f-4aa6-b74d-83bbe45a1f6b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:45.693167 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a8c768ec-028f-4aa6-b74d-83bbe45a1f6b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:45.693810 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a8c768ec-028f-4aa6-b74d-83bbe45a1f6b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:45.694984 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a8c768ec-028f-4aa6-b74d-83bbe45a1f6b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:45.695611 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a8c768ec-028f-4aa6-b74d-83bbe45a1f6b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:45.727613 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a8c768ec-028f-4aa6-b74d-83bbe45a1f6b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053403 May 03 08:59:45.728194 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 331/648] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:45 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:45.774889 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b3a48274-ddc8-45cd-bd95-d5fb4c1d828b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:45.775925 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b3a48274-ddc8-45cd-bd95-d5fb4c1d828b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:45.786386 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b3a48274-ddc8-45cd-bd95-d5fb4c1d828b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:45.787139 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b3a48274-ddc8-45cd-bd95-d5fb4c1d828b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:45.788463 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b3a48274-ddc8-45cd-bd95-d5fb4c1d828b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:45.789170 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b3a48274-ddc8-45cd-bd95-d5fb4c1d828b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:45.860225 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b3a48274-ddc8-45cd-bd95-d5fb4c1d828b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:45.867721 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b3a48274-ddc8-45cd-bd95-d5fb4c1d828b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.099248 May 03 08:59:45.868306 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 318/649] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:45 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:46.741857 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-0483100d-2c5c-4220-a108-01391c0d0331 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:46.742779 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-0483100d-2c5c-4220-a108-01391c0d0331 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:46.749724 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0483100d-2c5c-4220-a108-01391c0d0331 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:46.750172 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0483100d-2c5c-4220-a108-01391c0d0331 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:46.750942 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0483100d-2c5c-4220-a108-01391c0d0331 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:46.751375 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0483100d-2c5c-4220-a108-01391c0d0331 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:46.787820 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-0483100d-2c5c-4220-a108-01391c0d0331 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050097 May 03 08:59:46.788356 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 332/650] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:46 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:46.888843 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0447ac49-c781-478d-944e-622652b73076 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:46.889768 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0447ac49-c781-478d-944e-622652b73076 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:46.900347 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0447ac49-c781-478d-944e-622652b73076 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:46.901087 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0447ac49-c781-478d-944e-622652b73076 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:46.901985 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0447ac49-c781-478d-944e-622652b73076 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:46.902385 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0447ac49-c781-478d-944e-622652b73076 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:46.964396 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0447ac49-c781-478d-944e-622652b73076 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:46.972237 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0447ac49-c781-478d-944e-622652b73076 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.089794 May 03 08:59:46.972796 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 319/651] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:46 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:47.805316 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9c5ed0a3-6bd3-4f1a-b3bb-9f3d73cc35cd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:47.807013 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9c5ed0a3-6bd3-4f1a-b3bb-9f3d73cc35cd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:47.817948 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9c5ed0a3-6bd3-4f1a-b3bb-9f3d73cc35cd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:47.818706 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9c5ed0a3-6bd3-4f1a-b3bb-9f3d73cc35cd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:47.820035 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9c5ed0a3-6bd3-4f1a-b3bb-9f3d73cc35cd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:47.820767 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9c5ed0a3-6bd3-4f1a-b3bb-9f3d73cc35cd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:47.851434 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9c5ed0a3-6bd3-4f1a-b3bb-9f3d73cc35cd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052895 May 03 08:59:47.852020 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 333/652] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:47 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:47.992659 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4a902dd3-a8aa-4bc8-b699-70619e6ac3c7 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:47.993487 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4a902dd3-a8aa-4bc8-b699-70619e6ac3c7 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:48.004238 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4a902dd3-a8aa-4bc8-b699-70619e6ac3c7 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:48.004978 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4a902dd3-a8aa-4bc8-b699-70619e6ac3c7 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:48.006310 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4a902dd3-a8aa-4bc8-b699-70619e6ac3c7 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:48.007025 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4a902dd3-a8aa-4bc8-b699-70619e6ac3c7 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:48.085135 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-4a902dd3-a8aa-4bc8-b699-70619e6ac3c7 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:48.095709 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-4a902dd3-a8aa-4bc8-b699-70619e6ac3c7 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.109326 May 03 08:59:48.096482 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 320/653] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:47 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:48.866872 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-6cb3415a-7c3c-4317-b9a5-7398f032f0bc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:48.868365 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-6cb3415a-7c3c-4317-b9a5-7398f032f0bc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:48.876233 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6cb3415a-7c3c-4317-b9a5-7398f032f0bc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:48.876721 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6cb3415a-7c3c-4317-b9a5-7398f032f0bc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:48.877560 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6cb3415a-7c3c-4317-b9a5-7398f032f0bc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:48.878037 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6cb3415a-7c3c-4317-b9a5-7398f032f0bc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:48.909540 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-6cb3415a-7c3c-4317-b9a5-7398f032f0bc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049400 May 03 08:59:48.910070 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 334/654] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:48 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:49.121272 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a8694133-f71f-41db-a8f5-978ce1886930 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:49.122156 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a8694133-f71f-41db-a8f5-978ce1886930 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:49.132680 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a8694133-f71f-41db-a8f5-978ce1886930 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:49.133416 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a8694133-f71f-41db-a8f5-978ce1886930 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:49.134662 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a8694133-f71f-41db-a8f5-978ce1886930 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:49.135382 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a8694133-f71f-41db-a8f5-978ce1886930 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:49.211754 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a8694133-f71f-41db-a8f5-978ce1886930 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:49.220103 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a8694133-f71f-41db-a8f5-978ce1886930 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.105644 May 03 08:59:49.220685 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 321/655] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:49 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:49.925898 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-4e4e58c3-9df0-49c7-937f-b91d4a8ca48c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:49.927333 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-4e4e58c3-9df0-49c7-937f-b91d4a8ca48c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:49.938000 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4e4e58c3-9df0-49c7-937f-b91d4a8ca48c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:49.938778 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4e4e58c3-9df0-49c7-937f-b91d4a8ca48c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:49.940123 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4e4e58c3-9df0-49c7-937f-b91d4a8ca48c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:49.940849 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4e4e58c3-9df0-49c7-937f-b91d4a8ca48c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:49.984258 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-4e4e58c3-9df0-49c7-937f-b91d4a8ca48c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065141 May 03 08:59:49.984806 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 335/656] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:49 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:50.237146 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b2d2911a-d97c-4ac8-8449-d505b5399886 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:50.237758 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b2d2911a-d97c-4ac8-8449-d505b5399886 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:50.244478 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b2d2911a-d97c-4ac8-8449-d505b5399886 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:50.244929 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b2d2911a-d97c-4ac8-8449-d505b5399886 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:50.245694 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b2d2911a-d97c-4ac8-8449-d505b5399886 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:50.246130 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b2d2911a-d97c-4ac8-8449-d505b5399886 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:50.306380 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b2d2911a-d97c-4ac8-8449-d505b5399886 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:50.314045 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b2d2911a-d97c-4ac8-8449-d505b5399886 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.080828 May 03 08:59:50.314606 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 322/657] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:50 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:51.000459 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-cdbe0de7-3fda-4568-b7d9-249290b9e70e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:51.001938 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-cdbe0de7-3fda-4568-b7d9-249290b9e70e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:51.012044 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cdbe0de7-3fda-4568-b7d9-249290b9e70e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:51.012490 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cdbe0de7-3fda-4568-b7d9-249290b9e70e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:51.013265 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cdbe0de7-3fda-4568-b7d9-249290b9e70e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:51.013695 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cdbe0de7-3fda-4568-b7d9-249290b9e70e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:51.042564 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-cdbe0de7-3fda-4568-b7d9-249290b9e70e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048871 May 03 08:59:51.043112 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 336/658] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:50 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:51.338686 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-353b7a32-c7f5-47c0-a1ef-11987d3b188a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:51.339525 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-353b7a32-c7f5-47c0-a1ef-11987d3b188a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:51.347693 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-353b7a32-c7f5-47c0-a1ef-11987d3b188a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:51.348265 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-353b7a32-c7f5-47c0-a1ef-11987d3b188a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:51.349160 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-353b7a32-c7f5-47c0-a1ef-11987d3b188a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:51.349673 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-353b7a32-c7f5-47c0-a1ef-11987d3b188a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:51.419802 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-353b7a32-c7f5-47c0-a1ef-11987d3b188a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:51.427805 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-353b7a32-c7f5-47c0-a1ef-11987d3b188a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.095662 May 03 08:59:51.428360 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 323/659] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:51 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:52.054282 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ae212566-07e1-4b3c-926b-52ee0aa0aca7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:52.055137 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ae212566-07e1-4b3c-926b-52ee0aa0aca7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:52.061903 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ae212566-07e1-4b3c-926b-52ee0aa0aca7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:52.062348 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ae212566-07e1-4b3c-926b-52ee0aa0aca7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:52.063106 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ae212566-07e1-4b3c-926b-52ee0aa0aca7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:52.063533 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ae212566-07e1-4b3c-926b-52ee0aa0aca7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:52.094900 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ae212566-07e1-4b3c-926b-52ee0aa0aca7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044384 May 03 08:59:52.095711 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 337/660] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:52 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:52.444867 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6165ba00-2183-4aec-9746-93928db9adb6 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:52.445480 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6165ba00-2183-4aec-9746-93928db9adb6 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:52.453485 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6165ba00-2183-4aec-9746-93928db9adb6 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:52.453924 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6165ba00-2183-4aec-9746-93928db9adb6 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:52.454691 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6165ba00-2183-4aec-9746-93928db9adb6 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:52.455123 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6165ba00-2183-4aec-9746-93928db9adb6 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:52.524393 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6165ba00-2183-4aec-9746-93928db9adb6 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:52.531929 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6165ba00-2183-4aec-9746-93928db9adb6 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.090976 May 03 08:59:52.532484 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 324/661] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:52 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:53.111064 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-90f93699-9104-45d8-a4a6-429a436e2fe9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:53.112590 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-90f93699-9104-45d8-a4a6-429a436e2fe9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:53.123262 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-90f93699-9104-45d8-a4a6-429a436e2fe9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:53.124065 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-90f93699-9104-45d8-a4a6-429a436e2fe9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:53.125318 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-90f93699-9104-45d8-a4a6-429a436e2fe9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:53.126047 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-90f93699-9104-45d8-a4a6-429a436e2fe9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:53.160802 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-90f93699-9104-45d8-a4a6-429a436e2fe9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056690 May 03 08:59:53.161360 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 338/662] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:53 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:53.553171 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-75b0af5d-b327-4912-93a5-88f05c48c461 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:53.554227 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-75b0af5d-b327-4912-93a5-88f05c48c461 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:53.562985 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-75b0af5d-b327-4912-93a5-88f05c48c461 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:53.563428 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-75b0af5d-b327-4912-93a5-88f05c48c461 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:53.564224 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-75b0af5d-b327-4912-93a5-88f05c48c461 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:53.564656 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-75b0af5d-b327-4912-93a5-88f05c48c461 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:53.637501 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-75b0af5d-b327-4912-93a5-88f05c48c461 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:53.645683 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-75b0af5d-b327-4912-93a5-88f05c48c461 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.099310 May 03 08:59:53.646244 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 325/663] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:53 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:54.177043 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-1648eb1d-73fc-45c0-9545-a61ebd62bd1b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:54.178525 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-1648eb1d-73fc-45c0-9545-a61ebd62bd1b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:54.187299 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1648eb1d-73fc-45c0-9545-a61ebd62bd1b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:54.187750 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1648eb1d-73fc-45c0-9545-a61ebd62bd1b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:54.188565 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1648eb1d-73fc-45c0-9545-a61ebd62bd1b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:54.189046 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1648eb1d-73fc-45c0-9545-a61ebd62bd1b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:54.219217 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-1648eb1d-73fc-45c0-9545-a61ebd62bd1b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048966 May 03 08:59:54.219808 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 339/664] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:54 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:54.662833 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e38b81d9-31c0-4177-be8c-16819aad10f3 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:54.663431 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e38b81d9-31c0-4177-be8c-16819aad10f3 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:54.670199 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e38b81d9-31c0-4177-be8c-16819aad10f3 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:54.670654 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e38b81d9-31c0-4177-be8c-16819aad10f3 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:54.671424 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e38b81d9-31c0-4177-be8c-16819aad10f3 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:54.671901 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e38b81d9-31c0-4177-be8c-16819aad10f3 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:54.734671 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e38b81d9-31c0-4177-be8c-16819aad10f3 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:54.746050 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e38b81d9-31c0-4177-be8c-16819aad10f3 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.086936 May 03 08:59:54.746880 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 326/665] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:54 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:55.233667 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-199f0b17-8610-4662-b89c-8f4837fbad2f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:55.234593 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-199f0b17-8610-4662-b89c-8f4837fbad2f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:55.241289 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-199f0b17-8610-4662-b89c-8f4837fbad2f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:55.241751 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-199f0b17-8610-4662-b89c-8f4837fbad2f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:55.242517 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-199f0b17-8610-4662-b89c-8f4837fbad2f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:55.242950 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-199f0b17-8610-4662-b89c-8f4837fbad2f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:55.272610 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-199f0b17-8610-4662-b89c-8f4837fbad2f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044332 May 03 08:59:55.273086 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 340/666] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:55 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:55.766995 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9ab9458b-8fe1-4f5c-9ed2-db2ae4b2e379 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:55.768053 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9ab9458b-8fe1-4f5c-9ed2-db2ae4b2e379 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:55.778490 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9ab9458b-8fe1-4f5c-9ed2-db2ae4b2e379 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:55.778937 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9ab9458b-8fe1-4f5c-9ed2-db2ae4b2e379 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:55.779702 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9ab9458b-8fe1-4f5c-9ed2-db2ae4b2e379 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:55.780168 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9ab9458b-8fe1-4f5c-9ed2-db2ae4b2e379 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:55.853023 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9ab9458b-8fe1-4f5c-9ed2-db2ae4b2e379 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:55.864061 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9ab9458b-8fe1-4f5c-9ed2-db2ae4b2e379 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.103306 May 03 08:59:55.864779 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 327/667] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:55 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:56.288869 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-74c245d2-f364-4194-8b94-7f168a0320c0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:56.290350 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-74c245d2-f364-4194-8b94-7f168a0320c0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:56.300606 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-74c245d2-f364-4194-8b94-7f168a0320c0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:56.301345 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-74c245d2-f364-4194-8b94-7f168a0320c0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:56.302608 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-74c245d2-f364-4194-8b94-7f168a0320c0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:56.303340 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-74c245d2-f364-4194-8b94-7f168a0320c0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:56.334473 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-74c245d2-f364-4194-8b94-7f168a0320c0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052315 May 03 08:59:56.335032 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 341/668] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:56 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:56.887271 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4cf3d581-9af9-4c42-b223-980297e6172d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:56.888139 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4cf3d581-9af9-4c42-b223-980297e6172d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:56.896425 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4cf3d581-9af9-4c42-b223-980297e6172d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:56.896986 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4cf3d581-9af9-4c42-b223-980297e6172d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:56.897946 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4cf3d581-9af9-4c42-b223-980297e6172d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:56.898477 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4cf3d581-9af9-4c42-b223-980297e6172d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:56.962930 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-4cf3d581-9af9-4c42-b223-980297e6172d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:56.971280 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-4cf3d581-9af9-4c42-b223-980297e6172d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.090752 May 03 08:59:56.971862 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 328/669] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:56 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:57.351069 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b6e1d91a-3302-47a4-8388-109a4e011bdb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:57.352574 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b6e1d91a-3302-47a4-8388-109a4e011bdb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:57.363074 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b6e1d91a-3302-47a4-8388-109a4e011bdb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:57.363833 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b6e1d91a-3302-47a4-8388-109a4e011bdb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:57.365103 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b6e1d91a-3302-47a4-8388-109a4e011bdb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:57.365819 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b6e1d91a-3302-47a4-8388-109a4e011bdb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:57.397452 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b6e1d91a-3302-47a4-8388-109a4e011bdb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053103 May 03 08:59:57.397964 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 342/670] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:57 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:57.992839 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7a2e499c-4be2-46f2-81d2-36d7ded6a497 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:57.993837 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7a2e499c-4be2-46f2-81d2-36d7ded6a497 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:58.001625 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7a2e499c-4be2-46f2-81d2-36d7ded6a497 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:58.002069 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7a2e499c-4be2-46f2-81d2-36d7ded6a497 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:58.002833 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7a2e499c-4be2-46f2-81d2-36d7ded6a497 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:58.003258 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7a2e499c-4be2-46f2-81d2-36d7ded6a497 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:58.071987 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7a2e499c-4be2-46f2-81d2-36d7ded6a497 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:58.080166 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7a2e499c-4be2-46f2-81d2-36d7ded6a497 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.093569 May 03 08:59:58.080871 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 329/671] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:57 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:58.413766 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-6ac097cb-90a7-4795-90c9-2738874c5111 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:58.415335 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-6ac097cb-90a7-4795-90c9-2738874c5111 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:58.423328 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6ac097cb-90a7-4795-90c9-2738874c5111 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:58.423796 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6ac097cb-90a7-4795-90c9-2738874c5111 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:58.424649 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6ac097cb-90a7-4795-90c9-2738874c5111 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:58.425084 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6ac097cb-90a7-4795-90c9-2738874c5111 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:58.455878 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-6ac097cb-90a7-4795-90c9-2738874c5111 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048954 May 03 08:59:58.456434 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 343/672] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:58 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 08:59:59.102070 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b3ef805c-68c7-49f5-a8ad-575c1b0d9c3b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:59.103074 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b3ef805c-68c7-49f5-a8ad-575c1b0d9c3b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:59.110923 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b3ef805c-68c7-49f5-a8ad-575c1b0d9c3b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:59.111372 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b3ef805c-68c7-49f5-a8ad-575c1b0d9c3b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:59.112176 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b3ef805c-68c7-49f5-a8ad-575c1b0d9c3b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:59.112608 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b3ef805c-68c7-49f5-a8ad-575c1b0d9c3b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:59.173894 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b3ef805c-68c7-49f5-a8ad-575c1b0d9c3b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 08:59:59.181905 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b3ef805c-68c7-49f5-a8ad-575c1b0d9c3b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.086623 May 03 08:59:59.182498 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 330/673] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 08:59:59 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 08:59:59.470195 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5d8b66f9-6eea-48a4-b7ea-6095f7a566c8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 08:59:59.471598 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5d8b66f9-6eea-48a4-b7ea-6095f7a566c8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 08:59:59.481676 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5d8b66f9-6eea-48a4-b7ea-6095f7a566c8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:59.482356 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5d8b66f9-6eea-48a4-b7ea-6095f7a566c8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:59.483528 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5d8b66f9-6eea-48a4-b7ea-6095f7a566c8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 08:59:59.484236 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5d8b66f9-6eea-48a4-b7ea-6095f7a566c8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 08:59:59.517375 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5d8b66f9-6eea-48a4-b7ea-6095f7a566c8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053349 May 03 08:59:59.517922 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 344/674] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 08:59:59 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:00.207686 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-510e727e-0d7f-4637-8eca-e0d8841fb63a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:00.208564 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-510e727e-0d7f-4637-8eca-e0d8841fb63a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:00.218029 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-510e727e-0d7f-4637-8eca-e0d8841fb63a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:00.218477 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-510e727e-0d7f-4637-8eca-e0d8841fb63a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:00.219258 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-510e727e-0d7f-4637-8eca-e0d8841fb63a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:00.219690 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-510e727e-0d7f-4637-8eca-e0d8841fb63a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:00.282076 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-510e727e-0d7f-4637-8eca-e0d8841fb63a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:00.292663 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-510e727e-0d7f-4637-8eca-e0d8841fb63a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.091208 May 03 09:00:00.293512 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 331/675] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:00 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:00.533590 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-84644716-cc98-464a-9034-b2223584a8e0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:00.534971 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-84644716-cc98-464a-9034-b2223584a8e0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:00.544723 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-84644716-cc98-464a-9034-b2223584a8e0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:00.545177 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-84644716-cc98-464a-9034-b2223584a8e0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:00.545940 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-84644716-cc98-464a-9034-b2223584a8e0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:00.546369 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-84644716-cc98-464a-9034-b2223584a8e0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:00.575438 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-84644716-cc98-464a-9034-b2223584a8e0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048776 May 03 09:00:00.576048 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 345/676] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:00 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:01.318539 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f1493ceb-094d-4e4a-9fa4-292f5869b14d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:01.319541 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f1493ceb-094d-4e4a-9fa4-292f5869b14d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:01.327846 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f1493ceb-094d-4e4a-9fa4-292f5869b14d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:01.328318 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f1493ceb-094d-4e4a-9fa4-292f5869b14d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:01.329081 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f1493ceb-094d-4e4a-9fa4-292f5869b14d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:01.329508 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f1493ceb-094d-4e4a-9fa4-292f5869b14d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:01.400739 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f1493ceb-094d-4e4a-9fa4-292f5869b14d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:01.413084 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f1493ceb-094d-4e4a-9fa4-292f5869b14d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.100892 May 03 09:00:01.414026 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 332/677] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:01 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:01.592307 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-04fdd0ab-1472-44ea-9eba-42dc5b03d2c1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:01.593678 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-04fdd0ab-1472-44ea-9eba-42dc5b03d2c1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:01.604264 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-04fdd0ab-1472-44ea-9eba-42dc5b03d2c1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:01.605005 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-04fdd0ab-1472-44ea-9eba-42dc5b03d2c1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:01.606272 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-04fdd0ab-1472-44ea-9eba-42dc5b03d2c1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:01.606997 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-04fdd0ab-1472-44ea-9eba-42dc5b03d2c1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:01.642026 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-04fdd0ab-1472-44ea-9eba-42dc5b03d2c1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057128 May 03 09:00:01.642579 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 346/678] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:01 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:02.431684 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9631ec40-64bc-40b6-96d0-1caecb2cc535 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:02.432597 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9631ec40-64bc-40b6-96d0-1caecb2cc535 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:02.439417 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9631ec40-64bc-40b6-96d0-1caecb2cc535 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:02.439886 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9631ec40-64bc-40b6-96d0-1caecb2cc535 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:02.440652 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9631ec40-64bc-40b6-96d0-1caecb2cc535 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:02.441084 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9631ec40-64bc-40b6-96d0-1caecb2cc535 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:02.506917 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9631ec40-64bc-40b6-96d0-1caecb2cc535 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:02.514862 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9631ec40-64bc-40b6-96d0-1caecb2cc535 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.086834 May 03 09:00:02.515825 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 333/679] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:02 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:02.653921 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-69c4f279-3323-4fa0-96bf-a5cad994874e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:02.655017 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-69c4f279-3323-4fa0-96bf-a5cad994874e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:02.661426 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-69c4f279-3323-4fa0-96bf-a5cad994874e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:02.661878 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-69c4f279-3323-4fa0-96bf-a5cad994874e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:02.662678 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-69c4f279-3323-4fa0-96bf-a5cad994874e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:02.663143 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-69c4f279-3323-4fa0-96bf-a5cad994874e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:02.685513 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-38d996a8-98c6-49dd-bb45-ce9706bca6b6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:02.686305 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-38d996a8-98c6-49dd-bb45-ce9706bca6b6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:02.692603 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-38d996a8-98c6-49dd-bb45-ce9706bca6b6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:02.693123 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-38d996a8-98c6-49dd-bb45-ce9706bca6b6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:02.693348 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-69c4f279-3323-4fa0-96bf-a5cad994874e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043349 May 03 09:00:02.697260 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-38d996a8-98c6-49dd-bb45-ce9706bca6b6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:02.697403 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 347/680] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:02 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:02.697500 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-38d996a8-98c6-49dd-bb45-ce9706bca6b6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:03.534430 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e737b322-6e77-41a7-b2f0-71ade4b535d2 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:03.535173 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e737b322-6e77-41a7-b2f0-71ade4b535d2 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:03.544136 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e737b322-6e77-41a7-b2f0-71ade4b535d2 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:03.544580 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e737b322-6e77-41a7-b2f0-71ade4b535d2 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:03.545341 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e737b322-6e77-41a7-b2f0-71ade4b535d2 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:03.545769 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e737b322-6e77-41a7-b2f0-71ade4b535d2 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:03.662761 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e737b322-6e77-41a7-b2f0-71ade4b535d2 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:03.671694 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e737b322-6e77-41a7-b2f0-71ade4b535d2 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.142968 May 03 09:00:03.672290 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 348/681] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:03 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:03.705161 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-07d16e61-4368-427d-a4fd-920d411798bd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:03.706069 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-07d16e61-4368-427d-a4fd-920d411798bd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:03.712540 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-07d16e61-4368-427d-a4fd-920d411798bd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:03.712990 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-07d16e61-4368-427d-a4fd-920d411798bd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:03.713759 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-07d16e61-4368-427d-a4fd-920d411798bd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:03.714188 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-07d16e61-4368-427d-a4fd-920d411798bd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:03.744261 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-07d16e61-4368-427d-a4fd-920d411798bd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042881 May 03 09:00:03.744828 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 349/682] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:03 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:04.691593 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-0e389170-dcf1-40ee-87b4-3e72ad0743dc tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:04.692660 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-0e389170-dcf1-40ee-87b4-3e72ad0743dc tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:04.703387 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0e389170-dcf1-40ee-87b4-3e72ad0743dc tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:04.704201 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0e389170-dcf1-40ee-87b4-3e72ad0743dc tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:04.705456 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0e389170-dcf1-40ee-87b4-3e72ad0743dc tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:04.706178 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0e389170-dcf1-40ee-87b4-3e72ad0743dc tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:04.771422 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-0e389170-dcf1-40ee-87b4-3e72ad0743dc tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:04.779012 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-0e389170-dcf1-40ee-87b4-3e72ad0743dc tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.093879 May 03 09:00:04.779581 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 350/683] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:04 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:04.784078 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-0894508e-2b7c-4f7a-af82-ccacd4fffb77 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:04.784980 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-0894508e-2b7c-4f7a-af82-ccacd4fffb77 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:04.790544 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0894508e-2b7c-4f7a-af82-ccacd4fffb77 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:04.790985 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0894508e-2b7c-4f7a-af82-ccacd4fffb77 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:04.791799 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0894508e-2b7c-4f7a-af82-ccacd4fffb77 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:04.792236 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0894508e-2b7c-4f7a-af82-ccacd4fffb77 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:04.820061 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-0894508e-2b7c-4f7a-af82-ccacd4fffb77 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039454 May 03 09:00:04.820612 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 351/684] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:04 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:05.799843 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d18ce526-1f33-486b-b8ff-648c82b7f958 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:05.800453 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d18ce526-1f33-486b-b8ff-648c82b7f958 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:05.810468 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d18ce526-1f33-486b-b8ff-648c82b7f958 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:05.811121 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d18ce526-1f33-486b-b8ff-648c82b7f958 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:05.812297 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d18ce526-1f33-486b-b8ff-648c82b7f958 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:05.812931 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d18ce526-1f33-486b-b8ff-648c82b7f958 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:05.880357 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d18ce526-1f33-486b-b8ff-648c82b7f958 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:05.887990 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d18ce526-1f33-486b-b8ff-648c82b7f958 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.094228 May 03 09:00:05.888556 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 352/685] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:05 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:05.893195 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-69597ab0-fd8e-4be4-9a3f-a61437815232 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:05.894096 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-69597ab0-fd8e-4be4-9a3f-a61437815232 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:05.900208 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-69597ab0-fd8e-4be4-9a3f-a61437815232 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:05.900657 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-69597ab0-fd8e-4be4-9a3f-a61437815232 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:05.901426 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-69597ab0-fd8e-4be4-9a3f-a61437815232 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:05.901860 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-69597ab0-fd8e-4be4-9a3f-a61437815232 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:05.929870 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-69597ab0-fd8e-4be4-9a3f-a61437815232 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040322 May 03 09:00:05.930394 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 353/686] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:05 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:07.033555 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-0c65774b-4b0f-4cb2-a1d0-6bc183445fb1 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:07.034172 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-0c65774b-4b0f-4cb2-a1d0-6bc183445fb1 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:07.040842 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0c65774b-4b0f-4cb2-a1d0-6bc183445fb1 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:07.041285 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0c65774b-4b0f-4cb2-a1d0-6bc183445fb1 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:07.042034 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0c65774b-4b0f-4cb2-a1d0-6bc183445fb1 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:07.042462 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0c65774b-4b0f-4cb2-a1d0-6bc183445fb1 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:07.112657 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-0c65774b-4b0f-4cb2-a1d0-6bc183445fb1 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:07.120484 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-0c65774b-4b0f-4cb2-a1d0-6bc183445fb1 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.218765 May 03 09:00:07.121124 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 354/687] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:06 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:07.126276 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-713e9447-119d-43e3-aab5-7c04db30956b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:07.127225 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-713e9447-119d-43e3-aab5-7c04db30956b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:07.134976 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-713e9447-119d-43e3-aab5-7c04db30956b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:07.135579 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-713e9447-119d-43e3-aab5-7c04db30956b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:07.136727 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-713e9447-119d-43e3-aab5-7c04db30956b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:07.137150 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-713e9447-119d-43e3-aab5-7c04db30956b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:07.165847 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-713e9447-119d-43e3-aab5-7c04db30956b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043466 May 03 09:00:07.166304 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 355/688] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:07 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:08.140010 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-47a92853-f967-47bd-b3bd-fbc8e9d2d59f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:08.140774 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-47a92853-f967-47bd-b3bd-fbc8e9d2d59f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:08.148264 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-47a92853-f967-47bd-b3bd-fbc8e9d2d59f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:08.148787 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-47a92853-f967-47bd-b3bd-fbc8e9d2d59f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:08.149657 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-47a92853-f967-47bd-b3bd-fbc8e9d2d59f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:08.150215 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-47a92853-f967-47bd-b3bd-fbc8e9d2d59f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:08.213070 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-47a92853-f967-47bd-b3bd-fbc8e9d2d59f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:08.221323 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-47a92853-f967-47bd-b3bd-fbc8e9d2d59f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.086778 May 03 09:00:08.221885 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 356/689] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:08 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:08.226433 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-bb81a0a5-812b-418a-9784-c020ff41e83d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:08.227316 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-bb81a0a5-812b-418a-9784-c020ff41e83d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:08.233184 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bb81a0a5-812b-418a-9784-c020ff41e83d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:08.233591 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bb81a0a5-812b-418a-9784-c020ff41e83d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:08.234372 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bb81a0a5-812b-418a-9784-c020ff41e83d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:08.234795 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bb81a0a5-812b-418a-9784-c020ff41e83d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:08.264472 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-bb81a0a5-812b-418a-9784-c020ff41e83d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041549 May 03 09:00:08.265019 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 357/690] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:08 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:09.238235 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-4b511f4f-0b98-4d27-8dba-33b0ab068918 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:09.238829 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-4b511f4f-0b98-4d27-8dba-33b0ab068918 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:09.245501 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4b511f4f-0b98-4d27-8dba-33b0ab068918 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:09.245993 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4b511f4f-0b98-4d27-8dba-33b0ab068918 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:09.246759 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4b511f4f-0b98-4d27-8dba-33b0ab068918 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:09.247189 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4b511f4f-0b98-4d27-8dba-33b0ab068918 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:09.318163 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-4b511f4f-0b98-4d27-8dba-33b0ab068918 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:09.325686 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-4b511f4f-0b98-4d27-8dba-33b0ab068918 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.091352 May 03 09:00:09.326248 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 358/691] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:09 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:09.330741 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-7447631c-bf8d-4c7d-8c30-1d1c24d923d0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:09.331637 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-7447631c-bf8d-4c7d-8c30-1d1c24d923d0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:09.337473 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7447631c-bf8d-4c7d-8c30-1d1c24d923d0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:09.337932 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7447631c-bf8d-4c7d-8c30-1d1c24d923d0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:09.338673 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7447631c-bf8d-4c7d-8c30-1d1c24d923d0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:09.339115 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7447631c-bf8d-4c7d-8c30-1d1c24d923d0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:09.368453 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-7447631c-bf8d-4c7d-8c30-1d1c24d923d0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041196 May 03 09:00:09.369027 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 359/692] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:09 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:10.346141 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-7e475ea9-2d6a-48ca-a024-802ca3a805a4 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:10.346907 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-7e475ea9-2d6a-48ca-a024-802ca3a805a4 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:10.356103 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7e475ea9-2d6a-48ca-a024-802ca3a805a4 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:10.356552 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7e475ea9-2d6a-48ca-a024-802ca3a805a4 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:10.357321 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7e475ea9-2d6a-48ca-a024-802ca3a805a4 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:10.357753 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7e475ea9-2d6a-48ca-a024-802ca3a805a4 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:10.427984 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7e475ea9-2d6a-48ca-a024-802ca3a805a4 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:10.436079 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-7e475ea9-2d6a-48ca-a024-802ca3a805a4 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.096354 May 03 09:00:10.436658 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 360/693] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:10 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:10.441135 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-1ef57a32-2b9b-4d19-9ef2-89d2e9d39ace tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:10.442043 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-1ef57a32-2b9b-4d19-9ef2-89d2e9d39ace tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:10.447532 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1ef57a32-2b9b-4d19-9ef2-89d2e9d39ace tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:10.448030 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1ef57a32-2b9b-4d19-9ef2-89d2e9d39ace tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:10.448855 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1ef57a32-2b9b-4d19-9ef2-89d2e9d39ace tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:10.449294 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1ef57a32-2b9b-4d19-9ef2-89d2e9d39ace tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:10.479644 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-1ef57a32-2b9b-4d19-9ef2-89d2e9d39ace tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041940 May 03 09:00:10.480280 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 361/694] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:10 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:11.456595 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3c9d16c2-edbb-4c99-865f-f5af2157d531 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:11.457764 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-3c9d16c2-edbb-4c99-865f-f5af2157d531 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:11.467198 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3c9d16c2-edbb-4c99-865f-f5af2157d531 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:11.467586 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3c9d16c2-edbb-4c99-865f-f5af2157d531 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:11.468378 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3c9d16c2-edbb-4c99-865f-f5af2157d531 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:11.468817 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3c9d16c2-edbb-4c99-865f-f5af2157d531 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:11.542148 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-3c9d16c2-edbb-4c99-865f-f5af2157d531 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:11.550510 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-3c9d16c2-edbb-4c99-865f-f5af2157d531 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.100411 May 03 09:00:11.551076 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 362/695] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:11 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:11.555695 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-1750d58a-940c-421e-8460-565ee754a0ea tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:11.556658 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-1750d58a-940c-421e-8460-565ee754a0ea tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:11.562359 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1750d58a-940c-421e-8460-565ee754a0ea tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:11.562835 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1750d58a-940c-421e-8460-565ee754a0ea tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:11.563632 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1750d58a-940c-421e-8460-565ee754a0ea tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:11.564102 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1750d58a-940c-421e-8460-565ee754a0ea tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:11.592421 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-1750d58a-940c-421e-8460-565ee754a0ea tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040358 May 03 09:00:11.592999 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 363/696] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:11 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:12.571455 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-91f86bde-4238-461f-8413-31837a06db50 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:12.572605 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-91f86bde-4238-461f-8413-31837a06db50 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:12.579552 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-91f86bde-4238-461f-8413-31837a06db50 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:12.580041 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-91f86bde-4238-461f-8413-31837a06db50 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:12.580808 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-91f86bde-4238-461f-8413-31837a06db50 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:12.581241 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-91f86bde-4238-461f-8413-31837a06db50 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:12.649654 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-91f86bde-4238-461f-8413-31837a06db50 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:12.657248 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-91f86bde-4238-461f-8413-31837a06db50 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.092340 May 03 09:00:12.657810 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 364/697] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:12 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:12.662275 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d3041a4e-47f0-4004-8e29-2d442a922336 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:12.663174 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d3041a4e-47f0-4004-8e29-2d442a922336 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:12.668962 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d3041a4e-47f0-4004-8e29-2d442a922336 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:12.669394 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d3041a4e-47f0-4004-8e29-2d442a922336 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:12.670150 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d3041a4e-47f0-4004-8e29-2d442a922336 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:12.670576 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d3041a4e-47f0-4004-8e29-2d442a922336 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:12.698692 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d3041a4e-47f0-4004-8e29-2d442a922336 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039854 May 03 09:00:12.699229 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 365/698] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:12 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:13.678515 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ae200ed7-1ac3-45b2-84e9-c8f739a2e949 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:13.679542 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ae200ed7-1ac3-45b2-84e9-c8f739a2e949 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:13.687555 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ae200ed7-1ac3-45b2-84e9-c8f739a2e949 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:13.688110 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ae200ed7-1ac3-45b2-84e9-c8f739a2e949 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:13.688878 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ae200ed7-1ac3-45b2-84e9-c8f739a2e949 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:13.689303 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ae200ed7-1ac3-45b2-84e9-c8f739a2e949 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:13.758867 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ae200ed7-1ac3-45b2-84e9-c8f739a2e949 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:13.766663 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ae200ed7-1ac3-45b2-84e9-c8f739a2e949 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.094885 May 03 09:00:13.767230 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 366/699] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:13 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:13.771939 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d5f19b43-75ba-403a-94bc-7b854a693a5f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:13.772815 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d5f19b43-75ba-403a-94bc-7b854a693a5f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:13.780477 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d5f19b43-75ba-403a-94bc-7b854a693a5f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:13.780923 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d5f19b43-75ba-403a-94bc-7b854a693a5f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:13.781677 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d5f19b43-75ba-403a-94bc-7b854a693a5f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:13.782103 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d5f19b43-75ba-403a-94bc-7b854a693a5f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:13.810984 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d5f19b43-75ba-403a-94bc-7b854a693a5f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042764 May 03 09:00:13.811533 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 367/700] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:13 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:14.786284 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-92648985-d23e-4693-a5c6-9a8acd4897d6 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:14.787333 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-92648985-d23e-4693-a5c6-9a8acd4897d6 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:14.796749 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-92648985-d23e-4693-a5c6-9a8acd4897d6 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:14.797193 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-92648985-d23e-4693-a5c6-9a8acd4897d6 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:14.797957 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-92648985-d23e-4693-a5c6-9a8acd4897d6 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:14.798382 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-92648985-d23e-4693-a5c6-9a8acd4897d6 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:14.860205 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-92648985-d23e-4693-a5c6-9a8acd4897d6 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:14.867994 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-92648985-d23e-4693-a5c6-9a8acd4897d6 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.088082 May 03 09:00:14.868542 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 368/701] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:14 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:14.873134 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-6eae0478-9a44-4694-a37f-2996db266299 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:14.874031 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-6eae0478-9a44-4694-a37f-2996db266299 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:14.880026 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6eae0478-9a44-4694-a37f-2996db266299 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:14.880483 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6eae0478-9a44-4694-a37f-2996db266299 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:14.881244 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6eae0478-9a44-4694-a37f-2996db266299 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:14.881669 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6eae0478-9a44-4694-a37f-2996db266299 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:14.910413 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-6eae0478-9a44-4694-a37f-2996db266299 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040839 May 03 09:00:14.910955 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 369/702] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:14 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:15.885852 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-45f4c66f-3559-44a3-b921-dd9aaaad074f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:15.886514 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-45f4c66f-3559-44a3-b921-dd9aaaad074f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:15.899647 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-45f4c66f-3559-44a3-b921-dd9aaaad074f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:15.900413 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-45f4c66f-3559-44a3-b921-dd9aaaad074f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:15.901769 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-45f4c66f-3559-44a3-b921-dd9aaaad074f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:15.902202 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-45f4c66f-3559-44a3-b921-dd9aaaad074f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:15.969716 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-45f4c66f-3559-44a3-b921-dd9aaaad074f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:15.980943 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-45f4c66f-3559-44a3-b921-dd9aaaad074f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.099607 May 03 09:00:15.981743 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 370/703] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:15 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:15.988782 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f4719c13-7113-4104-9a9c-6b6a17ef039a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:15.990105 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f4719c13-7113-4104-9a9c-6b6a17ef039a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:15.997566 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f4719c13-7113-4104-9a9c-6b6a17ef039a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:15.998006 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f4719c13-7113-4104-9a9c-6b6a17ef039a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:15.998757 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f4719c13-7113-4104-9a9c-6b6a17ef039a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:15.999184 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f4719c13-7113-4104-9a9c-6b6a17ef039a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:16.027491 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f4719c13-7113-4104-9a9c-6b6a17ef039a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044605 May 03 09:00:16.028074 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 371/704] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:15 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:17.008056 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b7a15491-e823-4217-9cca-3626af28be11 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:17.009132 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b7a15491-e823-4217-9cca-3626af28be11 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:17.016498 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b7a15491-e823-4217-9cca-3626af28be11 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:17.016948 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b7a15491-e823-4217-9cca-3626af28be11 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:17.017706 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b7a15491-e823-4217-9cca-3626af28be11 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:17.018136 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b7a15491-e823-4217-9cca-3626af28be11 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:17.086357 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b7a15491-e823-4217-9cca-3626af28be11 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:17.094111 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b7a15491-e823-4217-9cca-3626af28be11 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.092609 May 03 09:00:17.094668 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 372/705] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:16 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:17.099125 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-8ca20206-4081-4c22-a9cd-e08055ce71ea tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:17.100086 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-8ca20206-4081-4c22-a9cd-e08055ce71ea tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:17.105790 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8ca20206-4081-4c22-a9cd-e08055ce71ea tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:17.106227 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8ca20206-4081-4c22-a9cd-e08055ce71ea tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:17.106976 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8ca20206-4081-4c22-a9cd-e08055ce71ea tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:17.107401 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8ca20206-4081-4c22-a9cd-e08055ce71ea tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:17.135184 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-8ca20206-4081-4c22-a9cd-e08055ce71ea tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039551 May 03 09:00:17.135736 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 373/706] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:17 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:18.110888 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-2683332e-7c33-40db-abbe-e3cbf6f15046 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:18.111537 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-2683332e-7c33-40db-abbe-e3cbf6f15046 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:18.118109 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2683332e-7c33-40db-abbe-e3cbf6f15046 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:18.118563 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2683332e-7c33-40db-abbe-e3cbf6f15046 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:18.119329 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2683332e-7c33-40db-abbe-e3cbf6f15046 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:18.119791 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2683332e-7c33-40db-abbe-e3cbf6f15046 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:18.190330 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-2683332e-7c33-40db-abbe-e3cbf6f15046 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:18.203907 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-2683332e-7c33-40db-abbe-e3cbf6f15046 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.096919 May 03 09:00:18.204500 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 374/707] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:18 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:18.212393 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e4a31566-ea69-41fb-97af-b85bbf26f3b3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:18.213571 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e4a31566-ea69-41fb-97af-b85bbf26f3b3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:18.220789 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e4a31566-ea69-41fb-97af-b85bbf26f3b3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:18.221240 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e4a31566-ea69-41fb-97af-b85bbf26f3b3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:18.222080 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e4a31566-ea69-41fb-97af-b85bbf26f3b3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:18.222543 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e4a31566-ea69-41fb-97af-b85bbf26f3b3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:18.253093 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e4a31566-ea69-41fb-97af-b85bbf26f3b3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046156 May 03 09:00:18.253652 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 375/708] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:18 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:19.224836 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5a790423-8f69-4c60-8e2f-c1bb9fc80629 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:19.226000 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5a790423-8f69-4c60-8e2f-c1bb9fc80629 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:19.234183 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5a790423-8f69-4c60-8e2f-c1bb9fc80629 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:19.234719 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5a790423-8f69-4c60-8e2f-c1bb9fc80629 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:19.235480 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5a790423-8f69-4c60-8e2f-c1bb9fc80629 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:19.235945 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5a790423-8f69-4c60-8e2f-c1bb9fc80629 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:19.298403 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5a790423-8f69-4c60-8e2f-c1bb9fc80629 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:19.306030 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5a790423-8f69-4c60-8e2f-c1bb9fc80629 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.087711 May 03 09:00:19.306592 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 376/709] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:19 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:19.311141 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f6cc3039-8485-497a-a77d-4f08d190c74e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:19.312073 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f6cc3039-8485-497a-a77d-4f08d190c74e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:19.318002 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f6cc3039-8485-497a-a77d-4f08d190c74e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:19.318466 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f6cc3039-8485-497a-a77d-4f08d190c74e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:19.319240 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f6cc3039-8485-497a-a77d-4f08d190c74e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:19.319653 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f6cc3039-8485-497a-a77d-4f08d190c74e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:19.348967 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f6cc3039-8485-497a-a77d-4f08d190c74e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041360 May 03 09:00:19.349553 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 377/710] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:19 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:20.326335 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3b4b4bb4-e61f-455f-80ea-3398ad698a18 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:20.327375 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-3b4b4bb4-e61f-455f-80ea-3398ad698a18 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:20.338012 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3b4b4bb4-e61f-455f-80ea-3398ad698a18 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:20.338909 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3b4b4bb4-e61f-455f-80ea-3398ad698a18 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:20.339672 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3b4b4bb4-e61f-455f-80ea-3398ad698a18 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:20.340130 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3b4b4bb4-e61f-455f-80ea-3398ad698a18 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:20.404231 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-3b4b4bb4-e61f-455f-80ea-3398ad698a18 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:20.414869 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-3b4b4bb4-e61f-455f-80ea-3398ad698a18 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.095105 May 03 09:00:20.415614 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 378/711] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:20 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:20.420157 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c5086864-dc5e-47c6-a49f-9d51c016eb40 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:20.421053 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c5086864-dc5e-47c6-a49f-9d51c016eb40 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:20.427610 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c5086864-dc5e-47c6-a49f-9d51c016eb40 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:20.428209 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c5086864-dc5e-47c6-a49f-9d51c016eb40 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:20.429342 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c5086864-dc5e-47c6-a49f-9d51c016eb40 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:20.429979 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c5086864-dc5e-47c6-a49f-9d51c016eb40 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:20.458762 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c5086864-dc5e-47c6-a49f-9d51c016eb40 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042128 May 03 09:00:20.459291 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 379/712] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:20 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:21.435513 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a5dee9cb-e28f-408f-944a-d4164799a369 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:21.436539 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a5dee9cb-e28f-408f-944a-d4164799a369 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:21.447152 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a5dee9cb-e28f-408f-944a-d4164799a369 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:21.448257 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a5dee9cb-e28f-408f-944a-d4164799a369 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:21.449019 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a5dee9cb-e28f-408f-944a-d4164799a369 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:21.449446 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a5dee9cb-e28f-408f-944a-d4164799a369 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:21.521404 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a5dee9cb-e28f-408f-944a-d4164799a369 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:21.532573 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a5dee9cb-e28f-408f-944a-d4164799a369 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.103158 May 03 09:00:21.533338 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 380/713] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:21 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:21.537982 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3e1936e3-e01e-4e3a-bb3c-4cd773bf97e7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:21.538881 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-3e1936e3-e01e-4e3a-bb3c-4cd773bf97e7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:21.544594 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3e1936e3-e01e-4e3a-bb3c-4cd773bf97e7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:21.545039 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3e1936e3-e01e-4e3a-bb3c-4cd773bf97e7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:21.545799 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3e1936e3-e01e-4e3a-bb3c-4cd773bf97e7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:21.546228 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3e1936e3-e01e-4e3a-bb3c-4cd773bf97e7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:21.575659 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-3e1936e3-e01e-4e3a-bb3c-4cd773bf97e7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041270 May 03 09:00:21.576246 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 381/714] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:21 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:22.553958 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-62e6a0e0-8c69-4d81-ad22-f79dcc26f9e1 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:22.554961 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-62e6a0e0-8c69-4d81-ad22-f79dcc26f9e1 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:22.563623 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-62e6a0e0-8c69-4d81-ad22-f79dcc26f9e1 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:22.564141 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-62e6a0e0-8c69-4d81-ad22-f79dcc26f9e1 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:22.564953 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-62e6a0e0-8c69-4d81-ad22-f79dcc26f9e1 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:22.565408 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-62e6a0e0-8c69-4d81-ad22-f79dcc26f9e1 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:22.637313 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-62e6a0e0-8c69-4d81-ad22-f79dcc26f9e1 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:22.644887 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-62e6a0e0-8c69-4d81-ad22-f79dcc26f9e1 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.097569 May 03 09:00:22.645457 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 382/715] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:22 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:22.650016 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f53ca0dc-85a7-4502-9403-d50abe490a24 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:22.650917 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f53ca0dc-85a7-4502-9403-d50abe490a24 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:22.656674 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f53ca0dc-85a7-4502-9403-d50abe490a24 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:22.657097 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f53ca0dc-85a7-4502-9403-d50abe490a24 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:22.657855 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f53ca0dc-85a7-4502-9403-d50abe490a24 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:22.658284 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f53ca0dc-85a7-4502-9403-d50abe490a24 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:22.686378 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f53ca0dc-85a7-4502-9403-d50abe490a24 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039948 May 03 09:00:22.686916 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 383/716] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:22 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:23.665768 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-8a0d2b86-c325-4dca-9e80-ad8593df5c3f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:23.666862 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-8a0d2b86-c325-4dca-9e80-ad8593df5c3f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:23.674558 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8a0d2b86-c325-4dca-9e80-ad8593df5c3f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:23.674916 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8a0d2b86-c325-4dca-9e80-ad8593df5c3f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:23.675958 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8a0d2b86-c325-4dca-9e80-ad8593df5c3f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:23.676255 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8a0d2b86-c325-4dca-9e80-ad8593df5c3f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:23.739310 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-8a0d2b86-c325-4dca-9e80-ad8593df5c3f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:23.747135 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-8a0d2b86-c325-4dca-9e80-ad8593df5c3f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.087878 May 03 09:00:23.747693 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 384/717] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:23 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:23.752188 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-411a4c0f-5cc1-4c92-9306-906848cd150e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:23.753120 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-411a4c0f-5cc1-4c92-9306-906848cd150e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:23.760684 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-411a4c0f-5cc1-4c92-9306-906848cd150e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:23.761125 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-411a4c0f-5cc1-4c92-9306-906848cd150e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:23.761879 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-411a4c0f-5cc1-4c92-9306-906848cd150e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:23.762332 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-411a4c0f-5cc1-4c92-9306-906848cd150e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:23.791211 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-411a4c0f-5cc1-4c92-9306-906848cd150e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042510 May 03 09:00:23.791977 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 385/718] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:23 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:24.260599 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.objects.instance [None req-38d996a8-98c6-49dd-bb45-ce9706bca6b6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lazy-loading 'services' on Instance uuid 512c1f04-399e-4647-8bfe-f2c295397df2 {{(pid=123392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 03 09:00:24.767653 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-aeba30d4-b06e-4694-b0e2-5ef444a08fe5 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:24.768732 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-aeba30d4-b06e-4694-b0e2-5ef444a08fe5 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:24.778173 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-aeba30d4-b06e-4694-b0e2-5ef444a08fe5 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:24.778617 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-aeba30d4-b06e-4694-b0e2-5ef444a08fe5 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:24.779376 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-aeba30d4-b06e-4694-b0e2-5ef444a08fe5 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:24.779798 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-aeba30d4-b06e-4694-b0e2-5ef444a08fe5 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:24.842634 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-aeba30d4-b06e-4694-b0e2-5ef444a08fe5 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:24.850760 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-aeba30d4-b06e-4694-b0e2-5ef444a08fe5 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.089474 May 03 09:00:24.851300 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 386/719] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:24 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:24.855820 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-95cbfd35-8c1a-4f20-ae40-92495e01639f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:24.856755 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-95cbfd35-8c1a-4f20-ae40-92495e01639f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:24.862182 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-95cbfd35-8c1a-4f20-ae40-92495e01639f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:24.862635 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-95cbfd35-8c1a-4f20-ae40-92495e01639f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:24.863393 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-95cbfd35-8c1a-4f20-ae40-92495e01639f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:24.863846 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-95cbfd35-8c1a-4f20-ae40-92495e01639f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:24.892488 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-95cbfd35-8c1a-4f20-ae40-92495e01639f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040117 May 03 09:00:24.893031 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 387/720] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:24 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:25.871189 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c98fcc46-755c-4029-a973-2e43c74adb0b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:25.872208 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c98fcc46-755c-4029-a973-2e43c74adb0b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:25.882359 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c98fcc46-755c-4029-a973-2e43c74adb0b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:25.883103 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c98fcc46-755c-4029-a973-2e43c74adb0b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:25.884400 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c98fcc46-755c-4029-a973-2e43c74adb0b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:25.885114 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c98fcc46-755c-4029-a973-2e43c74adb0b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:25.949893 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c98fcc46-755c-4029-a973-2e43c74adb0b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:25.961797 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c98fcc46-755c-4029-a973-2e43c74adb0b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.096874 May 03 09:00:25.962739 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 388/721] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:25 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:25.967802 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f6bd6d46-9530-4d68-9814-7c7288b4eeb3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:25.968699 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f6bd6d46-9530-4d68-9814-7c7288b4eeb3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:25.975959 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f6bd6d46-9530-4d68-9814-7c7288b4eeb3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:25.976680 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f6bd6d46-9530-4d68-9814-7c7288b4eeb3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:25.977935 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f6bd6d46-9530-4d68-9814-7c7288b4eeb3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:25.978646 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f6bd6d46-9530-4d68-9814-7c7288b4eeb3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:26.007967 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f6bd6d46-9530-4d68-9814-7c7288b4eeb3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044118 May 03 09:00:26.008520 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 389/722] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:25 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:26.980590 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-18135eb0-2db7-4371-a6bb-1bd1cf9f0c32 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:26.981292 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-18135eb0-2db7-4371-a6bb-1bd1cf9f0c32 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:26.987967 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-18135eb0-2db7-4371-a6bb-1bd1cf9f0c32 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:26.988419 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-18135eb0-2db7-4371-a6bb-1bd1cf9f0c32 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:26.989172 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-18135eb0-2db7-4371-a6bb-1bd1cf9f0c32 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:26.989599 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-18135eb0-2db7-4371-a6bb-1bd1cf9f0c32 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:27.049639 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-18135eb0-2db7-4371-a6bb-1bd1cf9f0c32 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:27.057216 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-18135eb0-2db7-4371-a6bb-1bd1cf9f0c32 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.080606 May 03 09:00:27.057771 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 390/723] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:26 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:27.062216 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9afd7712-8473-42bf-9442-64ad9b31613b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:27.063114 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9afd7712-8473-42bf-9442-64ad9b31613b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:27.068953 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9afd7712-8473-42bf-9442-64ad9b31613b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:27.069399 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9afd7712-8473-42bf-9442-64ad9b31613b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:27.070354 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9afd7712-8473-42bf-9442-64ad9b31613b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:27.070809 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9afd7712-8473-42bf-9442-64ad9b31613b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:27.100505 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9afd7712-8473-42bf-9442-64ad9b31613b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041770 May 03 09:00:27.101035 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 391/724] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:27 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:28.077914 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-414a88d6-846c-467e-8ba5-d3f155373565 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:28.079006 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-414a88d6-846c-467e-8ba5-d3f155373565 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:28.089506 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-414a88d6-846c-467e-8ba5-d3f155373565 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:28.090034 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-414a88d6-846c-467e-8ba5-d3f155373565 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:28.091183 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-414a88d6-846c-467e-8ba5-d3f155373565 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:28.091630 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-414a88d6-846c-467e-8ba5-d3f155373565 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:28.154377 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-414a88d6-846c-467e-8ba5-d3f155373565 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:28.162246 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-414a88d6-846c-467e-8ba5-d3f155373565 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.091166 May 03 09:00:28.162812 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 392/725] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:28 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:28.167564 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-47e90731-db3e-4dae-b04c-8cd9c4bed1ac tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:28.168538 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-47e90731-db3e-4dae-b04c-8cd9c4bed1ac tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:28.174388 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-47e90731-db3e-4dae-b04c-8cd9c4bed1ac tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:28.174841 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-47e90731-db3e-4dae-b04c-8cd9c4bed1ac tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:28.175612 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-47e90731-db3e-4dae-b04c-8cd9c4bed1ac tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:28.176079 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-47e90731-db3e-4dae-b04c-8cd9c4bed1ac tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:28.204566 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-47e90731-db3e-4dae-b04c-8cd9c4bed1ac tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040696 May 03 09:00:28.205129 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 393/726] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:28 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:29.182834 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a86d82ca-f7a8-4ac5-b8c0-c35990a314d4 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:29.183937 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a86d82ca-f7a8-4ac5-b8c0-c35990a314d4 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:29.194868 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a86d82ca-f7a8-4ac5-b8c0-c35990a314d4 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:29.195605 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a86d82ca-f7a8-4ac5-b8c0-c35990a314d4 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:29.196946 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a86d82ca-f7a8-4ac5-b8c0-c35990a314d4 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:29.197727 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a86d82ca-f7a8-4ac5-b8c0-c35990a314d4 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:29.263303 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a86d82ca-f7a8-4ac5-b8c0-c35990a314d4 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:29.273790 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a86d82ca-f7a8-4ac5-b8c0-c35990a314d4 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.097358 May 03 09:00:29.274560 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 394/727] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:29 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:29.279343 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-88af9360-824a-461e-9ddf-e91a9ecf986a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:29.280276 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-88af9360-824a-461e-9ddf-e91a9ecf986a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:29.286278 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-88af9360-824a-461e-9ddf-e91a9ecf986a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:29.286725 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-88af9360-824a-461e-9ddf-e91a9ecf986a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:29.287529 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-88af9360-824a-461e-9ddf-e91a9ecf986a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:29.288008 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-88af9360-824a-461e-9ddf-e91a9ecf986a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:29.317544 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-88af9360-824a-461e-9ddf-e91a9ecf986a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042011 May 03 09:00:29.318056 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 395/728] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:29 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:30.291727 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a77d71d9-2217-4c87-ab09-25191acce30b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:30.292407 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a77d71d9-2217-4c87-ab09-25191acce30b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:30.301012 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a77d71d9-2217-4c87-ab09-25191acce30b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:30.301680 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a77d71d9-2217-4c87-ab09-25191acce30b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:30.302834 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a77d71d9-2217-4c87-ab09-25191acce30b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:30.303480 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a77d71d9-2217-4c87-ab09-25191acce30b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:30.365815 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a77d71d9-2217-4c87-ab09-25191acce30b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:30.373744 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a77d71d9-2217-4c87-ab09-25191acce30b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.085935 May 03 09:00:30.374350 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 396/729] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:30 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:30.378907 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5a0338bb-137c-4110-a843-59f3b09730f9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:30.379887 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5a0338bb-137c-4110-a843-59f3b09730f9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:30.387244 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5a0338bb-137c-4110-a843-59f3b09730f9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:30.387686 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5a0338bb-137c-4110-a843-59f3b09730f9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:30.388512 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5a0338bb-137c-4110-a843-59f3b09730f9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:30.388935 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5a0338bb-137c-4110-a843-59f3b09730f9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:30.417697 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5a0338bb-137c-4110-a843-59f3b09730f9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042372 May 03 09:00:30.418239 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 397/730] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:30 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:31.393577 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-184408c0-19d7-4de8-853c-ea396a132887 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:31.394683 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-184408c0-19d7-4de8-853c-ea396a132887 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:31.405183 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-184408c0-19d7-4de8-853c-ea396a132887 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:31.405929 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-184408c0-19d7-4de8-853c-ea396a132887 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:31.407135 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-184408c0-19d7-4de8-853c-ea396a132887 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:31.407866 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-184408c0-19d7-4de8-853c-ea396a132887 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:31.473511 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-184408c0-19d7-4de8-853c-ea396a132887 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:31.481445 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-184408c0-19d7-4de8-853c-ea396a132887 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.093330 May 03 09:00:31.482006 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 398/731] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:31 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:31.486904 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-474146c6-78fe-4e07-b804-03b5dfe197c5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:31.487877 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-474146c6-78fe-4e07-b804-03b5dfe197c5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:31.494907 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-474146c6-78fe-4e07-b804-03b5dfe197c5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:31.495382 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-474146c6-78fe-4e07-b804-03b5dfe197c5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:31.496175 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-474146c6-78fe-4e07-b804-03b5dfe197c5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:31.496605 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-474146c6-78fe-4e07-b804-03b5dfe197c5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:31.526892 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-474146c6-78fe-4e07-b804-03b5dfe197c5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043904 May 03 09:00:31.527432 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 399/732] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:31 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:32.498810 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-1bba7fac-2641-4bf6-9c91-9a86781caa5a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:32.499467 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-1bba7fac-2641-4bf6-9c91-9a86781caa5a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:32.506054 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1bba7fac-2641-4bf6-9c91-9a86781caa5a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:32.506498 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1bba7fac-2641-4bf6-9c91-9a86781caa5a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:32.507267 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1bba7fac-2641-4bf6-9c91-9a86781caa5a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:32.507694 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1bba7fac-2641-4bf6-9c91-9a86781caa5a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:32.577101 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-1bba7fac-2641-4bf6-9c91-9a86781caa5a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:32.594288 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-1bba7fac-2641-4bf6-9c91-9a86781caa5a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.099605 May 03 09:00:32.594892 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 400/733] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:32 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:32.599644 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-0dddaea0-5814-4127-ac40-a7c0f15ce795 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:32.600568 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-0dddaea0-5814-4127-ac40-a7c0f15ce795 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:32.609023 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0dddaea0-5814-4127-ac40-a7c0f15ce795 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:32.609698 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0dddaea0-5814-4127-ac40-a7c0f15ce795 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:32.610906 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0dddaea0-5814-4127-ac40-a7c0f15ce795 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:32.611556 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0dddaea0-5814-4127-ac40-a7c0f15ce795 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:32.642770 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-0dddaea0-5814-4127-ac40-a7c0f15ce795 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046836 May 03 09:00:32.643341 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 401/734] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:32 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:33.615447 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e6b2ee6e-2052-4a3f-b6be-9a259c1b300c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:33.616527 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e6b2ee6e-2052-4a3f-b6be-9a259c1b300c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:33.626587 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e6b2ee6e-2052-4a3f-b6be-9a259c1b300c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:33.627325 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e6b2ee6e-2052-4a3f-b6be-9a259c1b300c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:33.628633 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e6b2ee6e-2052-4a3f-b6be-9a259c1b300c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:33.629346 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e6b2ee6e-2052-4a3f-b6be-9a259c1b300c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:33.696835 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e6b2ee6e-2052-4a3f-b6be-9a259c1b300c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:33.704785 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e6b2ee6e-2052-4a3f-b6be-9a259c1b300c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.095870 May 03 09:00:33.705368 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 402/735] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:33 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:33.710068 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-30ccd98e-bf9d-4c90-b98c-73833b938be0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:33.711352 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-30ccd98e-bf9d-4c90-b98c-73833b938be0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:33.717755 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-30ccd98e-bf9d-4c90-b98c-73833b938be0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:33.718922 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-30ccd98e-bf9d-4c90-b98c-73833b938be0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:33.721238 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-30ccd98e-bf9d-4c90-b98c-73833b938be0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:33.721673 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-30ccd98e-bf9d-4c90-b98c-73833b938be0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:33.750753 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-30ccd98e-bf9d-4c90-b98c-73833b938be0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044412 May 03 09:00:33.751327 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 403/736] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:33 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:34.725635 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ed9d1ce6-e91e-485c-90e4-dcdf41486a00 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:34.726685 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ed9d1ce6-e91e-485c-90e4-dcdf41486a00 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:34.737098 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ed9d1ce6-e91e-485c-90e4-dcdf41486a00 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:34.737860 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ed9d1ce6-e91e-485c-90e4-dcdf41486a00 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:34.739103 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ed9d1ce6-e91e-485c-90e4-dcdf41486a00 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:34.739839 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ed9d1ce6-e91e-485c-90e4-dcdf41486a00 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:34.801064 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ed9d1ce6-e91e-485c-90e4-dcdf41486a00 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:34.808559 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ed9d1ce6-e91e-485c-90e4-dcdf41486a00 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.089372 May 03 09:00:34.809122 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 404/737] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:34 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:34.813600 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a04812c5-b118-4739-9936-f77fc2acfad3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:34.814503 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a04812c5-b118-4739-9936-f77fc2acfad3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:34.820570 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a04812c5-b118-4739-9936-f77fc2acfad3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:34.821015 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a04812c5-b118-4739-9936-f77fc2acfad3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:34.821783 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a04812c5-b118-4739-9936-f77fc2acfad3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:34.822216 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a04812c5-b118-4739-9936-f77fc2acfad3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:34.852242 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a04812c5-b118-4739-9936-f77fc2acfad3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042093 May 03 09:00:34.852756 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 405/738] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:34 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:35.829690 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-36bf3546-2b66-4bba-84f9-4d9a9ddeaf06 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:35.830678 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-36bf3546-2b66-4bba-84f9-4d9a9ddeaf06 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:35.841569 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-36bf3546-2b66-4bba-84f9-4d9a9ddeaf06 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:35.842304 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-36bf3546-2b66-4bba-84f9-4d9a9ddeaf06 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:35.843554 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-36bf3546-2b66-4bba-84f9-4d9a9ddeaf06 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:35.844310 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-36bf3546-2b66-4bba-84f9-4d9a9ddeaf06 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:35.910171 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-36bf3546-2b66-4bba-84f9-4d9a9ddeaf06 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:35.918205 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-36bf3546-2b66-4bba-84f9-4d9a9ddeaf06 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.095127 May 03 09:00:35.918780 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 406/739] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:35 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:35.923318 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-af8f9e45-b2e8-44d3-9008-194548dcea9d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:35.924256 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-af8f9e45-b2e8-44d3-9008-194548dcea9d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:35.929871 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-af8f9e45-b2e8-44d3-9008-194548dcea9d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:35.930390 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-af8f9e45-b2e8-44d3-9008-194548dcea9d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:35.931086 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-af8f9e45-b2e8-44d3-9008-194548dcea9d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:35.931535 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-af8f9e45-b2e8-44d3-9008-194548dcea9d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:35.961609 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-af8f9e45-b2e8-44d3-9008-194548dcea9d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041856 May 03 09:00:35.962162 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 407/740] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:35 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:36.938864 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9cf18131-9fe0-4ba8-b386-7c6bb3c71bb8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:36.939970 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9cf18131-9fe0-4ba8-b386-7c6bb3c71bb8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:36.950563 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9cf18131-9fe0-4ba8-b386-7c6bb3c71bb8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:36.951331 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9cf18131-9fe0-4ba8-b386-7c6bb3c71bb8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:36.952682 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9cf18131-9fe0-4ba8-b386-7c6bb3c71bb8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:36.953402 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9cf18131-9fe0-4ba8-b386-7c6bb3c71bb8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:37.020283 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9cf18131-9fe0-4ba8-b386-7c6bb3c71bb8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:37.027824 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9cf18131-9fe0-4ba8-b386-7c6bb3c71bb8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.095728 May 03 09:00:37.028420 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 408/741] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:36 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:37.032884 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-438799fe-7d83-44fa-b32e-dc05e21b40e7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:37.033786 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-438799fe-7d83-44fa-b32e-dc05e21b40e7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:37.039334 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-438799fe-7d83-44fa-b32e-dc05e21b40e7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:37.039799 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-438799fe-7d83-44fa-b32e-dc05e21b40e7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:37.040574 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-438799fe-7d83-44fa-b32e-dc05e21b40e7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:37.041006 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-438799fe-7d83-44fa-b32e-dc05e21b40e7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:37.068996 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-438799fe-7d83-44fa-b32e-dc05e21b40e7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039621 May 03 09:00:37.069538 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 409/742] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:37 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:38.048831 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-de3da789-874e-42eb-a620-3a89fc07d301 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:38.049997 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-de3da789-874e-42eb-a620-3a89fc07d301 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:38.060701 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-de3da789-874e-42eb-a620-3a89fc07d301 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:38.061454 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-de3da789-874e-42eb-a620-3a89fc07d301 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:38.062702 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-de3da789-874e-42eb-a620-3a89fc07d301 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:38.063415 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-de3da789-874e-42eb-a620-3a89fc07d301 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:38.134262 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-de3da789-874e-42eb-a620-3a89fc07d301 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:38.144178 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-de3da789-874e-42eb-a620-3a89fc07d301 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.101893 May 03 09:00:38.144809 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 410/743] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:38 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:38.149982 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-03e030da-5369-4ad6-93c5-8d42cae332b7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:38.150886 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-03e030da-5369-4ad6-93c5-8d42cae332b7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:38.157012 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-03e030da-5369-4ad6-93c5-8d42cae332b7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:38.157447 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-03e030da-5369-4ad6-93c5-8d42cae332b7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:38.158210 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-03e030da-5369-4ad6-93c5-8d42cae332b7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:38.158639 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-03e030da-5369-4ad6-93c5-8d42cae332b7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:38.189121 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-03e030da-5369-4ad6-93c5-8d42cae332b7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043321 May 03 09:00:38.189679 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 411/744] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:38 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:39.165537 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-1d7a44d3-b563-4cf2-89ba-4e06f1142340 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:39.166656 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-1d7a44d3-b563-4cf2-89ba-4e06f1142340 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:39.177608 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1d7a44d3-b563-4cf2-89ba-4e06f1142340 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:39.178348 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1d7a44d3-b563-4cf2-89ba-4e06f1142340 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:39.179595 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1d7a44d3-b563-4cf2-89ba-4e06f1142340 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:39.180356 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1d7a44d3-b563-4cf2-89ba-4e06f1142340 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:39.243497 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-1d7a44d3-b563-4cf2-89ba-4e06f1142340 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:39.252256 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-1d7a44d3-b563-4cf2-89ba-4e06f1142340 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.093273 May 03 09:00:39.252796 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 412/745] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:39 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:39.257469 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3cf622bb-63e1-4023-9302-09d74d26c052 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:39.258398 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-3cf622bb-63e1-4023-9302-09d74d26c052 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:39.264360 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3cf622bb-63e1-4023-9302-09d74d26c052 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:39.264805 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3cf622bb-63e1-4023-9302-09d74d26c052 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:39.265564 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3cf622bb-63e1-4023-9302-09d74d26c052 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:39.265993 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3cf622bb-63e1-4023-9302-09d74d26c052 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:39.293700 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-3cf622bb-63e1-4023-9302-09d74d26c052 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039917 May 03 09:00:39.294277 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 413/746] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:39 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:40.273054 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-52f9ae8d-14d0-4c90-80de-97715973f34c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:40.274048 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-52f9ae8d-14d0-4c90-80de-97715973f34c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:40.285185 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-52f9ae8d-14d0-4c90-80de-97715973f34c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:40.285989 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-52f9ae8d-14d0-4c90-80de-97715973f34c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:40.287222 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-52f9ae8d-14d0-4c90-80de-97715973f34c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:40.288038 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-52f9ae8d-14d0-4c90-80de-97715973f34c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:40.353217 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-52f9ae8d-14d0-4c90-80de-97715973f34c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:40.361319 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-52f9ae8d-14d0-4c90-80de-97715973f34c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.094862 May 03 09:00:40.361897 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 414/747] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:40 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:40.366560 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-928ad625-20c8-47b9-bad5-44f6e7f5e942 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:40.367463 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-928ad625-20c8-47b9-bad5-44f6e7f5e942 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:40.373468 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-928ad625-20c8-47b9-bad5-44f6e7f5e942 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:40.373922 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-928ad625-20c8-47b9-bad5-44f6e7f5e942 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:40.374694 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-928ad625-20c8-47b9-bad5-44f6e7f5e942 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:40.375127 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-928ad625-20c8-47b9-bad5-44f6e7f5e942 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:40.405807 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-928ad625-20c8-47b9-bad5-44f6e7f5e942 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042917 May 03 09:00:40.406351 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 415/748] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:40 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:41.381266 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9b56138d-3380-4312-bc5d-60474d15bf1f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:41.382519 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9b56138d-3380-4312-bc5d-60474d15bf1f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:41.392315 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9b56138d-3380-4312-bc5d-60474d15bf1f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:41.392983 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9b56138d-3380-4312-bc5d-60474d15bf1f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:41.394150 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9b56138d-3380-4312-bc5d-60474d15bf1f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:41.394876 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9b56138d-3380-4312-bc5d-60474d15bf1f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:41.458924 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9b56138d-3380-4312-bc5d-60474d15bf1f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:41.467480 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9b56138d-3380-4312-bc5d-60474d15bf1f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.092189 May 03 09:00:41.468025 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 416/749] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:41 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:41.472831 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-1d501fe6-1d59-46c0-9eaa-414b129fe00e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:41.473736 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-1d501fe6-1d59-46c0-9eaa-414b129fe00e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:41.479517 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1d501fe6-1d59-46c0-9eaa-414b129fe00e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:41.480000 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1d501fe6-1d59-46c0-9eaa-414b129fe00e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:41.480788 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1d501fe6-1d59-46c0-9eaa-414b129fe00e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:41.481221 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1d501fe6-1d59-46c0-9eaa-414b129fe00e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:41.515720 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-1d501fe6-1d59-46c0-9eaa-414b129fe00e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046283 May 03 09:00:41.516545 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 417/750] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:41 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:42.485550 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-77cba480-bd6d-4248-8035-e1e6c54cee5d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:42.486231 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-77cba480-bd6d-4248-8035-e1e6c54cee5d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:42.493008 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-77cba480-bd6d-4248-8035-e1e6c54cee5d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:42.493454 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-77cba480-bd6d-4248-8035-e1e6c54cee5d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:42.494233 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-77cba480-bd6d-4248-8035-e1e6c54cee5d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:42.494653 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-77cba480-bd6d-4248-8035-e1e6c54cee5d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:42.557986 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-77cba480-bd6d-4248-8035-e1e6c54cee5d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:42.566220 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-77cba480-bd6d-4248-8035-e1e6c54cee5d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.084911 May 03 09:00:42.566789 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 418/751] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:42 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:42.571416 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-8d7b4d75-6cd8-45fc-863b-c5eee1ca49e8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:42.572329 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-8d7b4d75-6cd8-45fc-863b-c5eee1ca49e8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:42.580049 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8d7b4d75-6cd8-45fc-863b-c5eee1ca49e8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:42.580499 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8d7b4d75-6cd8-45fc-863b-c5eee1ca49e8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:42.581257 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8d7b4d75-6cd8-45fc-863b-c5eee1ca49e8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:42.581681 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8d7b4d75-6cd8-45fc-863b-c5eee1ca49e8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:42.613754 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-8d7b4d75-6cd8-45fc-863b-c5eee1ca49e8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045899 May 03 09:00:42.614313 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 419/752] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:42 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:43.587755 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-1b6da82c-82b0-4fb2-82d8-39d81fe23b3d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:43.588806 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-1b6da82c-82b0-4fb2-82d8-39d81fe23b3d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:43.596413 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1b6da82c-82b0-4fb2-82d8-39d81fe23b3d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:43.596877 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1b6da82c-82b0-4fb2-82d8-39d81fe23b3d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:43.597643 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1b6da82c-82b0-4fb2-82d8-39d81fe23b3d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:43.598070 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1b6da82c-82b0-4fb2-82d8-39d81fe23b3d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:43.659561 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-1b6da82c-82b0-4fb2-82d8-39d81fe23b3d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:43.667521 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-1b6da82c-82b0-4fb2-82d8-39d81fe23b3d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.086407 May 03 09:00:43.668252 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 420/753] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:43 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:43.672880 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c0b64d1b-b3f7-4af8-b93d-3f9ea5e4457f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:43.673776 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c0b64d1b-b3f7-4af8-b93d-3f9ea5e4457f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:43.679319 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c0b64d1b-b3f7-4af8-b93d-3f9ea5e4457f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:43.679760 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c0b64d1b-b3f7-4af8-b93d-3f9ea5e4457f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:43.680536 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c0b64d1b-b3f7-4af8-b93d-3f9ea5e4457f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:43.680960 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c0b64d1b-b3f7-4af8-b93d-3f9ea5e4457f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:43.709308 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c0b64d1b-b3f7-4af8-b93d-3f9ea5e4457f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040071 May 03 09:00:43.709837 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 421/754] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:43 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:44.684891 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-dc825147-25c7-4dbf-8e6f-83435433ee70 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:44.685611 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-dc825147-25c7-4dbf-8e6f-83435433ee70 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:44.692575 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dc825147-25c7-4dbf-8e6f-83435433ee70 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:44.693038 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dc825147-25c7-4dbf-8e6f-83435433ee70 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:44.693809 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dc825147-25c7-4dbf-8e6f-83435433ee70 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:44.694242 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dc825147-25c7-4dbf-8e6f-83435433ee70 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:44.762156 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-dc825147-25c7-4dbf-8e6f-83435433ee70 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:44.770460 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-dc825147-25c7-4dbf-8e6f-83435433ee70 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.089717 May 03 09:00:44.771050 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 422/755] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:44 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:44.775617 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-80c821a2-6bc1-4398-bcfb-5d9c427e6cb9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:44.776610 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-80c821a2-6bc1-4398-bcfb-5d9c427e6cb9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:44.782593 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-80c821a2-6bc1-4398-bcfb-5d9c427e6cb9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:44.783030 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-80c821a2-6bc1-4398-bcfb-5d9c427e6cb9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:44.783807 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-80c821a2-6bc1-4398-bcfb-5d9c427e6cb9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:44.784260 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-80c821a2-6bc1-4398-bcfb-5d9c427e6cb9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:44.815787 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-80c821a2-6bc1-4398-bcfb-5d9c427e6cb9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043700 May 03 09:00:44.816395 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 423/756] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:44 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:45.790968 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-54879636-7827-43a9-86f3-3f4ef1178481 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:45.792018 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-54879636-7827-43a9-86f3-3f4ef1178481 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:45.799109 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-54879636-7827-43a9-86f3-3f4ef1178481 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:45.799551 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-54879636-7827-43a9-86f3-3f4ef1178481 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:45.800343 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-54879636-7827-43a9-86f3-3f4ef1178481 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:45.800768 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-54879636-7827-43a9-86f3-3f4ef1178481 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:45.869353 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-54879636-7827-43a9-86f3-3f4ef1178481 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:45.877585 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-54879636-7827-43a9-86f3-3f4ef1178481 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.093034 May 03 09:00:45.878149 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 424/757] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:45 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:45.882583 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-475d567a-c1b1-4334-a50a-9c2e544fb7d0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:45.883512 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-475d567a-c1b1-4334-a50a-9c2e544fb7d0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:45.889373 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-475d567a-c1b1-4334-a50a-9c2e544fb7d0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:45.889830 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-475d567a-c1b1-4334-a50a-9c2e544fb7d0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:45.890633 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-475d567a-c1b1-4334-a50a-9c2e544fb7d0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:45.891070 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-475d567a-c1b1-4334-a50a-9c2e544fb7d0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:45.919334 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-475d567a-c1b1-4334-a50a-9c2e544fb7d0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040218 May 03 09:00:45.919902 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 425/758] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:45 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:46.898681 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-2a8b3cd1-a563-4a68-8cf1-3c49018347ed tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:46.899819 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-2a8b3cd1-a563-4a68-8cf1-3c49018347ed tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:46.907539 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2a8b3cd1-a563-4a68-8cf1-3c49018347ed tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:46.908019 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2a8b3cd1-a563-4a68-8cf1-3c49018347ed tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:46.908773 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2a8b3cd1-a563-4a68-8cf1-3c49018347ed tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:46.909199 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2a8b3cd1-a563-4a68-8cf1-3c49018347ed tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:46.970105 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-2a8b3cd1-a563-4a68-8cf1-3c49018347ed tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:46.977871 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-2a8b3cd1-a563-4a68-8cf1-3c49018347ed tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.085813 May 03 09:00:46.978439 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 426/759] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:46 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:46.982970 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-64a1b8d2-2270-4dfa-93ef-6b4223eabac2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:46.983978 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-64a1b8d2-2270-4dfa-93ef-6b4223eabac2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:46.993866 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-64a1b8d2-2270-4dfa-93ef-6b4223eabac2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:46.994314 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-64a1b8d2-2270-4dfa-93ef-6b4223eabac2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:46.995093 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-64a1b8d2-2270-4dfa-93ef-6b4223eabac2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:46.995530 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-64a1b8d2-2270-4dfa-93ef-6b4223eabac2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:47.025851 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-64a1b8d2-2270-4dfa-93ef-6b4223eabac2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046368 May 03 09:00:47.026409 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 427/760] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:46 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:47.998778 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-11a7f1a4-4289-4d11-b06a-e1d137b59de6 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:47.999854 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-11a7f1a4-4289-4d11-b06a-e1d137b59de6 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:48.010124 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-11a7f1a4-4289-4d11-b06a-e1d137b59de6 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:48.010854 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-11a7f1a4-4289-4d11-b06a-e1d137b59de6 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:48.012097 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-11a7f1a4-4289-4d11-b06a-e1d137b59de6 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:48.012529 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-11a7f1a4-4289-4d11-b06a-e1d137b59de6 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:48.091835 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-11a7f1a4-4289-4d11-b06a-e1d137b59de6 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:48.099854 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-11a7f1a4-4289-4d11-b06a-e1d137b59de6 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.107438 May 03 09:00:48.100716 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 428/761] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:47 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:48.105319 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-cfebee44-30eb-4ad1-a620-bd1801b68831 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:48.106254 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-cfebee44-30eb-4ad1-a620-bd1801b68831 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:48.111794 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cfebee44-30eb-4ad1-a620-bd1801b68831 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:48.112235 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cfebee44-30eb-4ad1-a620-bd1801b68831 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:48.112990 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cfebee44-30eb-4ad1-a620-bd1801b68831 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:48.113415 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cfebee44-30eb-4ad1-a620-bd1801b68831 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:48.141263 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-cfebee44-30eb-4ad1-a620-bd1801b68831 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039593 May 03 09:00:48.142122 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 429/762] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:48 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:49.121049 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e9fa588b-cf54-4da2-95c3-a541a37eadd8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:49.121824 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e9fa588b-cf54-4da2-95c3-a541a37eadd8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:49.129574 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e9fa588b-cf54-4da2-95c3-a541a37eadd8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:49.130097 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e9fa588b-cf54-4da2-95c3-a541a37eadd8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:49.130982 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e9fa588b-cf54-4da2-95c3-a541a37eadd8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:49.131485 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e9fa588b-cf54-4da2-95c3-a541a37eadd8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:49.199388 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e9fa588b-cf54-4da2-95c3-a541a37eadd8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:49.206778 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e9fa588b-cf54-4da2-95c3-a541a37eadd8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.092367 May 03 09:00:49.207312 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 430/763] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:49 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:49.212023 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-0ab37fc6-ac3a-4a78-b1aa-d96c0cb1ee94 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:49.212965 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-0ab37fc6-ac3a-4a78-b1aa-d96c0cb1ee94 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:49.219230 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0ab37fc6-ac3a-4a78-b1aa-d96c0cb1ee94 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:49.219689 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0ab37fc6-ac3a-4a78-b1aa-d96c0cb1ee94 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:49.220470 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0ab37fc6-ac3a-4a78-b1aa-d96c0cb1ee94 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:49.220920 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0ab37fc6-ac3a-4a78-b1aa-d96c0cb1ee94 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:49.250066 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-0ab37fc6-ac3a-4a78-b1aa-d96c0cb1ee94 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041730 May 03 09:00:49.250608 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 431/764] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:49 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:50.227790 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f078b17a-c1fd-4520-ab54-57cbcf74a553 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:50.228774 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f078b17a-c1fd-4520-ab54-57cbcf74a553 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:50.236144 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f078b17a-c1fd-4520-ab54-57cbcf74a553 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:50.236587 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f078b17a-c1fd-4520-ab54-57cbcf74a553 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:50.237352 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f078b17a-c1fd-4520-ab54-57cbcf74a553 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:50.237774 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f078b17a-c1fd-4520-ab54-57cbcf74a553 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:50.300123 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f078b17a-c1fd-4520-ab54-57cbcf74a553 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:50.307647 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f078b17a-c1fd-4520-ab54-57cbcf74a553 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.086371 May 03 09:00:50.308284 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 432/765] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:50 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:50.312722 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-017539b9-b5c1-40f5-8f0e-964bcb0e256b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:50.313619 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-017539b9-b5c1-40f5-8f0e-964bcb0e256b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:50.319277 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-017539b9-b5c1-40f5-8f0e-964bcb0e256b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:50.319717 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-017539b9-b5c1-40f5-8f0e-964bcb0e256b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:50.320496 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-017539b9-b5c1-40f5-8f0e-964bcb0e256b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:50.320924 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-017539b9-b5c1-40f5-8f0e-964bcb0e256b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:50.350512 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-017539b9-b5c1-40f5-8f0e-964bcb0e256b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041238 May 03 09:00:50.351038 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 433/766] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:50 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:51.326938 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-dfdfe796-5e21-4358-a57b-b45cc1d1109b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:51.327601 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-dfdfe796-5e21-4358-a57b-b45cc1d1109b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:51.334429 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dfdfe796-5e21-4358-a57b-b45cc1d1109b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:51.334884 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dfdfe796-5e21-4358-a57b-b45cc1d1109b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:51.335656 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dfdfe796-5e21-4358-a57b-b45cc1d1109b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:51.336120 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dfdfe796-5e21-4358-a57b-b45cc1d1109b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:51.398923 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-dfdfe796-5e21-4358-a57b-b45cc1d1109b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:51.406568 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-dfdfe796-5e21-4358-a57b-b45cc1d1109b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.084594 May 03 09:00:51.407132 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 434/767] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:51 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:51.411601 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-4c9bbc6e-0110-4140-839e-3755378d6eed tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:51.412535 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-4c9bbc6e-0110-4140-839e-3755378d6eed tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:51.418105 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4c9bbc6e-0110-4140-839e-3755378d6eed tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:51.418556 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4c9bbc6e-0110-4140-839e-3755378d6eed tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:51.419314 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4c9bbc6e-0110-4140-839e-3755378d6eed tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:51.419798 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4c9bbc6e-0110-4140-839e-3755378d6eed tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:51.455287 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-4c9bbc6e-0110-4140-839e-3755378d6eed tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046823 May 03 09:00:51.456017 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 435/768] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:51 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:52.425459 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a59a6c08-6a7e-404a-90e8-a712b606232a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:52.426208 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a59a6c08-6a7e-404a-90e8-a712b606232a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:52.434369 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a59a6c08-6a7e-404a-90e8-a712b606232a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:52.434811 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a59a6c08-6a7e-404a-90e8-a712b606232a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:52.435570 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a59a6c08-6a7e-404a-90e8-a712b606232a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:52.436027 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a59a6c08-6a7e-404a-90e8-a712b606232a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:52.505547 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a59a6c08-6a7e-404a-90e8-a712b606232a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:52.513786 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a59a6c08-6a7e-404a-90e8-a712b606232a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.093626 May 03 09:00:52.514350 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 436/769] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:52 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:52.519031 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d063ec1d-0e3a-4b6f-b4c9-255222f016ab tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:52.519975 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d063ec1d-0e3a-4b6f-b4c9-255222f016ab tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:52.525580 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d063ec1d-0e3a-4b6f-b4c9-255222f016ab tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:52.526024 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d063ec1d-0e3a-4b6f-b4c9-255222f016ab tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:52.526795 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d063ec1d-0e3a-4b6f-b4c9-255222f016ab tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:52.527224 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d063ec1d-0e3a-4b6f-b4c9-255222f016ab tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:52.556934 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d063ec1d-0e3a-4b6f-b4c9-255222f016ab tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041614 May 03 09:00:52.557511 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 437/770] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:52 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:53.535129 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-77ce2f07-9e5c-484a-9100-847f93c4c721 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:53.536202 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-77ce2f07-9e5c-484a-9100-847f93c4c721 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:53.545140 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-77ce2f07-9e5c-484a-9100-847f93c4c721 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:53.545580 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-77ce2f07-9e5c-484a-9100-847f93c4c721 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:53.546339 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-77ce2f07-9e5c-484a-9100-847f93c4c721 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:53.546770 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-77ce2f07-9e5c-484a-9100-847f93c4c721 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:53.609032 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-77ce2f07-9e5c-484a-9100-847f93c4c721 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:53.617016 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-77ce2f07-9e5c-484a-9100-847f93c4c721 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.088540 May 03 09:00:53.617580 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 438/771] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:53 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:53.622446 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a03cdc4a-96b1-461c-ac45-615f007a06c8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:53.623361 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a03cdc4a-96b1-461c-ac45-615f007a06c8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:53.628995 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a03cdc4a-96b1-461c-ac45-615f007a06c8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:53.629441 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a03cdc4a-96b1-461c-ac45-615f007a06c8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:53.630205 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a03cdc4a-96b1-461c-ac45-615f007a06c8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:53.630640 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a03cdc4a-96b1-461c-ac45-615f007a06c8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:53.660912 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a03cdc4a-96b1-461c-ac45-615f007a06c8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042359 May 03 09:00:53.661464 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 439/772] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:53 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:54.638526 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ea2f62c8-7ecf-4d0d-9637-cf6c83b61e32 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:54.639579 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ea2f62c8-7ecf-4d0d-9637-cf6c83b61e32 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:54.650183 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ea2f62c8-7ecf-4d0d-9637-cf6c83b61e32 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:54.650938 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ea2f62c8-7ecf-4d0d-9637-cf6c83b61e32 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:54.652241 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ea2f62c8-7ecf-4d0d-9637-cf6c83b61e32 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:54.652680 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ea2f62c8-7ecf-4d0d-9637-cf6c83b61e32 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:54.714208 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ea2f62c8-7ecf-4d0d-9637-cf6c83b61e32 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:54.726302 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ea2f62c8-7ecf-4d0d-9637-cf6c83b61e32 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.094204 May 03 09:00:54.727097 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 440/773] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:54 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:54.732674 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-86c86366-7f07-4198-8b11-805c880fc1d7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:54.733575 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-86c86366-7f07-4198-8b11-805c880fc1d7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:54.739146 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-86c86366-7f07-4198-8b11-805c880fc1d7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:54.739592 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-86c86366-7f07-4198-8b11-805c880fc1d7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:54.740377 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-86c86366-7f07-4198-8b11-805c880fc1d7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:54.740812 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-86c86366-7f07-4198-8b11-805c880fc1d7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:54.768915 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-86c86366-7f07-4198-8b11-805c880fc1d7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040727 May 03 09:00:54.769451 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 441/774] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:54 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:55.748203 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-af5faf8f-ca88-4a2a-9851-196b4ff15635 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:55.749261 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-af5faf8f-ca88-4a2a-9851-196b4ff15635 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:55.759444 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-af5faf8f-ca88-4a2a-9851-196b4ff15635 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:55.760244 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-af5faf8f-ca88-4a2a-9851-196b4ff15635 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:55.761511 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-af5faf8f-ca88-4a2a-9851-196b4ff15635 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:55.762228 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-af5faf8f-ca88-4a2a-9851-196b4ff15635 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:55.829642 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-af5faf8f-ca88-4a2a-9851-196b4ff15635 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:55.837535 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-af5faf8f-ca88-4a2a-9851-196b4ff15635 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.095908 May 03 09:00:55.838100 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 442/775] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:55 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:55.843012 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a179edf3-44fb-4ea8-877a-872fdc5e205b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:55.843941 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a179edf3-44fb-4ea8-877a-872fdc5e205b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:55.849774 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a179edf3-44fb-4ea8-877a-872fdc5e205b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:55.850213 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a179edf3-44fb-4ea8-877a-872fdc5e205b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:55.850969 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a179edf3-44fb-4ea8-877a-872fdc5e205b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:55.851398 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a179edf3-44fb-4ea8-877a-872fdc5e205b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:55.880140 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a179edf3-44fb-4ea8-877a-872fdc5e205b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041047 May 03 09:00:55.880675 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 443/776] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:55 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:56.858589 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-18b65672-f2f9-43ef-9632-277796b2c14a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:56.859666 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-18b65672-f2f9-43ef-9632-277796b2c14a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:56.870316 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-18b65672-f2f9-43ef-9632-277796b2c14a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:56.871083 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-18b65672-f2f9-43ef-9632-277796b2c14a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:56.872409 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-18b65672-f2f9-43ef-9632-277796b2c14a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:56.873151 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-18b65672-f2f9-43ef-9632-277796b2c14a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:56.936081 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-18b65672-f2f9-43ef-9632-277796b2c14a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:56.944080 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-18b65672-f2f9-43ef-9632-277796b2c14a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.091892 May 03 09:00:56.944675 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 444/777] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:56 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:56.949295 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-32028948-a87e-4a3f-90a5-1277eb0c8892 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:56.950209 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-32028948-a87e-4a3f-90a5-1277eb0c8892 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:56.956597 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-32028948-a87e-4a3f-90a5-1277eb0c8892 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:56.957070 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-32028948-a87e-4a3f-90a5-1277eb0c8892 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:56.957855 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-32028948-a87e-4a3f-90a5-1277eb0c8892 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:56.958282 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-32028948-a87e-4a3f-90a5-1277eb0c8892 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:56.987186 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-32028948-a87e-4a3f-90a5-1277eb0c8892 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041493 May 03 09:00:56.987736 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 445/778] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:56 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:57.963621 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a46336c3-59fd-473b-938d-f500d4133e61 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:57.965118 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a46336c3-59fd-473b-938d-f500d4133e61 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:57.975502 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a46336c3-59fd-473b-938d-f500d4133e61 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:57.976075 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a46336c3-59fd-473b-938d-f500d4133e61 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:57.976939 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a46336c3-59fd-473b-938d-f500d4133e61 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:57.977420 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a46336c3-59fd-473b-938d-f500d4133e61 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:58.047742 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a46336c3-59fd-473b-938d-f500d4133e61 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:58.055448 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a46336c3-59fd-473b-938d-f500d4133e61 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.097408 May 03 09:00:58.056049 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 446/779] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:57 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:58.060586 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9c03cae9-42cf-4c10-bae0-7c781a99a3bc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:58.061483 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9c03cae9-42cf-4c10-bae0-7c781a99a3bc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:58.067257 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9c03cae9-42cf-4c10-bae0-7c781a99a3bc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:58.067709 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9c03cae9-42cf-4c10-bae0-7c781a99a3bc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:58.068530 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9c03cae9-42cf-4c10-bae0-7c781a99a3bc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:58.068939 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9c03cae9-42cf-4c10-bae0-7c781a99a3bc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:58.098831 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9c03cae9-42cf-4c10-bae0-7c781a99a3bc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041782 May 03 09:00:58.099397 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 447/780] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:58 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:00:59.076147 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e02d7192-7a9a-4187-af77-624e89140f3d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:59.077268 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e02d7192-7a9a-4187-af77-624e89140f3d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:59.087857 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e02d7192-7a9a-4187-af77-624e89140f3d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:59.088587 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e02d7192-7a9a-4187-af77-624e89140f3d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:59.090218 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e02d7192-7a9a-4187-af77-624e89140f3d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:59.090950 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e02d7192-7a9a-4187-af77-624e89140f3d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:59.154086 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e02d7192-7a9a-4187-af77-624e89140f3d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:00:59.165950 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e02d7192-7a9a-4187-af77-624e89140f3d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.096078 May 03 09:00:59.166727 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 448/781] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:00:59 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:00:59.171344 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-4b833bd8-b146-46fc-ad4f-b18fe0ef2e3b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:00:59.172288 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-4b833bd8-b146-46fc-ad4f-b18fe0ef2e3b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:00:59.178308 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4b833bd8-b146-46fc-ad4f-b18fe0ef2e3b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:59.178795 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4b833bd8-b146-46fc-ad4f-b18fe0ef2e3b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:59.179587 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4b833bd8-b146-46fc-ad4f-b18fe0ef2e3b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:00:59.180059 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4b833bd8-b146-46fc-ad4f-b18fe0ef2e3b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:00:59.209676 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-4b833bd8-b146-46fc-ad4f-b18fe0ef2e3b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041911 May 03 09:00:59.210236 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 449/782] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:00:59 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:01:00.186952 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-8065c9d6-867c-49e3-b413-d43c2be90639 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:01:00.188017 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-8065c9d6-867c-49e3-b413-d43c2be90639 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:01:00.198476 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8065c9d6-867c-49e3-b413-d43c2be90639 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:01:00.199230 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8065c9d6-867c-49e3-b413-d43c2be90639 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:01:00.200634 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8065c9d6-867c-49e3-b413-d43c2be90639 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:01:00.201407 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8065c9d6-867c-49e3-b413-d43c2be90639 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:01:00.274560 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-8065c9d6-867c-49e3-b413-d43c2be90639 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:01:00.283421 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-8065c9d6-867c-49e3-b413-d43c2be90639 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.102977 May 03 09:01:00.284235 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 450/783] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:01:00 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:01:00.288886 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a0b29eb8-83a2-44e4-b18f-ef6d7e2991bd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:01:00.289820 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a0b29eb8-83a2-44e4-b18f-ef6d7e2991bd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:01:00.296013 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a0b29eb8-83a2-44e4-b18f-ef6d7e2991bd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:01:00.296452 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a0b29eb8-83a2-44e4-b18f-ef6d7e2991bd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:01:00.297209 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a0b29eb8-83a2-44e4-b18f-ef6d7e2991bd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:01:00.297636 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a0b29eb8-83a2-44e4-b18f-ef6d7e2991bd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:01:00.326596 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a0b29eb8-83a2-44e4-b18f-ef6d7e2991bd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041372 May 03 09:01:00.327151 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 451/784] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:01:00 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:01:01.304805 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b516b799-3fca-4ec4-af71-b917d1358b7d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:01:01.305790 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b516b799-3fca-4ec4-af71-b917d1358b7d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:01:01.313985 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b516b799-3fca-4ec4-af71-b917d1358b7d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:01:01.314424 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b516b799-3fca-4ec4-af71-b917d1358b7d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:01:01.315191 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b516b799-3fca-4ec4-af71-b917d1358b7d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:01:01.315644 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b516b799-3fca-4ec4-af71-b917d1358b7d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:01:01.378788 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b516b799-3fca-4ec4-af71-b917d1358b7d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:01:01.386290 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b516b799-3fca-4ec4-af71-b917d1358b7d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.088145 May 03 09:01:01.386855 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 452/785] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:01:01 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:01:01.391693 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-6ce753af-d94d-45b2-ae8e-2510627a4d4c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:01:01.392659 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-6ce753af-d94d-45b2-ae8e-2510627a4d4c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:01:01.398690 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6ce753af-d94d-45b2-ae8e-2510627a4d4c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:01:01.399133 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6ce753af-d94d-45b2-ae8e-2510627a4d4c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:01:01.399929 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6ce753af-d94d-45b2-ae8e-2510627a4d4c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:01:01.400366 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6ce753af-d94d-45b2-ae8e-2510627a4d4c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:01:01.428510 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-6ce753af-d94d-45b2-ae8e-2510627a4d4c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040682 May 03 09:01:01.429039 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 453/786] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:01:01 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:01:02.407316 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-6614f1fb-7708-43e4-a024-2ea953245967 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:01:02.408460 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-6614f1fb-7708-43e4-a024-2ea953245967 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:01:02.419073 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6614f1fb-7708-43e4-a024-2ea953245967 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:01:02.419672 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6614f1fb-7708-43e4-a024-2ea953245967 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:01:02.420498 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6614f1fb-7708-43e4-a024-2ea953245967 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:01:02.420935 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6614f1fb-7708-43e4-a024-2ea953245967 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:01:02.486042 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-6614f1fb-7708-43e4-a024-2ea953245967 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:01:02.497201 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-6614f1fb-7708-43e4-a024-2ea953245967 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.096390 May 03 09:01:02.497934 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 454/787] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:01:02 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:01:02.502579 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5d1aa58d-780f-4c26-8020-4da9eaf17347 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:01:02.503514 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5d1aa58d-780f-4c26-8020-4da9eaf17347 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:01:02.510485 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5d1aa58d-780f-4c26-8020-4da9eaf17347 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:01:02.510992 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5d1aa58d-780f-4c26-8020-4da9eaf17347 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:01:02.512198 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5d1aa58d-780f-4c26-8020-4da9eaf17347 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:01:02.512821 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5d1aa58d-780f-4c26-8020-4da9eaf17347 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:01:02.541247 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5d1aa58d-780f-4c26-8020-4da9eaf17347 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042231 May 03 09:01:02.541832 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 455/788] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:01:02 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:01:02.749285 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-cfb395b0-e776-48da-aeb7-1c1d36fcf814 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:01:02.749963 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-cfb395b0-e776-48da-aeb7-1c1d36fcf814 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:01:02.760286 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cfb395b0-e776-48da-aeb7-1c1d36fcf814 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:01:02.761037 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cfb395b0-e776-48da-aeb7-1c1d36fcf814 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:01:02.762282 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cfb395b0-e776-48da-aeb7-1c1d36fcf814 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:01:02.763000 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cfb395b0-e776-48da-aeb7-1c1d36fcf814 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:01:47.129787 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 09:01:47.130926 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: Tue May 3 09:01:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments/b0e90a13-d5bd-4175-8cb5-6962b4700c63 (ip 10.222.0.11) !!! May 03 09:01:58.362292 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 09:01:58.363299 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: Tue May 3 09:01:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments/b0e90a13-d5bd-4175-8cb5-6962b4700c63 (ip 10.222.0.11) !!! May 03 09:02:02.768774 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-38d996a8-98c6-49dd-bb45-ce9706bca6b6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "DELETE /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments/b0e90a13-d5bd-4175-8cb5-6962b4700c63" status: 202 len: 0 microversion: 2.1 time: 120.087151 May 03 09:02:02.769405 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 334/789] 10.222.0.11 () {58 vars in 1415 bytes} [Tue May 3 09:00:02 2022] DELETE /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments/b0e90a13-d5bd-4175-8cb5-6962b4700c63 => generated 0 bytes in 120089 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 09:02:02.775175 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-aebdef84-404f-4fc0-adbb-a00459589598 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:02.775907 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-aebdef84-404f-4fc0-adbb-a00459589598 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:02.782066 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aebdef84-404f-4fc0-adbb-a00459589598 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:02.782521 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aebdef84-404f-4fc0-adbb-a00459589598 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:02.783407 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aebdef84-404f-4fc0-adbb-a00459589598 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:02.783739 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aebdef84-404f-4fc0-adbb-a00459589598 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:02.847318 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-aebdef84-404f-4fc0-adbb-a00459589598 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:02:02.854963 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-aebdef84-404f-4fc0-adbb-a00459589598 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.084312 May 03 09:02:02.855716 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 335/790] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:02:02 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:02:02.860385 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-043ec38c-4894-49fa-8c99-db5423534460 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:02.861643 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-043ec38c-4894-49fa-8c99-db5423534460 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:02.866154 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.objects.instance [None req-cfb395b0-e776-48da-aeb7-1c1d36fcf814 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lazy-loading 'services' on Instance uuid 512c1f04-399e-4647-8bfe-f2c295397df2 {{(pid=123391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 03 09:02:02.868234 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-043ec38c-4894-49fa-8c99-db5423534460 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:02.868858 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-043ec38c-4894-49fa-8c99-db5423534460 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:02.869659 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-043ec38c-4894-49fa-8c99-db5423534460 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:02.870090 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-043ec38c-4894-49fa-8c99-db5423534460 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:02.899797 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-043ec38c-4894-49fa-8c99-db5423534460 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043102 May 03 09:02:02.900363 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 336/791] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:02:02 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:02:02.905737 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a4bd2263-5b53-4212-a2f1-832ad9288bb9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:02.906402 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a4bd2263-5b53-4212-a2f1-832ad9288bb9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:02.912830 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a4bd2263-5b53-4212-a2f1-832ad9288bb9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:02.913667 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a4bd2263-5b53-4212-a2f1-832ad9288bb9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:02.914331 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a4bd2263-5b53-4212-a2f1-832ad9288bb9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:02.914771 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a4bd2263-5b53-4212-a2f1-832ad9288bb9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:03.556800 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 09:02:03.557153 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: Tue May 3 09:02:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments/b0e90a13-d5bd-4175-8cb5-6962b4700c63 (ip 10.222.0.11) !!! May 03 09:02:15.769872 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 09:02:15.770648 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: Tue May 3 09:02:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments/b0e90a13-d5bd-4175-8cb5-6962b4700c63 (ip 10.222.0.11) !!! May 03 09:02:24.425608 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.wsgi [None req-cfb395b0-e776-48da-aeb7-1c1d36fcf814 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-db19ff0b-bab3-4586-a449-9bbab7334f4c) May 03 09:02:24.426212 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-cfb395b0-e776-48da-aeb7-1c1d36fcf814 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-db19ff0b-bab3-4586-a449-9bbab7334f4c) {{(pid=123391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 09:02:24.427082 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-cfb395b0-e776-48da-aeb7-1c1d36fcf814 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "DELETE /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments/b0e90a13-d5bd-4175-8cb5-6962b4700c63" status: 400 len: 269 microversion: 2.1 time: 81.684982 May 03 09:02:24.427674 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 456/792] 10.222.0.11 () {58 vars in 1415 bytes} [Tue May 3 09:01:02 2022] DELETE /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments/b0e90a13-d5bd-4175-8cb5-6962b4700c63 => generated 269 bytes in 81686 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 03 09:02:24.432882 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e09e3a71-12a1-4939-8bb3-d6f502b867d4 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:24.433563 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e09e3a71-12a1-4939-8bb3-d6f502b867d4 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:24.439508 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e09e3a71-12a1-4939-8bb3-d6f502b867d4 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:24.439992 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e09e3a71-12a1-4939-8bb3-d6f502b867d4 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:24.440749 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e09e3a71-12a1-4939-8bb3-d6f502b867d4 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:24.441183 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e09e3a71-12a1-4939-8bb3-d6f502b867d4 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:24.472795 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.objects.instance [None req-a4bd2263-5b53-4212-a2f1-832ad9288bb9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lazy-loading 'services' on Instance uuid 512c1f04-399e-4647-8bfe-f2c295397df2 {{(pid=123392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 03 09:02:24.508914 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e09e3a71-12a1-4939-8bb3-d6f502b867d4 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:02:24.516911 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e09e3a71-12a1-4939-8bb3-d6f502b867d4 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.088274 May 03 09:02:24.517491 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 457/793] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:02:24 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:02:24.522077 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-530b9a60-1256-477b-99db-857cb9642aad tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:24.523055 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-530b9a60-1256-477b-99db-857cb9642aad tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:24.528779 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-530b9a60-1256-477b-99db-857cb9642aad tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:24.529229 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-530b9a60-1256-477b-99db-857cb9642aad tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:24.530006 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-530b9a60-1256-477b-99db-857cb9642aad tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:24.530441 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-530b9a60-1256-477b-99db-857cb9642aad tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:24.559139 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-530b9a60-1256-477b-99db-857cb9642aad tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040629 May 03 09:02:24.559702 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 458/794] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:02:24 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:02:25.537531 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-1a119514-27c6-4622-88fc-8bfc6697d4a1 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:25.538519 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-1a119514-27c6-4622-88fc-8bfc6697d4a1 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:25.549100 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1a119514-27c6-4622-88fc-8bfc6697d4a1 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:25.549856 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1a119514-27c6-4622-88fc-8bfc6697d4a1 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:25.551118 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1a119514-27c6-4622-88fc-8bfc6697d4a1 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:25.551841 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1a119514-27c6-4622-88fc-8bfc6697d4a1 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:25.855543 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-1a119514-27c6-4622-88fc-8bfc6697d4a1 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:02:25.863056 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-1a119514-27c6-4622-88fc-8bfc6697d4a1 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.332230 May 03 09:02:25.863617 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 459/795] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:02:25 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:02:25.868097 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-48556874-2bfe-4259-abe0-a65482694d87 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:25.869028 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-48556874-2bfe-4259-abe0-a65482694d87 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:25.874322 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-48556874-2bfe-4259-abe0-a65482694d87 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:25.874776 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-48556874-2bfe-4259-abe0-a65482694d87 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:25.875532 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-48556874-2bfe-4259-abe0-a65482694d87 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:25.875993 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-48556874-2bfe-4259-abe0-a65482694d87 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:25.903790 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-48556874-2bfe-4259-abe0-a65482694d87 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039146 May 03 09:02:25.904335 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 460/796] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:02:25 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:02:26.883585 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-75fceb34-64d0-46d8-91c2-66fb1415c4b4 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:26.884687 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-75fceb34-64d0-46d8-91c2-66fb1415c4b4 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:26.895065 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-75fceb34-64d0-46d8-91c2-66fb1415c4b4 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:26.895821 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-75fceb34-64d0-46d8-91c2-66fb1415c4b4 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:26.897096 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-75fceb34-64d0-46d8-91c2-66fb1415c4b4 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:26.897819 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-75fceb34-64d0-46d8-91c2-66fb1415c4b4 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:26.962988 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-75fceb34-64d0-46d8-91c2-66fb1415c4b4 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:02:26.970864 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-75fceb34-64d0-46d8-91c2-66fb1415c4b4 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.093701 May 03 09:02:26.971427 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 461/797] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:02:26 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:02:26.976114 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e80cfbfd-cb76-4834-9b7c-3178dd3b24fd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:26.977014 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e80cfbfd-cb76-4834-9b7c-3178dd3b24fd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:26.982914 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e80cfbfd-cb76-4834-9b7c-3178dd3b24fd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:26.983353 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e80cfbfd-cb76-4834-9b7c-3178dd3b24fd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:26.984140 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e80cfbfd-cb76-4834-9b7c-3178dd3b24fd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:26.984572 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e80cfbfd-cb76-4834-9b7c-3178dd3b24fd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:27.013512 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e80cfbfd-cb76-4834-9b7c-3178dd3b24fd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041084 May 03 09:02:27.014053 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 462/798] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:02:26 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:02:27.991580 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-630cceeb-287e-4dfb-9273-da592c20d573 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:27.992715 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-630cceeb-287e-4dfb-9273-da592c20d573 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:28.003277 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-630cceeb-287e-4dfb-9273-da592c20d573 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:28.004091 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-630cceeb-287e-4dfb-9273-da592c20d573 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:28.005357 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-630cceeb-287e-4dfb-9273-da592c20d573 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:28.006082 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-630cceeb-287e-4dfb-9273-da592c20d573 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:28.067942 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-630cceeb-287e-4dfb-9273-da592c20d573 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:02:28.075705 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-630cceeb-287e-4dfb-9273-da592c20d573 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.090456 May 03 09:02:28.084625 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 463/799] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:02:27 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:02:28.084625 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e8d39411-647b-4c52-9bd6-664b419bc8bc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:28.084625 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e8d39411-647b-4c52-9bd6-664b419bc8bc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:28.088481 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e8d39411-647b-4c52-9bd6-664b419bc8bc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:28.088846 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e8d39411-647b-4c52-9bd6-664b419bc8bc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:28.089609 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e8d39411-647b-4c52-9bd6-664b419bc8bc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:28.090022 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e8d39411-647b-4c52-9bd6-664b419bc8bc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:28.118643 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e8d39411-647b-4c52-9bd6-664b419bc8bc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040987 May 03 09:02:28.119200 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 464/800] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:02:28 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:02:29.093586 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-7eea9b27-81f3-4615-a5ba-01e57e7e30a7 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:29.094287 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-7eea9b27-81f3-4615-a5ba-01e57e7e30a7 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:29.101265 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7eea9b27-81f3-4615-a5ba-01e57e7e30a7 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:29.101713 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7eea9b27-81f3-4615-a5ba-01e57e7e30a7 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:29.102473 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7eea9b27-81f3-4615-a5ba-01e57e7e30a7 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:29.102903 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7eea9b27-81f3-4615-a5ba-01e57e7e30a7 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:29.170307 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7eea9b27-81f3-4615-a5ba-01e57e7e30a7 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:02:29.177847 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-7eea9b27-81f3-4615-a5ba-01e57e7e30a7 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.088403 May 03 09:02:29.178413 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 465/801] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:02:29 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:02:29.182949 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ad738c3d-ad59-4972-bf37-b6ec27c06d12 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:29.183904 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ad738c3d-ad59-4972-bf37-b6ec27c06d12 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:29.189406 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ad738c3d-ad59-4972-bf37-b6ec27c06d12 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:29.189845 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ad738c3d-ad59-4972-bf37-b6ec27c06d12 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:29.190593 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ad738c3d-ad59-4972-bf37-b6ec27c06d12 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:29.191022 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ad738c3d-ad59-4972-bf37-b6ec27c06d12 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:29.220584 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ad738c3d-ad59-4972-bf37-b6ec27c06d12 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041140 May 03 09:02:29.221154 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 466/802] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:02:29 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:02:30.198591 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-6a7e43f2-6455-468e-a5cc-749ebb2e53e4 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:30.199701 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-6a7e43f2-6455-468e-a5cc-749ebb2e53e4 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:30.208109 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6a7e43f2-6455-468e-a5cc-749ebb2e53e4 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:30.208555 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6a7e43f2-6455-468e-a5cc-749ebb2e53e4 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:30.209334 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6a7e43f2-6455-468e-a5cc-749ebb2e53e4 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:30.209761 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6a7e43f2-6455-468e-a5cc-749ebb2e53e4 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:30.272437 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-6a7e43f2-6455-468e-a5cc-749ebb2e53e4 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:02:30.279940 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-6a7e43f2-6455-468e-a5cc-749ebb2e53e4 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.087857 May 03 09:02:30.280472 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 467/803] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:02:30 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:02:30.285114 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5911db92-429b-4d3b-9d37-8b466462e914 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:30.286017 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5911db92-429b-4d3b-9d37-8b466462e914 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:30.291656 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5911db92-429b-4d3b-9d37-8b466462e914 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:30.292135 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5911db92-429b-4d3b-9d37-8b466462e914 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:30.293001 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5911db92-429b-4d3b-9d37-8b466462e914 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:30.293436 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5911db92-429b-4d3b-9d37-8b466462e914 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:30.320717 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5911db92-429b-4d3b-9d37-8b466462e914 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039272 May 03 09:02:30.321258 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 468/804] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:02:30 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:02:31.301145 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ba890c89-ea9e-4d5d-983e-1cc3d6ca8a77 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:31.302092 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ba890c89-ea9e-4d5d-983e-1cc3d6ca8a77 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:31.311209 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ba890c89-ea9e-4d5d-983e-1cc3d6ca8a77 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:31.311723 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ba890c89-ea9e-4d5d-983e-1cc3d6ca8a77 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:31.312612 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ba890c89-ea9e-4d5d-983e-1cc3d6ca8a77 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:31.313055 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ba890c89-ea9e-4d5d-983e-1cc3d6ca8a77 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:31.375759 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ba890c89-ea9e-4d5d-983e-1cc3d6ca8a77 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:02:31.384626 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ba890c89-ea9e-4d5d-983e-1cc3d6ca8a77 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.090324 May 03 09:02:31.385330 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 469/805] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:02:31 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:02:31.390002 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-150a75a6-b8ac-49c1-bc1a-93bf8f773bbc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:31.390895 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-150a75a6-b8ac-49c1-bc1a-93bf8f773bbc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:31.399249 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-150a75a6-b8ac-49c1-bc1a-93bf8f773bbc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:31.399873 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-150a75a6-b8ac-49c1-bc1a-93bf8f773bbc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:31.401008 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-150a75a6-b8ac-49c1-bc1a-93bf8f773bbc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:31.401582 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-150a75a6-b8ac-49c1-bc1a-93bf8f773bbc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:31.431333 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-150a75a6-b8ac-49c1-bc1a-93bf8f773bbc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044925 May 03 09:02:31.431873 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 470/806] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:02:31 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:02:32.405510 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-29506063-2b06-47d4-b286-8d2b764535cc tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:32.406403 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-29506063-2b06-47d4-b286-8d2b764535cc tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:32.415171 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-29506063-2b06-47d4-b286-8d2b764535cc tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:32.416143 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-29506063-2b06-47d4-b286-8d2b764535cc tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:32.417897 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-29506063-2b06-47d4-b286-8d2b764535cc tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:32.418889 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-29506063-2b06-47d4-b286-8d2b764535cc tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:32.494993 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-29506063-2b06-47d4-b286-8d2b764535cc tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:02:32.503011 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-29506063-2b06-47d4-b286-8d2b764535cc tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.103054 May 03 09:02:32.503595 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 471/807] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:02:32 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:02:32.509740 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-4cc89731-7e8b-47f6-8834-013d9c1bfa68 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:32.510698 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-4cc89731-7e8b-47f6-8834-013d9c1bfa68 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:32.517555 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4cc89731-7e8b-47f6-8834-013d9c1bfa68 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:32.517997 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4cc89731-7e8b-47f6-8834-013d9c1bfa68 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:32.518750 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4cc89731-7e8b-47f6-8834-013d9c1bfa68 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:32.519182 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4cc89731-7e8b-47f6-8834-013d9c1bfa68 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:32.554412 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-4cc89731-7e8b-47f6-8834-013d9c1bfa68 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049693 May 03 09:02:32.554985 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 472/808] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:02:32 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:02:33.524521 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3df20994-6e7c-429a-9abc-2922857d311c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:33.525522 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-3df20994-6e7c-429a-9abc-2922857d311c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:33.536013 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3df20994-6e7c-429a-9abc-2922857d311c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:33.536794 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3df20994-6e7c-429a-9abc-2922857d311c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:33.538021 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3df20994-6e7c-429a-9abc-2922857d311c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:33.538775 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3df20994-6e7c-429a-9abc-2922857d311c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:33.608786 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-3df20994-6e7c-429a-9abc-2922857d311c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:02:33.616650 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-3df20994-6e7c-429a-9abc-2922857d311c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.098799 May 03 09:02:33.617227 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 473/809] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:02:33 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:02:33.621811 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-69ca2140-6fb3-45c9-a442-4fa4373584a2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:33.622720 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-69ca2140-6fb3-45c9-a442-4fa4373584a2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:33.628592 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-69ca2140-6fb3-45c9-a442-4fa4373584a2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:33.629064 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-69ca2140-6fb3-45c9-a442-4fa4373584a2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:33.629822 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-69ca2140-6fb3-45c9-a442-4fa4373584a2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:33.630268 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-69ca2140-6fb3-45c9-a442-4fa4373584a2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:33.660590 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-69ca2140-6fb3-45c9-a442-4fa4373584a2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042360 May 03 09:02:33.661130 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 474/810] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:02:33 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:02:34.637604 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-69fc490e-c941-4bba-a6e5-8a547434cee2 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:34.638613 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-69fc490e-c941-4bba-a6e5-8a547434cee2 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:34.648982 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-69fc490e-c941-4bba-a6e5-8a547434cee2 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:34.649720 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-69fc490e-c941-4bba-a6e5-8a547434cee2 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:34.650972 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-69fc490e-c941-4bba-a6e5-8a547434cee2 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:34.651794 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-69fc490e-c941-4bba-a6e5-8a547434cee2 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:34.714379 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-69fc490e-c941-4bba-a6e5-8a547434cee2 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:02:34.726102 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-69fc490e-c941-4bba-a6e5-8a547434cee2 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.094762 May 03 09:02:34.726861 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 475/811] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:02:34 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:02:34.732507 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-fb991b68-9f20-4800-b470-bed9938330d8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:34.733411 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-fb991b68-9f20-4800-b470-bed9938330d8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:34.739359 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fb991b68-9f20-4800-b470-bed9938330d8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:34.739805 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fb991b68-9f20-4800-b470-bed9938330d8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:34.740595 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fb991b68-9f20-4800-b470-bed9938330d8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:34.741028 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fb991b68-9f20-4800-b470-bed9938330d8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:34.770495 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-fb991b68-9f20-4800-b470-bed9938330d8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042450 May 03 09:02:34.771055 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 476/812] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:02:34 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:02:35.747076 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-acf09e70-0c4e-41e5-82d4-eb631562100a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:35.748147 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-acf09e70-0c4e-41e5-82d4-eb631562100a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:35.758640 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-acf09e70-0c4e-41e5-82d4-eb631562100a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:35.759384 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-acf09e70-0c4e-41e5-82d4-eb631562100a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:35.760711 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-acf09e70-0c4e-41e5-82d4-eb631562100a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:35.761770 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-acf09e70-0c4e-41e5-82d4-eb631562100a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:35.824882 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-acf09e70-0c4e-41e5-82d4-eb631562100a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:02:35.836296 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-acf09e70-0c4e-41e5-82d4-eb631562100a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.095059 May 03 09:02:35.836858 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 477/813] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:02:35 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:02:35.841681 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f2100693-23d7-4309-993a-4903578fba8b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:35.842580 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f2100693-23d7-4309-993a-4903578fba8b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:35.848243 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f2100693-23d7-4309-993a-4903578fba8b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:35.848687 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f2100693-23d7-4309-993a-4903578fba8b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:35.849434 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f2100693-23d7-4309-993a-4903578fba8b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:35.849866 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f2100693-23d7-4309-993a-4903578fba8b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:35.877545 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f2100693-23d7-4309-993a-4903578fba8b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039735 May 03 09:02:35.878070 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 478/814] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:02:35 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:02:36.857509 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ec906a67-bc0c-4b7b-8ce4-149e97f63be8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:36.858545 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ec906a67-bc0c-4b7b-8ce4-149e97f63be8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:36.869155 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ec906a67-bc0c-4b7b-8ce4-149e97f63be8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:36.869895 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ec906a67-bc0c-4b7b-8ce4-149e97f63be8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:36.874930 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ec906a67-bc0c-4b7b-8ce4-149e97f63be8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:36.875391 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ec906a67-bc0c-4b7b-8ce4-149e97f63be8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:36.941038 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ec906a67-bc0c-4b7b-8ce4-149e97f63be8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:02:36.954055 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ec906a67-bc0c-4b7b-8ce4-149e97f63be8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.103337 May 03 09:02:36.955010 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 479/815] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:02:36 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:02:36.960113 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-39c45ae5-0183-43b7-8b5c-13a9fc236a2b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:36.961355 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-39c45ae5-0183-43b7-8b5c-13a9fc236a2b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:36.967322 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-39c45ae5-0183-43b7-8b5c-13a9fc236a2b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:36.967790 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-39c45ae5-0183-43b7-8b5c-13a9fc236a2b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:36.968549 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-39c45ae5-0183-43b7-8b5c-13a9fc236a2b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:36.968981 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-39c45ae5-0183-43b7-8b5c-13a9fc236a2b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:36.997570 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-39c45ae5-0183-43b7-8b5c-13a9fc236a2b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040994 May 03 09:02:36.998123 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 480/816] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:02:36 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:02:37.975411 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b0b89a9e-68db-499a-8a0b-8a8c60960895 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:37.976522 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b0b89a9e-68db-499a-8a0b-8a8c60960895 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:37.984444 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b0b89a9e-68db-499a-8a0b-8a8c60960895 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:37.984895 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b0b89a9e-68db-499a-8a0b-8a8c60960895 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:37.985655 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b0b89a9e-68db-499a-8a0b-8a8c60960895 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:37.986084 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b0b89a9e-68db-499a-8a0b-8a8c60960895 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:38.048348 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b0b89a9e-68db-499a-8a0b-8a8c60960895 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:02:38.056275 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b0b89a9e-68db-499a-8a0b-8a8c60960895 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.087226 May 03 09:02:38.056839 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 481/817] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:02:37 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:02:38.061309 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5706f6a9-7320-4a1e-b3fd-4963ab94b93e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:38.062210 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5706f6a9-7320-4a1e-b3fd-4963ab94b93e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:38.067920 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5706f6a9-7320-4a1e-b3fd-4963ab94b93e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:38.068377 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5706f6a9-7320-4a1e-b3fd-4963ab94b93e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:38.069141 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5706f6a9-7320-4a1e-b3fd-4963ab94b93e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:38.069573 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5706f6a9-7320-4a1e-b3fd-4963ab94b93e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:38.098534 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5706f6a9-7320-4a1e-b3fd-4963ab94b93e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040672 May 03 09:02:38.099092 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 482/818] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:02:38 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:02:39.073714 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9ea82937-c244-4cfe-a922-a12e098fecc2 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:39.074486 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9ea82937-c244-4cfe-a922-a12e098fecc2 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:39.081420 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9ea82937-c244-4cfe-a922-a12e098fecc2 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:39.081895 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9ea82937-c244-4cfe-a922-a12e098fecc2 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:39.082690 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9ea82937-c244-4cfe-a922-a12e098fecc2 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:39.083141 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9ea82937-c244-4cfe-a922-a12e098fecc2 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:39.144827 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9ea82937-c244-4cfe-a922-a12e098fecc2 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:02:39.152255 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9ea82937-c244-4cfe-a922-a12e098fecc2 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.082595 May 03 09:02:39.152824 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 483/819] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:02:39 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:02:39.157352 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-74390d30-65cf-426d-9c06-98a56f24d89a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:39.158248 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-74390d30-65cf-426d-9c06-98a56f24d89a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:39.163901 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-74390d30-65cf-426d-9c06-98a56f24d89a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:39.164347 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-74390d30-65cf-426d-9c06-98a56f24d89a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:39.165099 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-74390d30-65cf-426d-9c06-98a56f24d89a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:39.165525 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-74390d30-65cf-426d-9c06-98a56f24d89a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:39.193621 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-74390d30-65cf-426d-9c06-98a56f24d89a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039837 May 03 09:02:39.194151 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 484/820] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:02:39 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:02:40.173011 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-178064ad-642c-4750-8f21-c42d06f34c74 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:40.174061 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-178064ad-642c-4750-8f21-c42d06f34c74 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:40.184512 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-178064ad-642c-4750-8f21-c42d06f34c74 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:40.184950 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-178064ad-642c-4750-8f21-c42d06f34c74 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:40.185722 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-178064ad-642c-4750-8f21-c42d06f34c74 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:40.186158 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-178064ad-642c-4750-8f21-c42d06f34c74 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:40.251684 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-178064ad-642c-4750-8f21-c42d06f34c74 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:02:40.261103 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-178064ad-642c-4750-8f21-c42d06f34c74 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.094612 May 03 09:02:40.261674 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 485/821] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:02:40 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:02:40.266370 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-322d2357-df01-42c3-b935-5a41e2a804d7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:40.267299 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-322d2357-df01-42c3-b935-5a41e2a804d7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:40.273495 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-322d2357-df01-42c3-b935-5a41e2a804d7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:40.273944 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-322d2357-df01-42c3-b935-5a41e2a804d7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:40.274707 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-322d2357-df01-42c3-b935-5a41e2a804d7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:40.275136 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-322d2357-df01-42c3-b935-5a41e2a804d7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:40.309622 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-322d2357-df01-42c3-b935-5a41e2a804d7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046877 May 03 09:02:40.310212 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 486/822] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:02:40 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:02:41.280689 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-7b93f97a-3585-451d-b8d2-c309a47f3f89 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:41.281355 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-7b93f97a-3585-451d-b8d2-c309a47f3f89 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:41.288933 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7b93f97a-3585-451d-b8d2-c309a47f3f89 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:41.289458 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7b93f97a-3585-451d-b8d2-c309a47f3f89 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:41.290686 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7b93f97a-3585-451d-b8d2-c309a47f3f89 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:41.291257 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7b93f97a-3585-451d-b8d2-c309a47f3f89 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:41.361870 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7b93f97a-3585-451d-b8d2-c309a47f3f89 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:02:41.373365 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-7b93f97a-3585-451d-b8d2-c309a47f3f89 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.098602 May 03 09:02:41.381677 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 487/823] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:02:41 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:02:41.381677 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-05190d66-4234-40b1-be91-526cae0c857a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:41.381677 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-05190d66-4234-40b1-be91-526cae0c857a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:41.388777 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-05190d66-4234-40b1-be91-526cae0c857a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:41.389238 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-05190d66-4234-40b1-be91-526cae0c857a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:41.390001 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-05190d66-4234-40b1-be91-526cae0c857a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:41.390437 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-05190d66-4234-40b1-be91-526cae0c857a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:41.420697 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-05190d66-4234-40b1-be91-526cae0c857a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045323 May 03 09:02:41.421366 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 488/824] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:02:41 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:02:42.394473 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d3c06735-49da-409c-b1d1-13b039b7c7b5 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:42.395507 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d3c06735-49da-409c-b1d1-13b039b7c7b5 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:42.405268 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d3c06735-49da-409c-b1d1-13b039b7c7b5 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:42.405714 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d3c06735-49da-409c-b1d1-13b039b7c7b5 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:42.406482 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d3c06735-49da-409c-b1d1-13b039b7c7b5 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:42.406916 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d3c06735-49da-409c-b1d1-13b039b7c7b5 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:42.468887 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d3c06735-49da-409c-b1d1-13b039b7c7b5 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:02:42.476362 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d3c06735-49da-409c-b1d1-13b039b7c7b5 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.088467 May 03 09:02:42.476931 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 489/825] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:02:42 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:02:42.481409 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3b15e39e-183d-45c2-8a4d-c94c9d63c88f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:42.482332 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-3b15e39e-183d-45c2-8a4d-c94c9d63c88f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:42.487923 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3b15e39e-183d-45c2-8a4d-c94c9d63c88f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:42.488368 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3b15e39e-183d-45c2-8a4d-c94c9d63c88f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:42.489123 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3b15e39e-183d-45c2-8a4d-c94c9d63c88f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:42.489555 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3b15e39e-183d-45c2-8a4d-c94c9d63c88f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:42.517715 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-3b15e39e-183d-45c2-8a4d-c94c9d63c88f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039822 May 03 09:02:42.518296 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 490/826] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:02:42 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:02:43.493454 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-2af3b746-6833-4208-b8ec-79a3dce5391d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:43.494123 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-2af3b746-6833-4208-b8ec-79a3dce5391d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:43.500579 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2af3b746-6833-4208-b8ec-79a3dce5391d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:43.501020 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2af3b746-6833-4208-b8ec-79a3dce5391d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:43.501776 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2af3b746-6833-4208-b8ec-79a3dce5391d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:43.502203 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2af3b746-6833-4208-b8ec-79a3dce5391d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:43.565239 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-2af3b746-6833-4208-b8ec-79a3dce5391d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:02:43.572830 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-2af3b746-6833-4208-b8ec-79a3dce5391d tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.083543 May 03 09:02:43.573413 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 491/827] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:02:43 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:02:43.577997 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-87a959b9-8466-4f63-a2c0-17f64532d3ee tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:43.578894 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-87a959b9-8466-4f63-a2c0-17f64532d3ee tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:43.584441 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-87a959b9-8466-4f63-a2c0-17f64532d3ee tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:43.584884 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-87a959b9-8466-4f63-a2c0-17f64532d3ee tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:43.585954 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-87a959b9-8466-4f63-a2c0-17f64532d3ee tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:43.586373 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-87a959b9-8466-4f63-a2c0-17f64532d3ee tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:43.613761 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-87a959b9-8466-4f63-a2c0-17f64532d3ee tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039383 May 03 09:02:43.614297 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 492/828] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:02:43 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:02:44.593111 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a9882fe9-7b4e-4687-a420-0ff66a33f23a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:44.594100 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a9882fe9-7b4e-4687-a420-0ff66a33f23a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:44.600643 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a9882fe9-7b4e-4687-a420-0ff66a33f23a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:44.601093 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a9882fe9-7b4e-4687-a420-0ff66a33f23a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:44.601860 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a9882fe9-7b4e-4687-a420-0ff66a33f23a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:44.602289 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a9882fe9-7b4e-4687-a420-0ff66a33f23a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:44.678063 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a9882fe9-7b4e-4687-a420-0ff66a33f23a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:02:44.685726 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a9882fe9-7b4e-4687-a420-0ff66a33f23a tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.098712 May 03 09:02:44.686297 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 493/829] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:02:44 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:02:44.690842 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-8884833e-a6f3-4385-bf09-d29119f68672 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:44.691760 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-8884833e-a6f3-4385-bf09-d29119f68672 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:44.697368 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8884833e-a6f3-4385-bf09-d29119f68672 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:44.697820 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8884833e-a6f3-4385-bf09-d29119f68672 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:44.698606 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8884833e-a6f3-4385-bf09-d29119f68672 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:44.699041 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8884833e-a6f3-4385-bf09-d29119f68672 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:44.727103 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-8884833e-a6f3-4385-bf09-d29119f68672 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039814 May 03 09:02:44.727640 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 494/830] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:02:44 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:02:45.706005 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-89dc4a89-7bc7-4a25-afb5-22af95e5dc72 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:45.706879 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-89dc4a89-7bc7-4a25-afb5-22af95e5dc72 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:45.715711 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-89dc4a89-7bc7-4a25-afb5-22af95e5dc72 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:45.716364 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-89dc4a89-7bc7-4a25-afb5-22af95e5dc72 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:45.717373 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-89dc4a89-7bc7-4a25-afb5-22af95e5dc72 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:45.717947 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-89dc4a89-7bc7-4a25-afb5-22af95e5dc72 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:45.782638 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-89dc4a89-7bc7-4a25-afb5-22af95e5dc72 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:02:45.790224 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-89dc4a89-7bc7-4a25-afb5-22af95e5dc72 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.090157 May 03 09:02:45.790787 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 495/831] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:02:45 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:02:45.795327 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-02e9917a-809f-4c63-9738-6631dc7eb546 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:45.796253 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-02e9917a-809f-4c63-9738-6631dc7eb546 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:45.801925 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-02e9917a-809f-4c63-9738-6631dc7eb546 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:45.802368 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-02e9917a-809f-4c63-9738-6631dc7eb546 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:45.803119 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-02e9917a-809f-4c63-9738-6631dc7eb546 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:45.803551 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-02e9917a-809f-4c63-9738-6631dc7eb546 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:45.831821 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-02e9917a-809f-4c63-9738-6631dc7eb546 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040056 May 03 09:02:45.832341 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 496/832] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:02:45 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:02:46.811128 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-013ad0c7-bf72-421c-adf2-57d09e5f469f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:46.812278 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-013ad0c7-bf72-421c-adf2-57d09e5f469f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:46.819752 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-013ad0c7-bf72-421c-adf2-57d09e5f469f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:46.820270 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-013ad0c7-bf72-421c-adf2-57d09e5f469f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:46.821034 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-013ad0c7-bf72-421c-adf2-57d09e5f469f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:46.821476 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-013ad0c7-bf72-421c-adf2-57d09e5f469f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:46.888646 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-013ad0c7-bf72-421c-adf2-57d09e5f469f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:02:46.896643 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-013ad0c7-bf72-421c-adf2-57d09e5f469f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.092226 May 03 09:02:46.897217 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 497/833] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:02:46 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:02:46.901755 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-0629104a-e016-4743-8440-849f1622ac7a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:46.902662 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-0629104a-e016-4743-8440-849f1622ac7a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:46.908746 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0629104a-e016-4743-8440-849f1622ac7a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:46.909195 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0629104a-e016-4743-8440-849f1622ac7a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:46.909964 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0629104a-e016-4743-8440-849f1622ac7a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:46.910419 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0629104a-e016-4743-8440-849f1622ac7a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:46.939826 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-0629104a-e016-4743-8440-849f1622ac7a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041615 May 03 09:02:46.940402 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 498/834] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:02:46 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:02:47.917618 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c27adb71-8ed0-49da-8307-6a05420dfe51 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:47.918676 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c27adb71-8ed0-49da-8307-6a05420dfe51 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:47.927232 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c27adb71-8ed0-49da-8307-6a05420dfe51 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:47.927685 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c27adb71-8ed0-49da-8307-6a05420dfe51 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:47.928514 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c27adb71-8ed0-49da-8307-6a05420dfe51 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:47.928953 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c27adb71-8ed0-49da-8307-6a05420dfe51 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:47.998317 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c27adb71-8ed0-49da-8307-6a05420dfe51 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:02:48.006331 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c27adb71-8ed0-49da-8307-6a05420dfe51 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.095274 May 03 09:02:48.006911 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 499/835] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:02:47 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:02:48.011390 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-463236ab-afe1-48f7-a656-b58ebca68bc2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:48.012334 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-463236ab-afe1-48f7-a656-b58ebca68bc2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:48.017949 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-463236ab-afe1-48f7-a656-b58ebca68bc2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:48.018400 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-463236ab-afe1-48f7-a656-b58ebca68bc2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:48.019230 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-463236ab-afe1-48f7-a656-b58ebca68bc2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:48.019607 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-463236ab-afe1-48f7-a656-b58ebca68bc2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:48.048633 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-463236ab-afe1-48f7-a656-b58ebca68bc2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040752 May 03 09:02:48.049176 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 500/836] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:02:48 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:02:49.026685 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-80989749-78b3-4732-9797-5adde2733330 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:49.027824 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-80989749-78b3-4732-9797-5adde2733330 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:49.036577 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-80989749-78b3-4732-9797-5adde2733330 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:49.037021 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-80989749-78b3-4732-9797-5adde2733330 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:49.037771 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-80989749-78b3-4732-9797-5adde2733330 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:49.038201 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-80989749-78b3-4732-9797-5adde2733330 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:49.111148 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-80989749-78b3-4732-9797-5adde2733330 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:02:49.123329 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-80989749-78b3-4732-9797-5adde2733330 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.103057 May 03 09:02:49.124143 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 501/837] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:02:49 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:02:49.128867 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-0c4894eb-762a-4cfa-b8c6-57c65216d25a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:49.129797 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-0c4894eb-762a-4cfa-b8c6-57c65216d25a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:49.136050 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0c4894eb-762a-4cfa-b8c6-57c65216d25a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:49.136513 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0c4894eb-762a-4cfa-b8c6-57c65216d25a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:49.137264 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0c4894eb-762a-4cfa-b8c6-57c65216d25a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:49.137690 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0c4894eb-762a-4cfa-b8c6-57c65216d25a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:49.166819 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-0c4894eb-762a-4cfa-b8c6-57c65216d25a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041704 May 03 09:02:49.167362 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 502/838] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:02:49 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:02:50.141209 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b70c681b-b8e2-4dc5-9961-6cceb51d9a5b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:50.141869 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b70c681b-b8e2-4dc5-9961-6cceb51d9a5b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:50.149057 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b70c681b-b8e2-4dc5-9961-6cceb51d9a5b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:50.149547 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b70c681b-b8e2-4dc5-9961-6cceb51d9a5b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:50.150363 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b70c681b-b8e2-4dc5-9961-6cceb51d9a5b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:50.150860 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b70c681b-b8e2-4dc5-9961-6cceb51d9a5b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:50.216141 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b70c681b-b8e2-4dc5-9961-6cceb51d9a5b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:02:50.227111 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b70c681b-b8e2-4dc5-9961-6cceb51d9a5b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.089716 May 03 09:02:50.227866 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 503/839] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:02:50 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:02:50.232590 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f90b4ead-9260-41e3-b418-b96375473ee1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:50.233495 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f90b4ead-9260-41e3-b418-b96375473ee1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:50.239595 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f90b4ead-9260-41e3-b418-b96375473ee1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:50.240088 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f90b4ead-9260-41e3-b418-b96375473ee1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:50.240852 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f90b4ead-9260-41e3-b418-b96375473ee1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:50.241289 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f90b4ead-9260-41e3-b418-b96375473ee1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:50.270713 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f90b4ead-9260-41e3-b418-b96375473ee1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041811 May 03 09:02:50.271264 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 504/840] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:02:50 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:02:51.244774 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-53f1e34c-d08b-49b3-a896-bfe2d543a744 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:51.245388 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-53f1e34c-d08b-49b3-a896-bfe2d543a744 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:51.252251 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-53f1e34c-d08b-49b3-a896-bfe2d543a744 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:51.252696 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-53f1e34c-d08b-49b3-a896-bfe2d543a744 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:51.253452 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-53f1e34c-d08b-49b3-a896-bfe2d543a744 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:51.253880 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-53f1e34c-d08b-49b3-a896-bfe2d543a744 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:51.315326 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-53f1e34c-d08b-49b3-a896-bfe2d543a744 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:02:51.324007 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-53f1e34c-d08b-49b3-a896-bfe2d543a744 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.083135 May 03 09:02:51.324581 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 505/841] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:02:51 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:02:51.329105 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-53e1587b-aaad-48ac-920e-8008a3e77f38 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:51.329999 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-53e1587b-aaad-48ac-920e-8008a3e77f38 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:51.336519 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-53e1587b-aaad-48ac-920e-8008a3e77f38 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:51.336956 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-53e1587b-aaad-48ac-920e-8008a3e77f38 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:51.337720 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-53e1587b-aaad-48ac-920e-8008a3e77f38 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:51.338177 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-53e1587b-aaad-48ac-920e-8008a3e77f38 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:51.370580 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-53e1587b-aaad-48ac-920e-8008a3e77f38 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044968 May 03 09:02:51.371134 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 506/842] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:02:51 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:02:52.344169 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-1b9bbfdf-62c7-4103-bb9f-b3d161d6c3a4 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:52.345177 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-1b9bbfdf-62c7-4103-bb9f-b3d161d6c3a4 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:52.353405 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1b9bbfdf-62c7-4103-bb9f-b3d161d6c3a4 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:52.354008 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1b9bbfdf-62c7-4103-bb9f-b3d161d6c3a4 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:52.355045 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1b9bbfdf-62c7-4103-bb9f-b3d161d6c3a4 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:52.355625 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1b9bbfdf-62c7-4103-bb9f-b3d161d6c3a4 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:52.421856 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-1b9bbfdf-62c7-4103-bb9f-b3d161d6c3a4 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:02:52.434055 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-1b9bbfdf-62c7-4103-bb9f-b3d161d6c3a4 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.094973 May 03 09:02:52.434982 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 507/843] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:02:52 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:02:52.442695 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f54d9d30-d514-49bb-9f1c-3e0c95a23375 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:52.444211 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f54d9d30-d514-49bb-9f1c-3e0c95a23375 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:52.450511 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f54d9d30-d514-49bb-9f1c-3e0c95a23375 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:52.450965 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f54d9d30-d514-49bb-9f1c-3e0c95a23375 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:52.451738 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f54d9d30-d514-49bb-9f1c-3e0c95a23375 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:52.452210 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f54d9d30-d514-49bb-9f1c-3e0c95a23375 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:52.481480 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f54d9d30-d514-49bb-9f1c-3e0c95a23375 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045127 May 03 09:02:52.481961 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 508/844] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:02:52 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:02:53.457569 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b1355712-aac6-422e-a628-e9af1feb271e tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:53.458302 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b1355712-aac6-422e-a628-e9af1feb271e tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:53.468962 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b1355712-aac6-422e-a628-e9af1feb271e tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:53.469444 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b1355712-aac6-422e-a628-e9af1feb271e tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:53.470540 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b1355712-aac6-422e-a628-e9af1feb271e tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:53.471328 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b1355712-aac6-422e-a628-e9af1feb271e tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:53.539121 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b1355712-aac6-422e-a628-e9af1feb271e tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:02:53.550485 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b1355712-aac6-422e-a628-e9af1feb271e tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.099121 May 03 09:02:53.551309 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 509/845] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:02:53 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:02:53.557071 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5b50a6c1-5563-4f67-97b1-a1be55b21408 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:53.557990 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5b50a6c1-5563-4f67-97b1-a1be55b21408 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:53.564133 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5b50a6c1-5563-4f67-97b1-a1be55b21408 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:53.564589 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5b50a6c1-5563-4f67-97b1-a1be55b21408 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:53.565351 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5b50a6c1-5563-4f67-97b1-a1be55b21408 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:53.565786 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5b50a6c1-5563-4f67-97b1-a1be55b21408 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:53.595997 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5b50a6c1-5563-4f67-97b1-a1be55b21408 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043478 May 03 09:02:53.596544 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 510/846] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:02:53 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:02:54.575332 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e7083283-a37e-4e54-ab1b-34afe831fb03 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:54.576399 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e7083283-a37e-4e54-ab1b-34afe831fb03 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:54.587247 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e7083283-a37e-4e54-ab1b-34afe831fb03 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:54.587690 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e7083283-a37e-4e54-ab1b-34afe831fb03 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:54.588481 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e7083283-a37e-4e54-ab1b-34afe831fb03 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:54.588905 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e7083283-a37e-4e54-ab1b-34afe831fb03 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:54.649816 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e7083283-a37e-4e54-ab1b-34afe831fb03 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:02:54.657555 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e7083283-a37e-4e54-ab1b-34afe831fb03 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.088847 May 03 09:02:54.658113 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 511/847] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:02:54 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:02:54.662608 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ae62c923-d9ee-4be1-a262-45935afc66b2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:54.663505 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ae62c923-d9ee-4be1-a262-45935afc66b2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:54.669710 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ae62c923-d9ee-4be1-a262-45935afc66b2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:54.670153 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ae62c923-d9ee-4be1-a262-45935afc66b2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:54.670927 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ae62c923-d9ee-4be1-a262-45935afc66b2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:54.671385 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ae62c923-d9ee-4be1-a262-45935afc66b2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:54.700672 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ae62c923-d9ee-4be1-a262-45935afc66b2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041569 May 03 09:02:54.701215 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 512/848] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:02:54 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:02:55.674698 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-2329fd47-da57-4ae3-b0c8-f8c6a70b7618 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:55.675398 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-2329fd47-da57-4ae3-b0c8-f8c6a70b7618 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:55.681480 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2329fd47-da57-4ae3-b0c8-f8c6a70b7618 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:55.681919 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2329fd47-da57-4ae3-b0c8-f8c6a70b7618 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:55.682670 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2329fd47-da57-4ae3-b0c8-f8c6a70b7618 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:55.683095 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2329fd47-da57-4ae3-b0c8-f8c6a70b7618 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:55.745725 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-2329fd47-da57-4ae3-b0c8-f8c6a70b7618 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:02:55.753317 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-2329fd47-da57-4ae3-b0c8-f8c6a70b7618 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.082807 May 03 09:02:55.762327 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 513/849] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:02:55 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:02:55.762327 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-58c57984-ec6c-4852-ae36-07492e4206e8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:55.762327 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-58c57984-ec6c-4852-ae36-07492e4206e8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:55.765137 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-58c57984-ec6c-4852-ae36-07492e4206e8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:55.765578 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-58c57984-ec6c-4852-ae36-07492e4206e8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:55.766339 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-58c57984-ec6c-4852-ae36-07492e4206e8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:55.766769 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-58c57984-ec6c-4852-ae36-07492e4206e8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:55.799746 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-58c57984-ec6c-4852-ae36-07492e4206e8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044830 May 03 09:02:55.800328 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 514/850] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:02:55 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:02:56.773756 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3183af52-3066-45d2-bc7a-db7da194e5bd tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:56.774868 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-3183af52-3066-45d2-bc7a-db7da194e5bd tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:56.781700 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3183af52-3066-45d2-bc7a-db7da194e5bd tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:56.782151 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3183af52-3066-45d2-bc7a-db7da194e5bd tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:56.782926 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3183af52-3066-45d2-bc7a-db7da194e5bd tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:56.783353 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3183af52-3066-45d2-bc7a-db7da194e5bd tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:56.847069 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-3183af52-3066-45d2-bc7a-db7da194e5bd tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:02:56.855178 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-3183af52-3066-45d2-bc7a-db7da194e5bd tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.087983 May 03 09:02:56.855744 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 515/851] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:02:56 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:02:56.860352 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f8879b96-d89f-4345-a1ff-efeb6e1162a1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:56.861303 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f8879b96-d89f-4345-a1ff-efeb6e1162a1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:56.866830 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f8879b96-d89f-4345-a1ff-efeb6e1162a1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:56.867286 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f8879b96-d89f-4345-a1ff-efeb6e1162a1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:56.868075 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f8879b96-d89f-4345-a1ff-efeb6e1162a1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:56.868514 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f8879b96-d89f-4345-a1ff-efeb6e1162a1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:56.897321 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f8879b96-d89f-4345-a1ff-efeb6e1162a1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040549 May 03 09:02:56.897860 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 516/852] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:02:56 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:02:57.876381 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3bdd9d22-3cac-4809-bbbf-8685f6a3c697 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:57.877336 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-3bdd9d22-3cac-4809-bbbf-8685f6a3c697 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:57.887420 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3bdd9d22-3cac-4809-bbbf-8685f6a3c697 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:57.887899 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3bdd9d22-3cac-4809-bbbf-8685f6a3c697 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:57.888659 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3bdd9d22-3cac-4809-bbbf-8685f6a3c697 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:57.889086 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3bdd9d22-3cac-4809-bbbf-8685f6a3c697 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:57.958708 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-3bdd9d22-3cac-4809-bbbf-8685f6a3c697 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:02:57.966726 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-3bdd9d22-3cac-4809-bbbf-8685f6a3c697 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.097003 May 03 09:02:57.967285 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 517/853] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:02:57 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:02:57.971756 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-77410c0b-caa6-48a3-aac8-2c2695377c21 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:57.972677 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-77410c0b-caa6-48a3-aac8-2c2695377c21 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:57.978107 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-77410c0b-caa6-48a3-aac8-2c2695377c21 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:57.978549 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-77410c0b-caa6-48a3-aac8-2c2695377c21 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:57.979298 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-77410c0b-caa6-48a3-aac8-2c2695377c21 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:57.979730 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-77410c0b-caa6-48a3-aac8-2c2695377c21 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:58.008488 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-77410c0b-caa6-48a3-aac8-2c2695377c21 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040228 May 03 09:02:58.009023 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 518/854] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:02:57 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:02:58.987644 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-14613992-00c7-4caf-86fd-85d5095ed22f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:58.988754 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-14613992-00c7-4caf-86fd-85d5095ed22f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:58.998575 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-14613992-00c7-4caf-86fd-85d5095ed22f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:58.999022 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-14613992-00c7-4caf-86fd-85d5095ed22f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:58.999809 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-14613992-00c7-4caf-86fd-85d5095ed22f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:59.000239 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-14613992-00c7-4caf-86fd-85d5095ed22f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:59.060833 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-14613992-00c7-4caf-86fd-85d5095ed22f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:02:59.068764 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-14613992-00c7-4caf-86fd-85d5095ed22f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.087708 May 03 09:02:59.069370 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 519/855] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:02:58 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:02:59.073888 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-487d16dd-aec1-4859-a0a7-2e1afee54585 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:02:59.074788 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-487d16dd-aec1-4859-a0a7-2e1afee54585 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:02:59.080611 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-487d16dd-aec1-4859-a0a7-2e1afee54585 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:59.081059 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-487d16dd-aec1-4859-a0a7-2e1afee54585 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:59.081821 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-487d16dd-aec1-4859-a0a7-2e1afee54585 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:02:59.082259 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-487d16dd-aec1-4859-a0a7-2e1afee54585 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:02:59.112864 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-487d16dd-aec1-4859-a0a7-2e1afee54585 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042488 May 03 09:02:59.113367 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 520/856] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:02:59 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:03:00.090398 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-cf9caf06-eded-4be6-8d84-a99c1eada695 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:03:00.091393 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-cf9caf06-eded-4be6-8d84-a99c1eada695 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:03:00.102002 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cf9caf06-eded-4be6-8d84-a99c1eada695 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:03:00.102796 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cf9caf06-eded-4be6-8d84-a99c1eada695 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:03:00.104143 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cf9caf06-eded-4be6-8d84-a99c1eada695 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:03:00.104870 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cf9caf06-eded-4be6-8d84-a99c1eada695 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:03:00.173281 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-cf9caf06-eded-4be6-8d84-a99c1eada695 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:03:00.180913 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-cf9caf06-eded-4be6-8d84-a99c1eada695 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.097671 May 03 09:03:00.181499 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 521/857] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:03:00 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:03:00.186065 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-7eeaff7b-2b33-478c-a006-67b12c111079 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:03:00.187020 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-7eeaff7b-2b33-478c-a006-67b12c111079 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:03:00.193036 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7eeaff7b-2b33-478c-a006-67b12c111079 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:03:00.193486 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7eeaff7b-2b33-478c-a006-67b12c111079 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:03:00.194287 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7eeaff7b-2b33-478c-a006-67b12c111079 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:03:00.194721 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7eeaff7b-2b33-478c-a006-67b12c111079 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:03:00.226139 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-7eeaff7b-2b33-478c-a006-67b12c111079 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043638 May 03 09:03:00.226698 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 522/858] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:03:00 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:03:01.202122 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b83ec986-be27-4aa2-aa67-50cb4ed09bf1 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:03:01.203182 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b83ec986-be27-4aa2-aa67-50cb4ed09bf1 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:03:01.211000 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b83ec986-be27-4aa2-aa67-50cb4ed09bf1 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:03:01.211571 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b83ec986-be27-4aa2-aa67-50cb4ed09bf1 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:03:01.212255 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b83ec986-be27-4aa2-aa67-50cb4ed09bf1 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:03:01.212686 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b83ec986-be27-4aa2-aa67-50cb4ed09bf1 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:03:01.273241 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b83ec986-be27-4aa2-aa67-50cb4ed09bf1 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:03:01.280655 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b83ec986-be27-4aa2-aa67-50cb4ed09bf1 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.085112 May 03 09:03:01.281212 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 523/859] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:03:01 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:03:01.285780 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-8f86417a-289e-4eb7-ba87-f277d89b7cfe tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:03:01.286631 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-8f86417a-289e-4eb7-ba87-f277d89b7cfe tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:03:01.292312 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8f86417a-289e-4eb7-ba87-f277d89b7cfe tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:03:01.292760 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8f86417a-289e-4eb7-ba87-f277d89b7cfe tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:03:01.293513 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8f86417a-289e-4eb7-ba87-f277d89b7cfe tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:03:01.293955 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8f86417a-289e-4eb7-ba87-f277d89b7cfe tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:03:01.323172 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-8f86417a-289e-4eb7-ba87-f277d89b7cfe tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040935 May 03 09:03:01.323727 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 524/860] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:03:01 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:03:02.303935 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-2a1cf735-b2e1-448b-9efc-c3fc7c394c0e tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:03:02.306059 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-2a1cf735-b2e1-448b-9efc-c3fc7c394c0e tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:03:02.319136 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2a1cf735-b2e1-448b-9efc-c3fc7c394c0e tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:03:02.319659 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2a1cf735-b2e1-448b-9efc-c3fc7c394c0e tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:03:02.320658 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2a1cf735-b2e1-448b-9efc-c3fc7c394c0e tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:03:02.321097 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2a1cf735-b2e1-448b-9efc-c3fc7c394c0e tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:03:02.390052 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-2a1cf735-b2e1-448b-9efc-c3fc7c394c0e tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:03:02.398574 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-2a1cf735-b2e1-448b-9efc-c3fc7c394c0e tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.103704 May 03 09:03:02.399170 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 525/861] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:03:02 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:03:02.403878 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-6c51bd8c-058c-4965-8d67-1ca38c58a816 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:03:02.404790 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-6c51bd8c-058c-4965-8d67-1ca38c58a816 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:03:02.410905 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6c51bd8c-058c-4965-8d67-1ca38c58a816 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:03:02.411345 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6c51bd8c-058c-4965-8d67-1ca38c58a816 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:03:02.412149 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6c51bd8c-058c-4965-8d67-1ca38c58a816 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:03:02.412581 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6c51bd8c-058c-4965-8d67-1ca38c58a816 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:03:02.440734 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-6c51bd8c-058c-4965-8d67-1ca38c58a816 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040581 May 03 09:03:02.441294 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 526/862] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:03:02 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:03:02.872470 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-8a154c31-4ac9-42c7-9b2c-70415ed2f8ee tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:03:02.873357 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-8a154c31-4ac9-42c7-9b2c-70415ed2f8ee tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:03:02.883599 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8a154c31-4ac9-42c7-9b2c-70415ed2f8ee tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:03:02.884401 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8a154c31-4ac9-42c7-9b2c-70415ed2f8ee tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:03:02.885680 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8a154c31-4ac9-42c7-9b2c-70415ed2f8ee tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:03:02.886423 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8a154c31-4ac9-42c7-9b2c-70415ed2f8ee tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:04:03.083341 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-a4bd2263-5b53-4212-a2f1-832ad9288bb9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a25ad784-a4c4-4505-9c5f-b4e6d2753559) May 03 09:04:03.084004 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a4bd2263-5b53-4212-a2f1-832ad9288bb9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a25ad784-a4c4-4505-9c5f-b4e6d2753559) {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 09:04:03.084852 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a4bd2263-5b53-4212-a2f1-832ad9288bb9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "DELETE /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments/b0e90a13-d5bd-4175-8cb5-6962b4700c63" status: 400 len: 269 microversion: 2.1 time: 120.183381 May 03 09:04:03.085437 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 337/863] 10.222.0.11 () {58 vars in 1415 bytes} [Tue May 3 09:02:02 2022] DELETE /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments/b0e90a13-d5bd-4175-8cb5-6962b4700c63 => generated 269 bytes in 120184 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 03 09:04:03.091720 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a4d4a8e7-3fe1-4cc1-b088-09a69a95920c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:04:03.092351 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a4d4a8e7-3fe1-4cc1-b088-09a69a95920c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:04:03.098407 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a4d4a8e7-3fe1-4cc1-b088-09a69a95920c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:04:03.098856 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a4d4a8e7-3fe1-4cc1-b088-09a69a95920c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:04:03.099612 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a4d4a8e7-3fe1-4cc1-b088-09a69a95920c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:04:03.100081 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a4d4a8e7-3fe1-4cc1-b088-09a69a95920c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:04:03.161825 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a4d4a8e7-3fe1-4cc1-b088-09a69a95920c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:04:03.169272 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a4d4a8e7-3fe1-4cc1-b088-09a69a95920c tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.082192 May 03 09:04:03.169813 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 338/864] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:04:03 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:04:03.187664 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.objects.instance [None req-8a154c31-4ac9-42c7-9b2c-70415ed2f8ee tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lazy-loading 'services' on Instance uuid 512c1f04-399e-4647-8bfe-f2c295397df2 {{(pid=123391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 03 09:04:03.256051 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-86887179-2cd8-469c-a899-c3b45852a973 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:04:03.257030 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-86887179-2cd8-469c-a899-c3b45852a973 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:04:03.262905 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-86887179-2cd8-469c-a899-c3b45852a973 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:04:03.263352 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-86887179-2cd8-469c-a899-c3b45852a973 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:04:03.264150 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-86887179-2cd8-469c-a899-c3b45852a973 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:04:03.264584 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-86887179-2cd8-469c-a899-c3b45852a973 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:04:03.292919 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-86887179-2cd8-469c-a899-c3b45852a973 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.122122 May 03 09:04:03.293476 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 339/865] 10.222.0.11 () {60 vars in 1342 bytes} [Tue May 3 09:04:03 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:04:03.297991 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b2e01b5d-aefd-4306-9344-f834649e8057 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:04:03.298466 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b2e01b5d-aefd-4306-9344-f834649e8057 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:04:03.304034 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b2e01b5d-aefd-4306-9344-f834649e8057 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:04:03.304488 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b2e01b5d-aefd-4306-9344-f834649e8057 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:04:03.305242 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b2e01b5d-aefd-4306-9344-f834649e8057 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:04:03.305672 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b2e01b5d-aefd-4306-9344-f834649e8057 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:04:15.498647 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 09:04:15.499559 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: Tue May 3 09:04:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments/b0e90a13-d5bd-4175-8cb5-6962b4700c63 (ip 10.222.0.11) !!! May 03 09:04:24.596347 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.wsgi [None req-8a154c31-4ac9-42c7-9b2c-70415ed2f8ee tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b3a8455b-5c18-4d81-aabe-384668bf2fb4) May 03 09:04:24.596964 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-8a154c31-4ac9-42c7-9b2c-70415ed2f8ee tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b3a8455b-5c18-4d81-aabe-384668bf2fb4) {{(pid=123391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 09:04:24.597940 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-8a154c31-4ac9-42c7-9b2c-70415ed2f8ee tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "DELETE /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments/b0e90a13-d5bd-4175-8cb5-6962b4700c63" status: 400 len: 269 microversion: 2.1 time: 81.732557 May 03 09:04:24.598720 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 527/866] 10.222.0.11 () {58 vars in 1415 bytes} [Tue May 3 09:03:02 2022] DELETE /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments/b0e90a13-d5bd-4175-8cb5-6962b4700c63 => generated 269 bytes in 81734 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 03 09:04:24.604280 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-affc5b80-cf5b-422b-aa17-253232022dc4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:04:24.604765 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-affc5b80-cf5b-422b-aa17-253232022dc4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:04:24.611032 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-affc5b80-cf5b-422b-aa17-253232022dc4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:04:24.611477 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-affc5b80-cf5b-422b-aa17-253232022dc4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:04:24.612274 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-affc5b80-cf5b-422b-aa17-253232022dc4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:04:24.612704 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-affc5b80-cf5b-422b-aa17-253232022dc4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:04:24.682922 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.objects.instance [None req-b2e01b5d-aefd-4306-9344-f834649e8057 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lazy-loading 'services' on Instance uuid 512c1f04-399e-4647-8bfe-f2c295397df2 {{(pid=123392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 03 09:05:07.143530 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 09:05:07.144605 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: Tue May 3 09:05:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5/os-volume_attachments/e63b7581-76a0-494d-a723-2c1f41193e62 (ip 10.222.0.11) !!! May 03 09:05:18.376380 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 09:05:18.377565 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: Tue May 3 09:05:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5/os-volume_attachments/e63b7581-76a0-494d-a723-2c1f41193e62 (ip 10.222.0.11) !!! May 03 09:05:23.570587 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 09:05:23.571379 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: Tue May 3 09:05:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments/b0e90a13-d5bd-4175-8cb5-6962b4700c63 (ip 10.222.0.11) !!! May 03 09:05:35.781451 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 09:05:35.782458 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: Tue May 3 09:05:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments/b0e90a13-d5bd-4175-8cb5-6962b4700c63 (ip 10.222.0.11) !!! May 03 09:06:03.488505 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.objects.instance [None req-affc5b80-cf5b-422b-aa17-253232022dc4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lazy-loading 'services' on Instance uuid 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 {{(pid=123391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 03 09:06:03.622576 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-b2e01b5d-aefd-4306-9344-f834649e8057 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b8d4cb5b-207a-443e-9dbf-0a217f08132d) May 03 09:06:03.623253 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b2e01b5d-aefd-4306-9344-f834649e8057 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b8d4cb5b-207a-443e-9dbf-0a217f08132d) {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 09:06:03.624279 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b2e01b5d-aefd-4306-9344-f834649e8057 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "DELETE /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments/b0e90a13-d5bd-4175-8cb5-6962b4700c63" status: 400 len: 269 microversion: 2.1 time: 120.329753 May 03 09:06:03.625162 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 340/867] 10.222.0.11 () {58 vars in 1415 bytes} [Tue May 3 09:04:03 2022] DELETE /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments/b0e90a13-d5bd-4175-8cb5-6962b4700c63 => generated 269 bytes in 120331 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 03 09:06:03.695663 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f97a9761-1f74-43cb-8f96-d50d0f77001b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:06:03.696303 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f97a9761-1f74-43cb-8f96-d50d0f77001b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:06:03.702482 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f97a9761-1f74-43cb-8f96-d50d0f77001b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:06:03.702926 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f97a9761-1f74-43cb-8f96-d50d0f77001b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:06:03.703684 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f97a9761-1f74-43cb-8f96-d50d0f77001b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:06:03.704204 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f97a9761-1f74-43cb-8f96-d50d0f77001b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:06:03.772269 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f97a9761-1f74-43cb-8f96-d50d0f77001b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:06:03.780575 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f97a9761-1f74-43cb-8f96-d50d0f77001b tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.154429 May 03 09:06:03.781140 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 341/868] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:06:03 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:06:03.786129 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5e5fdbfd-1b16-4ec9-8a59-8899b3b84de5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:06:03.787859 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5e5fdbfd-1b16-4ec9-8a59-8899b3b84de5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:06:03.796620 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5e5fdbfd-1b16-4ec9-8a59-8899b3b84de5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:06:03.797066 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5e5fdbfd-1b16-4ec9-8a59-8899b3b84de5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:06:03.797839 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5e5fdbfd-1b16-4ec9-8a59-8899b3b84de5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:06:03.798282 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5e5fdbfd-1b16-4ec9-8a59-8899b3b84de5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:06:03.889993 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5e5fdbfd-1b16-4ec9-8a59-8899b3b84de5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "POST /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/action" status: 200 len: 38216 microversion: 2.20 time: 0.107599 May 03 09:06:03.890695 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 342/869] 10.222.0.11 () {62 vars in 1318 bytes} [Tue May 3 09:06:03 2022] POST /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f/action => generated 38216 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 03 09:06:03.896147 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-49e1818a-5b26-4727-bee9-e5977df7bd27 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:06:03.897134 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-49e1818a-5b26-4727-bee9-e5977df7bd27 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:06:03.903934 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-49e1818a-5b26-4727-bee9-e5977df7bd27 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:06:03.904401 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-49e1818a-5b26-4727-bee9-e5977df7bd27 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:06:03.905135 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-49e1818a-5b26-4727-bee9-e5977df7bd27 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:06:03.905567 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-49e1818a-5b26-4727-bee9-e5977df7bd27 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:06:03.934528 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-49e1818a-5b26-4727-bee9-e5977df7bd27 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042690 May 03 09:06:03.935059 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 343/870] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:06:03 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:06:03.939350 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-885e7226-9f11-44af-97b3-12e094b2f8af tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:06:03.939809 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-885e7226-9f11-44af-97b3-12e094b2f8af tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:06:03.945771 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-885e7226-9f11-44af-97b3-12e094b2f8af tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:06:03.946207 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-885e7226-9f11-44af-97b3-12e094b2f8af tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:06:03.946946 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-885e7226-9f11-44af-97b3-12e094b2f8af tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:06:03.947372 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-885e7226-9f11-44af-97b3-12e094b2f8af tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:06:24.764642 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-affc5b80-cf5b-422b-aa17-253232022dc4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "DELETE /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5/os-volume_attachments/e63b7581-76a0-494d-a723-2c1f41193e62" status: 202 len: 0 microversion: 2.1 time: 120.164680 May 03 09:06:24.765414 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 528/871] 10.222.0.11 () {58 vars in 1415 bytes} [Tue May 3 09:04:24 2022] DELETE /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5/os-volume_attachments/e63b7581-76a0-494d-a723-2c1f41193e62 => generated 0 bytes in 120166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 09:06:24.771609 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c98ea0e1-24b3-4f17-957d-878ececd815e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:06:24.772215 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c98ea0e1-24b3-4f17-957d-878ececd815e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:06:24.778294 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c98ea0e1-24b3-4f17-957d-878ececd815e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:06:24.778737 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c98ea0e1-24b3-4f17-957d-878ececd815e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:06:24.779502 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c98ea0e1-24b3-4f17-957d-878ececd815e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:06:24.780171 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c98ea0e1-24b3-4f17-957d-878ececd815e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:06:24.813946 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.objects.instance [None req-885e7226-9f11-44af-97b3-12e094b2f8af tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lazy-loading 'services' on Instance uuid 512c1f04-399e-4647-8bfe-f2c295397df2 {{(pid=123392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 03 09:08:03.802357 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.objects.instance [None req-c98ea0e1-24b3-4f17-957d-878ececd815e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lazy-loading 'services' on Instance uuid 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 {{(pid=123391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 03 09:08:03.828811 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-885e7226-9f11-44af-97b3-12e094b2f8af tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a4cee6bf-ef54-4a83-b1e6-c02bb6a0b3ba) May 03 09:08:03.830010 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-885e7226-9f11-44af-97b3-12e094b2f8af tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a4cee6bf-ef54-4a83-b1e6-c02bb6a0b3ba) {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 09:08:03.830917 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-885e7226-9f11-44af-97b3-12e094b2f8af tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "DELETE /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments/b0e90a13-d5bd-4175-8cb5-6962b4700c63" status: 400 len: 269 microversion: 2.1 time: 119.895023 May 03 09:08:03.831648 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 344/872] 10.222.0.11 () {58 vars in 1415 bytes} [Tue May 3 09:06:03 2022] DELETE /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments/b0e90a13-d5bd-4175-8cb5-6962b4700c63 => generated 269 bytes in 119896 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 03 09:08:03.836744 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-71d96ebb-f967-4aed-aa35-339894201dd9 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:03.837357 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-71d96ebb-f967-4aed-aa35-339894201dd9 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:03.844062 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-71d96ebb-f967-4aed-aa35-339894201dd9 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:03.844515 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-71d96ebb-f967-4aed-aa35-339894201dd9 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:03.845642 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-71d96ebb-f967-4aed-aa35-339894201dd9 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:03.846067 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-71d96ebb-f967-4aed-aa35-339894201dd9 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:03.915044 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-71d96ebb-f967-4aed-aa35-339894201dd9 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:08:03.916776 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-71d96ebb-f967-4aed-aa35-339894201dd9 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.084284 May 03 09:08:03.917555 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 345/873] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:08:03 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:08:03.921916 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2296a931-3396-4cd7-a4f6-a7fe57d5cfdd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:03.922839 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-2296a931-3396-4cd7-a4f6-a7fe57d5cfdd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:03.928827 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2296a931-3396-4cd7-a4f6-a7fe57d5cfdd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:03.929275 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2296a931-3396-4cd7-a4f6-a7fe57d5cfdd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:03.930061 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2296a931-3396-4cd7-a4f6-a7fe57d5cfdd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:03.930487 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2296a931-3396-4cd7-a4f6-a7fe57d5cfdd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:03.943531 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.wsgi [None req-c98ea0e1-24b3-4f17-957d-878ececd815e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b135d282-a888-497c-9538-7f0be6abab6d) May 03 09:08:03.944173 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c98ea0e1-24b3-4f17-957d-878ececd815e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b135d282-a888-497c-9538-7f0be6abab6d) {{(pid=123391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 09:08:03.945023 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c98ea0e1-24b3-4f17-957d-878ececd815e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "DELETE /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5/os-volume_attachments/e63b7581-76a0-494d-a723-2c1f41193e62" status: 400 len: 269 microversion: 2.1 time: 99.178265 May 03 09:08:03.945603 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 529/874] 10.222.0.11 () {58 vars in 1415 bytes} [Tue May 3 09:06:24 2022] DELETE /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5/os-volume_attachments/e63b7581-76a0-494d-a723-2c1f41193e62 => generated 269 bytes in 99179 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 03 09:08:03.951655 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-2779a8ba-7923-49e8-86b3-3f7db5edf731 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:03.952505 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-2779a8ba-7923-49e8-86b3-3f7db5edf731 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:03.958996 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2779a8ba-7923-49e8-86b3-3f7db5edf731 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:03.959424 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2779a8ba-7923-49e8-86b3-3f7db5edf731 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:03.960245 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2779a8ba-7923-49e8-86b3-3f7db5edf731 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:03.960894 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2779a8ba-7923-49e8-86b3-3f7db5edf731 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:03.962883 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-2296a931-3396-4cd7-a4f6-a7fe57d5cfdd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044449 May 03 09:08:03.963487 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 346/875] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:03 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:03.968628 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-388a6631-4f95-4922-a2d2-22cc85f9f11d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:03.969097 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-388a6631-4f95-4922-a2d2-22cc85f9f11d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:03.976040 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-388a6631-4f95-4922-a2d2-22cc85f9f11d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:03.976490 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-388a6631-4f95-4922-a2d2-22cc85f9f11d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:03.977283 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-388a6631-4f95-4922-a2d2-22cc85f9f11d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:03.977713 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-388a6631-4f95-4922-a2d2-22cc85f9f11d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:04.051121 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.objects.instance [None req-2779a8ba-7923-49e8-86b3-3f7db5edf731 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lazy-loading 'services' on Instance uuid 512c1f04-399e-4647-8bfe-f2c295397df2 {{(pid=123391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 03 09:08:04.092595 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.objects.instance [None req-388a6631-4f95-4922-a2d2-22cc85f9f11d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lazy-loading 'services' on Instance uuid 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 {{(pid=123392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 03 09:08:04.119708 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.wsgi [None req-2779a8ba-7923-49e8-86b3-3f7db5edf731 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8cb8787a-8d98-45dc-9b6f-7e7f24000844) May 03 09:08:04.120409 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-2779a8ba-7923-49e8-86b3-3f7db5edf731 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8cb8787a-8d98-45dc-9b6f-7e7f24000844) {{(pid=123391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 09:08:04.121340 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-2779a8ba-7923-49e8-86b3-3f7db5edf731 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "DELETE /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments/b0e90a13-d5bd-4175-8cb5-6962b4700c63" status: 400 len: 269 microversion: 2.1 time: 0.174673 May 03 09:08:04.121952 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 530/876] 10.222.0.11 () {58 vars in 1415 bytes} [Tue May 3 09:08:03 2022] DELETE /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments/b0e90a13-d5bd-4175-8cb5-6962b4700c63 => generated 269 bytes in 176 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 03 09:08:04.126640 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-77ae9cd7-2710-4f5e-871e-8ab1694ed98f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:04.127298 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-77ae9cd7-2710-4f5e-871e-8ab1694ed98f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:04.133109 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-77ae9cd7-2710-4f5e-871e-8ab1694ed98f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:04.133552 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-77ae9cd7-2710-4f5e-871e-8ab1694ed98f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:04.134308 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-77ae9cd7-2710-4f5e-871e-8ab1694ed98f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:04.134733 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-77ae9cd7-2710-4f5e-871e-8ab1694ed98f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:04.154042 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-388a6631-4f95-4922-a2d2-22cc85f9f11d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a77a8a30-cf98-425c-ae52-eec0b091db96) May 03 09:08:04.154689 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-388a6631-4f95-4922-a2d2-22cc85f9f11d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a77a8a30-cf98-425c-ae52-eec0b091db96) {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 09:08:04.155564 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-388a6631-4f95-4922-a2d2-22cc85f9f11d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "DELETE /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5/os-volume_attachments/e63b7581-76a0-494d-a723-2c1f41193e62" status: 400 len: 269 microversion: 2.1 time: 0.191097 May 03 09:08:04.156141 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 347/877] 10.222.0.11 () {58 vars in 1415 bytes} [Tue May 3 09:08:03 2022] DELETE /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5/os-volume_attachments/e63b7581-76a0-494d-a723-2c1f41193e62 => generated 269 bytes in 192 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 03 09:08:04.166384 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a5e73828-8444-4c15-b911-a4eba74c6038 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:04.175462 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a5e73828-8444-4c15-b911-a4eba74c6038 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:04.182691 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a5e73828-8444-4c15-b911-a4eba74c6038 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:04.183154 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a5e73828-8444-4c15-b911-a4eba74c6038 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:04.183988 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a5e73828-8444-4c15-b911-a4eba74c6038 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:04.184426 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a5e73828-8444-4c15-b911-a4eba74c6038 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:04.226682 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a5e73828-8444-4c15-b911-a4eba74c6038 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069427 May 03 09:08:04.227014 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-77ae9cd7-2710-4f5e-871e-8ab1694ed98f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:08:04.227422 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 348/878] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:04 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:04.232444 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4df28c12-ec9b-43bb-8af7-f9ac9cb67940 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:04.232937 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4df28c12-ec9b-43bb-8af7-f9ac9cb67940 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:04.234844 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-77ae9cd7-2710-4f5e-871e-8ab1694ed98f tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1226 microversion: 2.1 time: 0.111748 May 03 09:08:04.235402 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 531/879] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:08:04 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1226 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:08:04.238675 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4df28c12-ec9b-43bb-8af7-f9ac9cb67940 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:04.239121 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4df28c12-ec9b-43bb-8af7-f9ac9cb67940 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:04.239908 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4df28c12-ec9b-43bb-8af7-f9ac9cb67940 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:04.240076 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d921bbb0-605c-48de-9506-59ad52c10eb4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:04.240342 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4df28c12-ec9b-43bb-8af7-f9ac9cb67940 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:04.240564 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d921bbb0-605c-48de-9506-59ad52c10eb4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:04.246123 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d921bbb0-605c-48de-9506-59ad52c10eb4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:04.246616 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d921bbb0-605c-48de-9506-59ad52c10eb4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:04.247349 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d921bbb0-605c-48de-9506-59ad52c10eb4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:04.247865 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d921bbb0-605c-48de-9506-59ad52c10eb4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:04.317031 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.objects.instance [None req-4df28c12-ec9b-43bb-8af7-f9ac9cb67940 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lazy-loading 'services' on Instance uuid 512c1f04-399e-4647-8bfe-f2c295397df2 {{(pid=123392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 03 09:08:04.357359 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.objects.instance [None req-d921bbb0-605c-48de-9506-59ad52c10eb4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lazy-loading 'services' on Instance uuid 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 {{(pid=123391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 03 09:08:24.915580 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-4df28c12-ec9b-43bb-8af7-f9ac9cb67940 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-988fdc73-aa52-43ee-bdf8-de1bc6dc0c8e) May 03 09:08:24.916442 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4df28c12-ec9b-43bb-8af7-f9ac9cb67940 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-988fdc73-aa52-43ee-bdf8-de1bc6dc0c8e) {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 09:08:24.917620 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-4df28c12-ec9b-43bb-8af7-f9ac9cb67940 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "DELETE /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments/b0e90a13-d5bd-4175-8cb5-6962b4700c63" status: 400 len: 269 microversion: 2.1 time: 20.689054 May 03 09:08:24.918488 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 349/880] 10.222.0.11 () {58 vars in 1415 bytes} [Tue May 3 09:08:04 2022] DELETE /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments/b0e90a13-d5bd-4175-8cb5-6962b4700c63 => generated 269 bytes in 20690 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 03 09:08:24.925444 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5a080a9d-8658-4cdc-9368-ead58beea2a0 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:24.927246 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5a080a9d-8658-4cdc-9368-ead58beea2a0 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:24.935012 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5a080a9d-8658-4cdc-9368-ead58beea2a0 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:24.935684 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5a080a9d-8658-4cdc-9368-ead58beea2a0 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:24.936530 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5a080a9d-8658-4cdc-9368-ead58beea2a0 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:24.936982 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5a080a9d-8658-4cdc-9368-ead58beea2a0 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:24.951422 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.wsgi [None req-d921bbb0-605c-48de-9506-59ad52c10eb4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6c550f9e-d764-4bf0-b74f-eb9a33e34fe9) May 03 09:08:24.952057 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d921bbb0-605c-48de-9506-59ad52c10eb4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6c550f9e-d764-4bf0-b74f-eb9a33e34fe9) {{(pid=123391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 09:08:24.953112 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d921bbb0-605c-48de-9506-59ad52c10eb4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "DELETE /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5/os-volume_attachments/e63b7581-76a0-494d-a723-2c1f41193e62" status: 400 len: 269 microversion: 2.1 time: 20.716471 May 03 09:08:24.953670 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 532/881] 10.222.0.11 () {58 vars in 1415 bytes} [Tue May 3 09:08:04 2022] DELETE /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5/os-volume_attachments/e63b7581-76a0-494d-a723-2c1f41193e62 => generated 269 bytes in 20718 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 03 09:08:24.959361 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-93e2b018-45e9-40b8-982e-26897da11762 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:24.960398 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-93e2b018-45e9-40b8-982e-26897da11762 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:24.971063 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5a080a9d-8658-4cdc-9368-ead58beea2a0 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:24.971490 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5a080a9d-8658-4cdc-9368-ead58beea2a0 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:24.972174 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.objects.instance [None req-5a080a9d-8658-4cdc-9368-ead58beea2a0 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lazy-loading 'fault' on Instance uuid a53f83a8-c719-47a0-969f-5b1305f839df {{(pid=123392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 03 09:08:24.976592 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-93e2b018-45e9-40b8-982e-26897da11762 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:24.977030 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-93e2b018-45e9-40b8-982e-26897da11762 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:24.978009 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-93e2b018-45e9-40b8-982e-26897da11762 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:24.978443 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-93e2b018-45e9-40b8-982e-26897da11762 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:25.010977 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-93e2b018-45e9-40b8-982e-26897da11762 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055733 May 03 09:08:25.011657 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 533/882] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:24 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:25.016398 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-64e6f780-fdf7-4dbc-b9a6-b2711dd4c8fb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:25.016894 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-64e6f780-fdf7-4dbc-b9a6-b2711dd4c8fb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:25.021212 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5a080a9d-8658-4cdc-9368-ead58beea2a0 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:08:25.022582 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-64e6f780-fdf7-4dbc-b9a6-b2711dd4c8fb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:25.023040 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-64e6f780-fdf7-4dbc-b9a6-b2711dd4c8fb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:25.023832 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-64e6f780-fdf7-4dbc-b9a6-b2711dd4c8fb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:25.024265 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-64e6f780-fdf7-4dbc-b9a6-b2711dd4c8fb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:25.028677 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5a080a9d-8658-4cdc-9368-ead58beea2a0 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1231 microversion: 2.1 time: 0.108966 May 03 09:08:25.029258 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 350/883] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:08:24 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1231 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:08:25.034115 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d77ed1c8-cd43-4a7a-bcd3-b3e071fa63cf tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:25.034566 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d77ed1c8-cd43-4a7a-bcd3-b3e071fa63cf tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:25.040088 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d77ed1c8-cd43-4a7a-bcd3-b3e071fa63cf tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:25.040534 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d77ed1c8-cd43-4a7a-bcd3-b3e071fa63cf tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:25.041296 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d77ed1c8-cd43-4a7a-bcd3-b3e071fa63cf tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:25.041736 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d77ed1c8-cd43-4a7a-bcd3-b3e071fa63cf tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:25.101492 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.objects.instance [None req-64e6f780-fdf7-4dbc-b9a6-b2711dd4c8fb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lazy-loading 'services' on Instance uuid 512c1f04-399e-4647-8bfe-f2c295397df2 {{(pid=123391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 03 09:08:25.140711 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.objects.instance [None req-d77ed1c8-cd43-4a7a-bcd3-b3e071fa63cf tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lazy-loading 'services' on Instance uuid 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 {{(pid=123392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 03 09:08:25.167807 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.wsgi [None req-64e6f780-fdf7-4dbc-b9a6-b2711dd4c8fb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f8916802-fe96-49fb-8429-1d530c1dd307) May 03 09:08:25.168436 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-64e6f780-fdf7-4dbc-b9a6-b2711dd4c8fb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f8916802-fe96-49fb-8429-1d530c1dd307) {{(pid=123391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 09:08:25.169386 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-64e6f780-fdf7-4dbc-b9a6-b2711dd4c8fb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "DELETE /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments/b0e90a13-d5bd-4175-8cb5-6962b4700c63" status: 400 len: 269 microversion: 2.1 time: 0.156709 May 03 09:08:25.169939 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 534/884] 10.222.0.11 () {58 vars in 1415 bytes} [Tue May 3 09:08:25 2022] DELETE /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments/b0e90a13-d5bd-4175-8cb5-6962b4700c63 => generated 269 bytes in 158 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 03 09:08:25.175611 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5c0fab98-328b-4cb1-b9d9-9cbecc772de8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:25.176247 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5c0fab98-328b-4cb1-b9d9-9cbecc772de8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:25.182610 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5c0fab98-328b-4cb1-b9d9-9cbecc772de8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:25.183059 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5c0fab98-328b-4cb1-b9d9-9cbecc772de8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:25.183823 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5c0fab98-328b-4cb1-b9d9-9cbecc772de8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:25.184269 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5c0fab98-328b-4cb1-b9d9-9cbecc772de8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:25.203659 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-d77ed1c8-cd43-4a7a-bcd3-b3e071fa63cf tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-feaebd3a-18b3-4774-abe5-6918bcf5de59) May 03 09:08:25.203659 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d77ed1c8-cd43-4a7a-bcd3-b3e071fa63cf tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-feaebd3a-18b3-4774-abe5-6918bcf5de59) {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 09:08:25.204224 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d77ed1c8-cd43-4a7a-bcd3-b3e071fa63cf tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "DELETE /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5/os-volume_attachments/e63b7581-76a0-494d-a723-2c1f41193e62" status: 400 len: 269 microversion: 2.1 time: 0.173862 May 03 09:08:25.204786 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 351/885] 10.222.0.11 () {58 vars in 1415 bytes} [Tue May 3 09:08:25 2022] DELETE /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5/os-volume_attachments/e63b7581-76a0-494d-a723-2c1f41193e62 => generated 269 bytes in 175 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 03 09:08:25.214220 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7160b750-7a6d-4a5d-bf48-9ea4cd076420 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:25.215320 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7160b750-7a6d-4a5d-bf48-9ea4cd076420 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:25.222338 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7160b750-7a6d-4a5d-bf48-9ea4cd076420 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:25.223012 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7160b750-7a6d-4a5d-bf48-9ea4cd076420 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:25.223552 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7160b750-7a6d-4a5d-bf48-9ea4cd076420 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:25.224171 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7160b750-7a6d-4a5d-bf48-9ea4cd076420 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:25.229034 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5c0fab98-328b-4cb1-b9d9-9cbecc772de8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:25.229538 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5c0fab98-328b-4cb1-b9d9-9cbecc772de8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:25.230109 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.objects.instance [None req-5c0fab98-328b-4cb1-b9d9-9cbecc772de8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lazy-loading 'fault' on Instance uuid a53f83a8-c719-47a0-969f-5b1305f839df {{(pid=123391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 03 09:08:25.262207 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7160b750-7a6d-4a5d-bf48-9ea4cd076420 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056033 May 03 09:08:25.263084 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 352/886] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:25 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:25.270117 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0f5bf4cb-224a-497c-b2ac-33fec90d01e4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:25.271104 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0f5bf4cb-224a-497c-b2ac-33fec90d01e4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:25.279478 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0f5bf4cb-224a-497c-b2ac-33fec90d01e4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:25.279983 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0f5bf4cb-224a-497c-b2ac-33fec90d01e4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:25.280785 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0f5bf4cb-224a-497c-b2ac-33fec90d01e4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:25.281138 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5c0fab98-328b-4cb1-b9d9-9cbecc772de8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e7163264a04db9a3b18aea3ae7631b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffda909ab345414b8962364cf2f5738f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:08:25.282400 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0f5bf4cb-224a-497c-b2ac-33fec90d01e4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:25.289810 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5c0fab98-328b-4cb1-b9d9-9cbecc772de8 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 200 len: 1231 microversion: 2.1 time: 0.118916 May 03 09:08:25.290888 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 535/887] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:08:25 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 1231 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:08:25.315845 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0f5bf4cb-224a-497c-b2ac-33fec90d01e4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051605 May 03 09:08:25.320491 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 353/888] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:25 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:25.821689 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-8917f5dc-5cf1-4d1a-a74f-c248f20ea507 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:25.822179 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-8917f5dc-5cf1-4d1a-a74f-c248f20ea507 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:25.828595 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8917f5dc-5cf1-4d1a-a74f-c248f20ea507 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:25.829043 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8917f5dc-5cf1-4d1a-a74f-c248f20ea507 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:25.829801 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8917f5dc-5cf1-4d1a-a74f-c248f20ea507 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:25.830222 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8917f5dc-5cf1-4d1a-a74f-c248f20ea507 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:25.843318 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.wsgi [None req-8917f5dc-5cf1-4d1a-a74f-c248f20ea507 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] HTTP exception thrown: Instance a53f83a8-c719-47a0-969f-5b1305f839df could not be found. May 03 09:08:25.843924 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-8917f5dc-5cf1-4d1a-a74f-c248f20ea507 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Returning 404 to user: Instance a53f83a8-c719-47a0-969f-5b1305f839df could not be found. {{(pid=123391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 09:08:25.844715 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-8917f5dc-5cf1-4d1a-a74f-c248f20ea507 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "DELETE /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 404 len: 111 microversion: 2.1 time: 0.027094 May 03 09:08:25.845517 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 536/889] 10.222.0.11 () {58 vars in 1238 bytes} [Tue May 3 09:08:25 2022] DELETE /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 09:08:25.853847 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d74f75d7-5c79-4023-80db-7f61ee2211cf tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:25.854481 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d74f75d7-5c79-4023-80db-7f61ee2211cf tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] [instance: a53f83a8-c719-47a0-969f-5b1305f839df] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:25.861530 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d74f75d7-5c79-4023-80db-7f61ee2211cf tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:25.861986 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d74f75d7-5c79-4023-80db-7f61ee2211cf tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:25.862755 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d74f75d7-5c79-4023-80db-7f61ee2211cf tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:25.863189 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d74f75d7-5c79-4023-80db-7f61ee2211cf tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:25.876916 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-d74f75d7-5c79-4023-80db-7f61ee2211cf tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] HTTP exception thrown: Instance a53f83a8-c719-47a0-969f-5b1305f839df could not be found. May 03 09:08:25.877507 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d74f75d7-5c79-4023-80db-7f61ee2211cf tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Returning 404 to user: Instance a53f83a8-c719-47a0-969f-5b1305f839df could not be found. {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 09:08:25.878337 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d74f75d7-5c79-4023-80db-7f61ee2211cf tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df" status: 404 len: 111 microversion: 2.1 time: 0.028483 May 03 09:08:25.878871 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 354/890] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:08:25 2022] GET /compute/v2.1/servers/a53f83a8-c719-47a0-969f-5b1305f839df => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 09:08:26.278674 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-2854a1a8-a41a-400d-b751-a69be4ace1a2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:26.280363 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-2854a1a8-a41a-400d-b751-a69be4ace1a2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:26.290787 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2854a1a8-a41a-400d-b751-a69be4ace1a2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:26.291529 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2854a1a8-a41a-400d-b751-a69be4ace1a2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:26.292859 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2854a1a8-a41a-400d-b751-a69be4ace1a2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:26.293562 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2854a1a8-a41a-400d-b751-a69be4ace1a2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:26.325041 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-2854a1a8-a41a-400d-b751-a69be4ace1a2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053065 May 03 09:08:26.325616 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 537/891] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:26 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:26.329508 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a6ba2582-e13f-4d70-86e1-6919742a5831 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:26.330532 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a6ba2582-e13f-4d70-86e1-6919742a5831 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:26.339499 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a6ba2582-e13f-4d70-86e1-6919742a5831 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:26.339499 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a6ba2582-e13f-4d70-86e1-6919742a5831 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:26.339499 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a6ba2582-e13f-4d70-86e1-6919742a5831 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:26.339499 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a6ba2582-e13f-4d70-86e1-6919742a5831 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:26.368323 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a6ba2582-e13f-4d70-86e1-6919742a5831 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043839 May 03 09:08:26.368880 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 355/892] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:26 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:27.158454 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 09:08:27.158638 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: Tue May 3 09:08:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 03 09:08:27.336841 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-0c1bf56a-8775-4838-bb90-ca12d97dc8bd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:27.337734 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-0c1bf56a-8775-4838-bb90-ca12d97dc8bd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:27.344225 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0c1bf56a-8775-4838-bb90-ca12d97dc8bd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:27.345191 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0c1bf56a-8775-4838-bb90-ca12d97dc8bd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:27.346091 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0c1bf56a-8775-4838-bb90-ca12d97dc8bd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:27.346523 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0c1bf56a-8775-4838-bb90-ca12d97dc8bd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:27.379783 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-0c1bf56a-8775-4838-bb90-ca12d97dc8bd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046934 May 03 09:08:27.380256 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ef4ca7b1-d1f9-45e5-96f5-2511be23d9c1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:27.382722 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ef4ca7b1-d1f9-45e5-96f5-2511be23d9c1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:27.383984 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 538/893] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:27 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:27.390439 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ef4ca7b1-d1f9-45e5-96f5-2511be23d9c1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:27.391450 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ef4ca7b1-d1f9-45e5-96f5-2511be23d9c1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:27.392642 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ef4ca7b1-d1f9-45e5-96f5-2511be23d9c1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:27.393078 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ef4ca7b1-d1f9-45e5-96f5-2511be23d9c1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:27.423933 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ef4ca7b1-d1f9-45e5-96f5-2511be23d9c1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047646 May 03 09:08:27.424662 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 356/894] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:27 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 09:08:28.393934 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e65e9426-25b4-4631-8575-2570b4ac01bc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:28.395066 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e65e9426-25b4-4631-8575-2570b4ac01bc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:28.403308 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e65e9426-25b4-4631-8575-2570b4ac01bc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:28.403898 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e65e9426-25b4-4631-8575-2570b4ac01bc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:28.404856 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e65e9426-25b4-4631-8575-2570b4ac01bc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:28.405388 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e65e9426-25b4-4631-8575-2570b4ac01bc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:28.436618 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f767af6b-3fc2-43fb-9cac-0f90f4f3eda6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:28.437173 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e65e9426-25b4-4631-8575-2570b4ac01bc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048909 May 03 09:08:28.440223 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 539/895] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:28 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:28.440341 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f767af6b-3fc2-43fb-9cac-0f90f4f3eda6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:28.444584 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f767af6b-3fc2-43fb-9cac-0f90f4f3eda6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:28.445038 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f767af6b-3fc2-43fb-9cac-0f90f4f3eda6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:28.445808 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f767af6b-3fc2-43fb-9cac-0f90f4f3eda6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:28.446248 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f767af6b-3fc2-43fb-9cac-0f90f4f3eda6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:28.477433 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f767af6b-3fc2-43fb-9cac-0f90f4f3eda6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045224 May 03 09:08:28.478010 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 357/896] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:28 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:29.452648 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e7a6c43c-1e0f-40cb-81b1-438e85dfe1ad tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:29.454178 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e7a6c43c-1e0f-40cb-81b1-438e85dfe1ad tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:29.461775 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e7a6c43c-1e0f-40cb-81b1-438e85dfe1ad tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:29.462274 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e7a6c43c-1e0f-40cb-81b1-438e85dfe1ad tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:29.463144 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e7a6c43c-1e0f-40cb-81b1-438e85dfe1ad tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:29.463675 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e7a6c43c-1e0f-40cb-81b1-438e85dfe1ad tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:29.489937 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7d9d7030-4700-4e1d-b115-474882992298 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:29.490865 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7d9d7030-4700-4e1d-b115-474882992298 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:29.497376 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e7a6c43c-1e0f-40cb-81b1-438e85dfe1ad tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051244 May 03 09:08:29.497964 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 540/897] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:29 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:29.501652 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7d9d7030-4700-4e1d-b115-474882992298 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:29.502132 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7d9d7030-4700-4e1d-b115-474882992298 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:29.502910 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7d9d7030-4700-4e1d-b115-474882992298 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:29.503351 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7d9d7030-4700-4e1d-b115-474882992298 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:29.532771 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7d9d7030-4700-4e1d-b115-474882992298 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046833 May 03 09:08:29.533302 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 358/898] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:29 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:30.513440 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9fd30cd1-d90d-43c2-97c9-90b71a504747 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:30.514806 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9fd30cd1-d90d-43c2-97c9-90b71a504747 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:30.525534 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9fd30cd1-d90d-43c2-97c9-90b71a504747 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:30.526294 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9fd30cd1-d90d-43c2-97c9-90b71a504747 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:30.527599 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9fd30cd1-d90d-43c2-97c9-90b71a504747 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:30.528367 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9fd30cd1-d90d-43c2-97c9-90b71a504747 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:30.544425 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-69c5bbc6-f93e-440c-912a-2759c5aed661 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:30.546292 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-69c5bbc6-f93e-440c-912a-2759c5aed661 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:30.553384 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-69c5bbc6-f93e-440c-912a-2759c5aed661 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:30.553901 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-69c5bbc6-f93e-440c-912a-2759c5aed661 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:30.554773 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-69c5bbc6-f93e-440c-912a-2759c5aed661 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:30.555422 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-69c5bbc6-f93e-440c-912a-2759c5aed661 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:30.563732 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9fd30cd1-d90d-43c2-97c9-90b71a504747 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057012 May 03 09:08:30.566818 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 541/899] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:30 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:30.584757 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-69c5bbc6-f93e-440c-912a-2759c5aed661 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044177 May 03 09:08:30.585336 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 359/900] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:30 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:31.579729 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-18be573e-ea0e-4404-90e7-5ea3ed3ee6b7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:31.580963 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-18be573e-ea0e-4404-90e7-5ea3ed3ee6b7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:31.588665 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-18be573e-ea0e-4404-90e7-5ea3ed3ee6b7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:31.588973 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-18be573e-ea0e-4404-90e7-5ea3ed3ee6b7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:31.589804 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-18be573e-ea0e-4404-90e7-5ea3ed3ee6b7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:31.590312 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-18be573e-ea0e-4404-90e7-5ea3ed3ee6b7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:31.597603 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-39101251-25bd-4ecf-9f87-5a72a0f900ff tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:31.598688 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-39101251-25bd-4ecf-9f87-5a72a0f900ff tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:31.606222 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-39101251-25bd-4ecf-9f87-5a72a0f900ff tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:31.606222 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-39101251-25bd-4ecf-9f87-5a72a0f900ff tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:31.607080 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-39101251-25bd-4ecf-9f87-5a72a0f900ff tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:31.607555 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-39101251-25bd-4ecf-9f87-5a72a0f900ff tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:31.622877 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-18be573e-ea0e-4404-90e7-5ea3ed3ee6b7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049791 May 03 09:08:31.627093 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 542/901] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:31 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:31.637795 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-39101251-25bd-4ecf-9f87-5a72a0f900ff tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044928 May 03 09:08:31.638352 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 360/902] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:31 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:32.638653 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-370f11f8-a0a9-4e2a-b7dc-155792d34a97 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:32.640004 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-370f11f8-a0a9-4e2a-b7dc-155792d34a97 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:32.651703 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-370f11f8-a0a9-4e2a-b7dc-155792d34a97 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:32.652528 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-370f11f8-a0a9-4e2a-b7dc-155792d34a97 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:32.653770 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-370f11f8-a0a9-4e2a-b7dc-155792d34a97 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:32.654510 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-370f11f8-a0a9-4e2a-b7dc-155792d34a97 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:32.655136 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-600e088d-27a8-4a14-9dca-e360906d7495 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:32.656803 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-600e088d-27a8-4a14-9dca-e360906d7495 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:32.665677 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-600e088d-27a8-4a14-9dca-e360906d7495 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:32.666122 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-600e088d-27a8-4a14-9dca-e360906d7495 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:32.667298 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-600e088d-27a8-4a14-9dca-e360906d7495 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:32.667726 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-600e088d-27a8-4a14-9dca-e360906d7495 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:32.686071 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-370f11f8-a0a9-4e2a-b7dc-155792d34a97 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054223 May 03 09:08:32.690079 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 543/903] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:32 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:32.705946 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-600e088d-27a8-4a14-9dca-e360906d7495 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059873 May 03 09:08:32.706508 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 361/904] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:32 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:33.702072 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9c821e1e-f647-4f83-a72d-f72568f816e5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:33.703565 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9c821e1e-f647-4f83-a72d-f72568f816e5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:33.712279 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9c821e1e-f647-4f83-a72d-f72568f816e5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:33.712279 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9c821e1e-f647-4f83-a72d-f72568f816e5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:33.712670 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9c821e1e-f647-4f83-a72d-f72568f816e5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:33.713090 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9c821e1e-f647-4f83-a72d-f72568f816e5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:33.717921 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d9b30f46-3172-44da-831d-1f523082b3c8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:33.718854 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d9b30f46-3172-44da-831d-1f523082b3c8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:33.726206 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d9b30f46-3172-44da-831d-1f523082b3c8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:33.726206 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d9b30f46-3172-44da-831d-1f523082b3c8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:33.726835 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d9b30f46-3172-44da-831d-1f523082b3c8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:33.727276 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d9b30f46-3172-44da-831d-1f523082b3c8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:33.743296 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9c821e1e-f647-4f83-a72d-f72568f816e5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048145 May 03 09:08:33.743868 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 544/905] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:33 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:33.768479 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d9b30f46-3172-44da-831d-1f523082b3c8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054416 May 03 09:08:33.769113 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 362/906] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:33 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:34.759653 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c754f4a8-f59c-4d33-ace0-ec41642f6065 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:34.761039 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c754f4a8-f59c-4d33-ace0-ec41642f6065 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:34.771073 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c754f4a8-f59c-4d33-ace0-ec41642f6065 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:34.771504 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c754f4a8-f59c-4d33-ace0-ec41642f6065 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:34.772344 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c754f4a8-f59c-4d33-ace0-ec41642f6065 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:34.774381 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c754f4a8-f59c-4d33-ace0-ec41642f6065 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:34.779255 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ff1fdb17-0708-4e3c-ad51-3e0dd458ca46 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:34.780872 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ff1fdb17-0708-4e3c-ad51-3e0dd458ca46 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:34.787640 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ff1fdb17-0708-4e3c-ad51-3e0dd458ca46 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:34.788113 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ff1fdb17-0708-4e3c-ad51-3e0dd458ca46 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:34.789807 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ff1fdb17-0708-4e3c-ad51-3e0dd458ca46 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:34.789807 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ff1fdb17-0708-4e3c-ad51-3e0dd458ca46 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:34.811463 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c754f4a8-f59c-4d33-ace0-ec41642f6065 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058487 May 03 09:08:34.812494 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 545/907] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:34 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:34.823753 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ff1fdb17-0708-4e3c-ad51-3e0dd458ca46 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048437 May 03 09:08:34.824362 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 363/908] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:34 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:35.823741 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-fcdc9b4e-d162-42ea-8c72-c6ad300693be tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:35.824607 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-fcdc9b4e-d162-42ea-8c72-c6ad300693be tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:35.832167 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fcdc9b4e-d162-42ea-8c72-c6ad300693be tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:35.832629 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fcdc9b4e-d162-42ea-8c72-c6ad300693be tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:35.833429 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fcdc9b4e-d162-42ea-8c72-c6ad300693be tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:35.833867 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fcdc9b4e-d162-42ea-8c72-c6ad300693be tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:35.835469 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-86c24bd5-be17-469e-b448-50e0f6135e8e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:35.836527 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-86c24bd5-be17-469e-b448-50e0f6135e8e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:35.843566 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-86c24bd5-be17-469e-b448-50e0f6135e8e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:35.844199 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-86c24bd5-be17-469e-b448-50e0f6135e8e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:35.845434 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-86c24bd5-be17-469e-b448-50e0f6135e8e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:35.845989 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-86c24bd5-be17-469e-b448-50e0f6135e8e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:35.864585 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-fcdc9b4e-d162-42ea-8c72-c6ad300693be tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045022 May 03 09:08:35.865471 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 546/909] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:35 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 09:08:35.883110 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-86c24bd5-be17-469e-b448-50e0f6135e8e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052261 May 03 09:08:35.883672 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 364/910] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:35 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:36.880081 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-909658ec-e00d-4314-b1ca-cc8f24b4a8e4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:36.880966 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-909658ec-e00d-4314-b1ca-cc8f24b4a8e4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:36.888447 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-909658ec-e00d-4314-b1ca-cc8f24b4a8e4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:36.888767 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-909658ec-e00d-4314-b1ca-cc8f24b4a8e4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:36.889611 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-909658ec-e00d-4314-b1ca-cc8f24b4a8e4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:36.890055 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-909658ec-e00d-4314-b1ca-cc8f24b4a8e4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:36.895916 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a53e00fa-aff6-4811-8e72-0ff78f340ffd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:36.896851 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a53e00fa-aff6-4811-8e72-0ff78f340ffd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:36.904331 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a53e00fa-aff6-4811-8e72-0ff78f340ffd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:36.904777 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a53e00fa-aff6-4811-8e72-0ff78f340ffd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:36.905559 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a53e00fa-aff6-4811-8e72-0ff78f340ffd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:36.905995 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a53e00fa-aff6-4811-8e72-0ff78f340ffd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:36.921442 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-909658ec-e00d-4314-b1ca-cc8f24b4a8e4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047963 May 03 09:08:36.922228 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 547/911] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:36 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:36.935628 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a53e00fa-aff6-4811-8e72-0ff78f340ffd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044670 May 03 09:08:36.936236 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 365/912] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:36 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:37.937594 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f7e90071-b004-4447-8b9f-cd3827043c6d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:37.939259 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f7e90071-b004-4447-8b9f-cd3827043c6d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:37.947215 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f7e90071-b004-4447-8b9f-cd3827043c6d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:37.947639 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f7e90071-b004-4447-8b9f-cd3827043c6d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:37.947851 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-bf0bf0c5-32c8-4008-a161-0ec8ea0298f4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:37.948677 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f7e90071-b004-4447-8b9f-cd3827043c6d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:37.948836 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-bf0bf0c5-32c8-4008-a161-0ec8ea0298f4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:37.949119 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f7e90071-b004-4447-8b9f-cd3827043c6d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:37.955378 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bf0bf0c5-32c8-4008-a161-0ec8ea0298f4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:37.955842 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bf0bf0c5-32c8-4008-a161-0ec8ea0298f4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:37.956599 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bf0bf0c5-32c8-4008-a161-0ec8ea0298f4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:37.957065 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bf0bf0c5-32c8-4008-a161-0ec8ea0298f4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:37.980456 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f7e90071-b004-4447-8b9f-cd3827043c6d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050122 May 03 09:08:37.985031 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 548/913] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:37 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:37.987158 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-bf0bf0c5-32c8-4008-a161-0ec8ea0298f4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043262 May 03 09:08:37.987743 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 366/914] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:37 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:38.387296 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 09:08:38.387633 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: Tue May 3 09:08:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 03 09:08:38.996967 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-4fee2152-36fa-4941-b9ed-c592c4b111c7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:38.998402 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-4fee2152-36fa-4941-b9ed-c592c4b111c7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:39.003523 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a8a2a083-316f-45fb-90fd-faca834bc533 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:39.005090 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a8a2a083-316f-45fb-90fd-faca834bc533 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:39.008552 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4fee2152-36fa-4941-b9ed-c592c4b111c7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:39.009266 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4fee2152-36fa-4941-b9ed-c592c4b111c7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:39.011862 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4fee2152-36fa-4941-b9ed-c592c4b111c7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:39.012693 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4fee2152-36fa-4941-b9ed-c592c4b111c7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:39.015569 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a8a2a083-316f-45fb-90fd-faca834bc533 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:39.016748 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a8a2a083-316f-45fb-90fd-faca834bc533 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:39.018042 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a8a2a083-316f-45fb-90fd-faca834bc533 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:39.020815 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a8a2a083-316f-45fb-90fd-faca834bc533 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:39.046246 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-4fee2152-36fa-4941-b9ed-c592c4b111c7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056153 May 03 09:08:39.047367 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 549/915] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:38 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:39.055345 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a8a2a083-316f-45fb-90fd-faca834bc533 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059436 May 03 09:08:39.055945 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 367/916] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:38 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:40.063570 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d49daa4d-e6a8-45ff-b577-7da06f3b2245 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:40.066002 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d49daa4d-e6a8-45ff-b577-7da06f3b2245 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:40.070280 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-3638211a-1780-4002-8563-78ce77e42caa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:40.071457 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-3638211a-1780-4002-8563-78ce77e42caa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:40.073434 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d49daa4d-e6a8-45ff-b577-7da06f3b2245 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:40.073883 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d49daa4d-e6a8-45ff-b577-7da06f3b2245 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:40.074663 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d49daa4d-e6a8-45ff-b577-7da06f3b2245 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:40.075100 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d49daa4d-e6a8-45ff-b577-7da06f3b2245 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:40.079622 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3638211a-1780-4002-8563-78ce77e42caa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:40.080036 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3638211a-1780-4002-8563-78ce77e42caa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:40.080803 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3638211a-1780-4002-8563-78ce77e42caa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:40.081239 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3638211a-1780-4002-8563-78ce77e42caa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:40.107496 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d49daa4d-e6a8-45ff-b577-7da06f3b2245 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051445 May 03 09:08:40.109130 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 550/917] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:40 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:40.118304 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-3638211a-1780-4002-8563-78ce77e42caa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053890 May 03 09:08:40.118877 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 368/918] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:40 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:41.124443 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e002d7bf-ce56-48b5-9ae0-10b7065700d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:41.126665 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e002d7bf-ce56-48b5-9ae0-10b7065700d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:41.133767 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c4076107-0b37-4342-8ffe-0268a0e2076d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:41.135216 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c4076107-0b37-4342-8ffe-0268a0e2076d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:41.137815 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e002d7bf-ce56-48b5-9ae0-10b7065700d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:41.138557 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e002d7bf-ce56-48b5-9ae0-10b7065700d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:41.142328 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e002d7bf-ce56-48b5-9ae0-10b7065700d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:41.142328 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e002d7bf-ce56-48b5-9ae0-10b7065700d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:41.145758 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c4076107-0b37-4342-8ffe-0268a0e2076d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:41.146476 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c4076107-0b37-4342-8ffe-0268a0e2076d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:41.147268 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c4076107-0b37-4342-8ffe-0268a0e2076d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:41.147703 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c4076107-0b37-4342-8ffe-0268a0e2076d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:41.173736 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e002d7bf-ce56-48b5-9ae0-10b7065700d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055627 May 03 09:08:41.174307 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 551/919] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:41 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:41.183198 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c4076107-0b37-4342-8ffe-0268a0e2076d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051061 May 03 09:08:41.183198 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 369/920] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:41 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:42.189774 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5a312f29-b7a7-4139-a8ef-040854e95dca tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:42.191179 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5a312f29-b7a7-4139-a8ef-040854e95dca tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:42.194317 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-3453ff02-ec97-45d3-9747-c4f48361dfa0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:42.195913 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-3453ff02-ec97-45d3-9747-c4f48361dfa0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:42.202377 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5a312f29-b7a7-4139-a8ef-040854e95dca tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:42.203130 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5a312f29-b7a7-4139-a8ef-040854e95dca tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:42.204418 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5a312f29-b7a7-4139-a8ef-040854e95dca tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:42.205497 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3453ff02-ec97-45d3-9747-c4f48361dfa0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:42.205734 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5a312f29-b7a7-4139-a8ef-040854e95dca tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:42.206215 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3453ff02-ec97-45d3-9747-c4f48361dfa0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:42.207824 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3453ff02-ec97-45d3-9747-c4f48361dfa0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:42.208914 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3453ff02-ec97-45d3-9747-c4f48361dfa0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:42.239526 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-3453ff02-ec97-45d3-9747-c4f48361dfa0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052366 May 03 09:08:42.240211 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 370/921] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:42 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:42.241169 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5a312f29-b7a7-4139-a8ef-040854e95dca tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058226 May 03 09:08:42.241859 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 552/922] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:42 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:43.251733 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-15c0dd89-f27d-4608-a694-915479bbf00e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:43.252621 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-15c0dd89-f27d-4608-a694-915479bbf00e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:43.252842 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d515bfa5-b5a1-4f87-b614-e9949710c50d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:43.253820 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d515bfa5-b5a1-4f87-b614-e9949710c50d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:43.259300 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-15c0dd89-f27d-4608-a694-915479bbf00e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:43.259753 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-15c0dd89-f27d-4608-a694-915479bbf00e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:43.260556 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-15c0dd89-f27d-4608-a694-915479bbf00e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:43.260900 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d515bfa5-b5a1-4f87-b614-e9949710c50d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:43.261052 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-15c0dd89-f27d-4608-a694-915479bbf00e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:43.261329 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d515bfa5-b5a1-4f87-b614-e9949710c50d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:43.262099 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d515bfa5-b5a1-4f87-b614-e9949710c50d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:43.262545 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d515bfa5-b5a1-4f87-b614-e9949710c50d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:43.292818 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-15c0dd89-f27d-4608-a694-915479bbf00e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045056 May 03 09:08:43.293672 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 371/923] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:43 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:43.302894 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d515bfa5-b5a1-4f87-b614-e9949710c50d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054109 May 03 09:08:43.303503 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 553/924] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:43 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:43.585358 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 09:08:43.585583 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: Tue May 3 09:08:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 03 09:08:44.305323 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5933cb44-f809-42b0-a850-84a9ad5487a6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:44.306156 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5933cb44-f809-42b0-a850-84a9ad5487a6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:44.313705 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5933cb44-f809-42b0-a850-84a9ad5487a6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:44.314159 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5933cb44-f809-42b0-a850-84a9ad5487a6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:44.314759 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5dab31b7-de58-4185-9ef5-0c13575ec0bc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:44.315228 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5933cb44-f809-42b0-a850-84a9ad5487a6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:44.315411 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5933cb44-f809-42b0-a850-84a9ad5487a6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:44.316107 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5dab31b7-de58-4185-9ef5-0c13575ec0bc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:44.322668 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5dab31b7-de58-4185-9ef5-0c13575ec0bc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:44.323096 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5dab31b7-de58-4185-9ef5-0c13575ec0bc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:44.323896 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5dab31b7-de58-4185-9ef5-0c13575ec0bc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:44.324326 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5dab31b7-de58-4185-9ef5-0c13575ec0bc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:44.347283 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5933cb44-f809-42b0-a850-84a9ad5487a6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046316 May 03 09:08:44.348184 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 372/925] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:44 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:44.353602 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5dab31b7-de58-4185-9ef5-0c13575ec0bc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042885 May 03 09:08:44.354099 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 554/926] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:44 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:45.359095 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2508e836-112f-43af-b063-3db7d480b206 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:45.360122 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-2508e836-112f-43af-b063-3db7d480b206 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:45.366033 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-09ffb51c-4324-4265-bc19-1f4ce5c24e06 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:45.366595 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2508e836-112f-43af-b063-3db7d480b206 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:45.366988 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2508e836-112f-43af-b063-3db7d480b206 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:45.368030 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2508e836-112f-43af-b063-3db7d480b206 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:45.368347 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-09ffb51c-4324-4265-bc19-1f4ce5c24e06 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:45.369005 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2508e836-112f-43af-b063-3db7d480b206 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:45.376626 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-09ffb51c-4324-4265-bc19-1f4ce5c24e06 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:45.377158 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-09ffb51c-4324-4265-bc19-1f4ce5c24e06 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:45.378135 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-09ffb51c-4324-4265-bc19-1f4ce5c24e06 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:45.378542 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-09ffb51c-4324-4265-bc19-1f4ce5c24e06 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:45.406660 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-2508e836-112f-43af-b063-3db7d480b206 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051541 May 03 09:08:45.407560 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 373/927] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:45 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:45.411188 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-09ffb51c-4324-4265-bc19-1f4ce5c24e06 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049629 May 03 09:08:45.412074 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 555/928] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:45 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:46.422738 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0ed94b08-210f-4185-ba56-dcfa33f94502 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:46.424386 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0ed94b08-210f-4185-ba56-dcfa33f94502 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:46.426633 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-4a6393d0-cc35-43ce-b72f-0a7364272220 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:46.428263 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-4a6393d0-cc35-43ce-b72f-0a7364272220 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:46.432864 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0ed94b08-210f-4185-ba56-dcfa33f94502 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:46.433285 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0ed94b08-210f-4185-ba56-dcfa33f94502 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:46.434088 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0ed94b08-210f-4185-ba56-dcfa33f94502 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:46.434519 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0ed94b08-210f-4185-ba56-dcfa33f94502 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:46.434866 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4a6393d0-cc35-43ce-b72f-0a7364272220 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:46.435330 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4a6393d0-cc35-43ce-b72f-0a7364272220 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:46.436132 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4a6393d0-cc35-43ce-b72f-0a7364272220 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:46.436727 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4a6393d0-cc35-43ce-b72f-0a7364272220 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:46.464217 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0ed94b08-210f-4185-ba56-dcfa33f94502 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048171 May 03 09:08:46.464834 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 374/929] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:46 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:46.471467 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-4a6393d0-cc35-43ce-b72f-0a7364272220 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051473 May 03 09:08:46.472060 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 556/930] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:46 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:47.481416 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f6f16b40-74bb-406e-94f6-b986b0ce2e9c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:47.482892 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f6f16b40-74bb-406e-94f6-b986b0ce2e9c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:47.487246 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9a228bea-1817-4852-882f-d37764c9bcce tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:47.489367 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9a228bea-1817-4852-882f-d37764c9bcce tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:47.493899 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f6f16b40-74bb-406e-94f6-b986b0ce2e9c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:47.494698 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f6f16b40-74bb-406e-94f6-b986b0ce2e9c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:47.496027 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f6f16b40-74bb-406e-94f6-b986b0ce2e9c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:47.496852 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f6f16b40-74bb-406e-94f6-b986b0ce2e9c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:47.499821 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9a228bea-1817-4852-882f-d37764c9bcce tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:47.500486 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9a228bea-1817-4852-882f-d37764c9bcce tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:47.502016 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9a228bea-1817-4852-882f-d37764c9bcce tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:47.502751 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9a228bea-1817-4852-882f-d37764c9bcce tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:47.535952 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9a228bea-1817-4852-882f-d37764c9bcce tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055201 May 03 09:08:47.536523 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 557/931] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:47 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:47.540476 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f6f16b40-74bb-406e-94f6-b986b0ce2e9c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066243 May 03 09:08:47.541043 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 375/932] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:47 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:48.553038 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-270c3e02-4dc6-4bc9-a64e-1e66001ad4ca tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:48.554533 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-270c3e02-4dc6-4bc9-a64e-1e66001ad4ca tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:48.557743 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-cc75ade3-6c5e-4ece-a892-868cc14ae571 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:48.559217 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-cc75ade3-6c5e-4ece-a892-868cc14ae571 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:48.564873 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-270c3e02-4dc6-4bc9-a64e-1e66001ad4ca tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:48.565853 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-270c3e02-4dc6-4bc9-a64e-1e66001ad4ca tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:48.566831 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-270c3e02-4dc6-4bc9-a64e-1e66001ad4ca tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:48.567607 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-270c3e02-4dc6-4bc9-a64e-1e66001ad4ca tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:48.569665 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cc75ade3-6c5e-4ece-a892-868cc14ae571 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:48.570326 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cc75ade3-6c5e-4ece-a892-868cc14ae571 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:48.571103 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cc75ade3-6c5e-4ece-a892-868cc14ae571 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:48.571528 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cc75ade3-6c5e-4ece-a892-868cc14ae571 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:48.598303 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-270c3e02-4dc6-4bc9-a64e-1e66001ad4ca tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053322 May 03 09:08:48.599074 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 558/933] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:48 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:48.605145 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-cc75ade3-6c5e-4ece-a892-868cc14ae571 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056302 May 03 09:08:48.605705 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 376/934] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:48 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:49.614263 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-13cd522a-74b1-4846-9ee2-4cb52854f0f1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:49.615414 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-13cd522a-74b1-4846-9ee2-4cb52854f0f1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:49.619246 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-23c1b0ff-7f04-447e-914f-de692cbc1f0d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:49.620182 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-23c1b0ff-7f04-447e-914f-de692cbc1f0d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:49.623264 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-13cd522a-74b1-4846-9ee2-4cb52854f0f1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:49.623720 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-13cd522a-74b1-4846-9ee2-4cb52854f0f1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:49.625546 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-13cd522a-74b1-4846-9ee2-4cb52854f0f1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:49.625546 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-13cd522a-74b1-4846-9ee2-4cb52854f0f1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:49.626468 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-23c1b0ff-7f04-447e-914f-de692cbc1f0d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:49.626936 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-23c1b0ff-7f04-447e-914f-de692cbc1f0d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:49.627708 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-23c1b0ff-7f04-447e-914f-de692cbc1f0d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:49.628160 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-23c1b0ff-7f04-447e-914f-de692cbc1f0d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:49.654627 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-13cd522a-74b1-4846-9ee2-4cb52854f0f1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047052 May 03 09:08:49.655387 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 559/935] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:49 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:49.660671 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-23c1b0ff-7f04-447e-914f-de692cbc1f0d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046417 May 03 09:08:49.661261 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 377/936] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:49 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:50.666453 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-13a6ef10-d337-4105-9865-92454c275d95 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:50.667465 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-13a6ef10-d337-4105-9865-92454c275d95 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:50.671712 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-cec70f87-24c9-435c-a746-aa802ef78dee tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:50.673383 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-cec70f87-24c9-435c-a746-aa802ef78dee tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:50.675220 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-13a6ef10-d337-4105-9865-92454c275d95 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:50.675697 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-13a6ef10-d337-4105-9865-92454c275d95 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:50.676473 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-13a6ef10-d337-4105-9865-92454c275d95 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:50.676878 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-13a6ef10-d337-4105-9865-92454c275d95 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:50.680780 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cec70f87-24c9-435c-a746-aa802ef78dee tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:50.681155 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cec70f87-24c9-435c-a746-aa802ef78dee tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:50.681925 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cec70f87-24c9-435c-a746-aa802ef78dee tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:50.682386 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cec70f87-24c9-435c-a746-aa802ef78dee tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:50.706128 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-13a6ef10-d337-4105-9865-92454c275d95 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044210 May 03 09:08:50.706675 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 560/937] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:50 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:50.715188 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-cec70f87-24c9-435c-a746-aa802ef78dee tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047548 May 03 09:08:50.715788 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 378/938] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:50 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:51.722332 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e28c45f1-434e-4e9f-b457-2ce0c88e8fdd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:51.724776 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e28c45f1-434e-4e9f-b457-2ce0c88e8fdd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:51.730854 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-786935e2-eb99-4334-8bad-c13a80ae2cd2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:51.732774 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-786935e2-eb99-4334-8bad-c13a80ae2cd2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:51.735628 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e28c45f1-434e-4e9f-b457-2ce0c88e8fdd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:51.736440 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e28c45f1-434e-4e9f-b457-2ce0c88e8fdd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:51.737663 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e28c45f1-434e-4e9f-b457-2ce0c88e8fdd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:51.738412 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e28c45f1-434e-4e9f-b457-2ce0c88e8fdd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:51.742772 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-786935e2-eb99-4334-8bad-c13a80ae2cd2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:51.744264 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-786935e2-eb99-4334-8bad-c13a80ae2cd2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:51.744264 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-786935e2-eb99-4334-8bad-c13a80ae2cd2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:51.744478 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-786935e2-eb99-4334-8bad-c13a80ae2cd2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:51.769445 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e28c45f1-434e-4e9f-b457-2ce0c88e8fdd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053982 May 03 09:08:51.773288 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 561/939] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:51 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:51.776074 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-786935e2-eb99-4334-8bad-c13a80ae2cd2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051850 May 03 09:08:51.776628 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 379/940] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:51 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:52.785777 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-0abe0563-b350-43e2-8a7b-6a50196ec550 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:52.788675 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-0abe0563-b350-43e2-8a7b-6a50196ec550 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:52.790855 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-18036509-321a-45f5-97fd-ec3c413e894f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:52.792169 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-18036509-321a-45f5-97fd-ec3c413e894f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:52.796951 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0abe0563-b350-43e2-8a7b-6a50196ec550 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:52.797588 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0abe0563-b350-43e2-8a7b-6a50196ec550 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:52.798172 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0abe0563-b350-43e2-8a7b-6a50196ec550 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:52.798629 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0abe0563-b350-43e2-8a7b-6a50196ec550 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:52.798743 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-18036509-321a-45f5-97fd-ec3c413e894f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:52.799352 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-18036509-321a-45f5-97fd-ec3c413e894f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:52.799995 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-18036509-321a-45f5-97fd-ec3c413e894f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:52.800431 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-18036509-321a-45f5-97fd-ec3c413e894f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:52.829576 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-0abe0563-b350-43e2-8a7b-6a50196ec550 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050428 May 03 09:08:52.831679 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 562/941] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:52 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:52.834007 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-18036509-321a-45f5-97fd-ec3c413e894f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048633 May 03 09:08:52.834604 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 380/942] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:52 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:53.846373 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-28938bda-6b48-4d37-a017-b397a33c46b5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:53.847875 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-28938bda-6b48-4d37-a017-b397a33c46b5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:53.851377 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-36df5eff-668f-4101-b59c-0bdebc83c11c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:53.852909 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-36df5eff-668f-4101-b59c-0bdebc83c11c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:53.858362 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-28938bda-6b48-4d37-a017-b397a33c46b5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:53.859131 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-28938bda-6b48-4d37-a017-b397a33c46b5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:53.860462 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-28938bda-6b48-4d37-a017-b397a33c46b5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:53.861177 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-28938bda-6b48-4d37-a017-b397a33c46b5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:53.865194 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-36df5eff-668f-4101-b59c-0bdebc83c11c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:53.865875 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-36df5eff-668f-4101-b59c-0bdebc83c11c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:53.867097 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-36df5eff-668f-4101-b59c-0bdebc83c11c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:53.867532 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-36df5eff-668f-4101-b59c-0bdebc83c11c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:53.893275 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-28938bda-6b48-4d37-a017-b397a33c46b5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053997 May 03 09:08:53.893849 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 563/943] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:53 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:53.901483 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-36df5eff-668f-4101-b59c-0bdebc83c11c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053443 May 03 09:08:53.901483 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 381/944] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:53 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:54.909128 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-cf117ecc-0b96-47a2-89a9-744d9c43b636 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:54.910784 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-cf117ecc-0b96-47a2-89a9-744d9c43b636 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:54.913298 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-834b1283-cc9b-45ac-95b6-e4bbaeaf9f02 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:54.914825 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-834b1283-cc9b-45ac-95b6-e4bbaeaf9f02 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:54.921032 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cf117ecc-0b96-47a2-89a9-744d9c43b636 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:54.921743 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cf117ecc-0b96-47a2-89a9-744d9c43b636 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:54.923067 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cf117ecc-0b96-47a2-89a9-744d9c43b636 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:54.923823 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cf117ecc-0b96-47a2-89a9-744d9c43b636 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:54.926480 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-834b1283-cc9b-45ac-95b6-e4bbaeaf9f02 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:54.926480 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-834b1283-cc9b-45ac-95b6-e4bbaeaf9f02 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:54.927841 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-834b1283-cc9b-45ac-95b6-e4bbaeaf9f02 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:54.928577 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-834b1283-cc9b-45ac-95b6-e4bbaeaf9f02 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:54.956713 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-cf117ecc-0b96-47a2-89a9-744d9c43b636 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054664 May 03 09:08:54.957306 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 564/945] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:54 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:54.958693 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-834b1283-cc9b-45ac-95b6-e4bbaeaf9f02 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052397 May 03 09:08:54.959254 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 382/946] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:54 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:55.798497 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 09:08:55.798666 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: Tue May 3 09:08:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 03 09:08:55.972421 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-cd4b07ef-ae5e-4d10-b2b7-1d9033b6aec3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:55.973891 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-cd4b07ef-ae5e-4d10-b2b7-1d9033b6aec3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:55.976437 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f773a0b8-00d5-4935-8e00-9489eda8afb6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:55.976863 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f773a0b8-00d5-4935-8e00-9489eda8afb6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:55.981040 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cd4b07ef-ae5e-4d10-b2b7-1d9033b6aec3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:55.981487 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cd4b07ef-ae5e-4d10-b2b7-1d9033b6aec3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:55.982303 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cd4b07ef-ae5e-4d10-b2b7-1d9033b6aec3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:55.982756 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cd4b07ef-ae5e-4d10-b2b7-1d9033b6aec3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:55.983537 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f773a0b8-00d5-4935-8e00-9489eda8afb6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:55.984067 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f773a0b8-00d5-4935-8e00-9489eda8afb6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:55.984836 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f773a0b8-00d5-4935-8e00-9489eda8afb6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:55.985284 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f773a0b8-00d5-4935-8e00-9489eda8afb6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:56.014145 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-cd4b07ef-ae5e-4d10-b2b7-1d9033b6aec3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048891 May 03 09:08:56.014619 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f773a0b8-00d5-4935-8e00-9489eda8afb6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046920 May 03 09:08:56.015044 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 565/947] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:55 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:56.015196 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 383/948] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:55 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 09:08:57.026192 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-dcd16551-86ac-40f5-817e-483852864c4d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:57.026813 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c78ef68c-31d6-4c27-93d7-29b7b79c8cc4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:57.027174 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-dcd16551-86ac-40f5-817e-483852864c4d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:57.027732 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c78ef68c-31d6-4c27-93d7-29b7b79c8cc4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:57.034416 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dcd16551-86ac-40f5-817e-483852864c4d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:57.034865 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dcd16551-86ac-40f5-817e-483852864c4d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:57.035628 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dcd16551-86ac-40f5-817e-483852864c4d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:57.037871 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dcd16551-86ac-40f5-817e-483852864c4d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:57.038016 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c78ef68c-31d6-4c27-93d7-29b7b79c8cc4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:57.038016 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c78ef68c-31d6-4c27-93d7-29b7b79c8cc4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:57.038496 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c78ef68c-31d6-4c27-93d7-29b7b79c8cc4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:57.039060 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c78ef68c-31d6-4c27-93d7-29b7b79c8cc4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:57.067993 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-dcd16551-86ac-40f5-817e-483852864c4d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046240 May 03 09:08:57.072344 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 566/949] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:57 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:57.073880 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c78ef68c-31d6-4c27-93d7-29b7b79c8cc4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051444 May 03 09:08:57.074696 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 384/950] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:57 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 09:08:58.080110 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-dac9700b-ae00-4103-a6ff-e510b7a36293 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:58.081063 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-dac9700b-ae00-4103-a6ff-e510b7a36293 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:58.085456 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f1ebb193-e1e2-4d8c-be23-f855fc06ce8e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:58.086430 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f1ebb193-e1e2-4d8c-be23-f855fc06ce8e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:58.087559 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dac9700b-ae00-4103-a6ff-e510b7a36293 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:58.088043 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dac9700b-ae00-4103-a6ff-e510b7a36293 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:58.088811 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dac9700b-ae00-4103-a6ff-e510b7a36293 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:58.089255 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dac9700b-ae00-4103-a6ff-e510b7a36293 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:58.094374 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f1ebb193-e1e2-4d8c-be23-f855fc06ce8e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:58.094970 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f1ebb193-e1e2-4d8c-be23-f855fc06ce8e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:58.095974 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f1ebb193-e1e2-4d8c-be23-f855fc06ce8e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:58.096404 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f1ebb193-e1e2-4d8c-be23-f855fc06ce8e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:58.119356 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-dac9700b-ae00-4103-a6ff-e510b7a36293 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043325 May 03 09:08:58.120159 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 567/951] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:58 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:58.125955 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f1ebb193-e1e2-4d8c-be23-f855fc06ce8e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044440 May 03 09:08:58.126766 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 385/952] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:58 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:59.135846 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ff484ff5-e3d1-4be3-be7d-7031d86e27dd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:59.137522 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ff484ff5-e3d1-4be3-be7d-7031d86e27dd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:59.141602 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5ea3a9d2-0ece-4318-b458-9815fd9140a8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:08:59.143226 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5ea3a9d2-0ece-4318-b458-9815fd9140a8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:08:59.148389 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ff484ff5-e3d1-4be3-be7d-7031d86e27dd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:59.149296 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ff484ff5-e3d1-4be3-be7d-7031d86e27dd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:59.150582 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ff484ff5-e3d1-4be3-be7d-7031d86e27dd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:59.151402 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ff484ff5-e3d1-4be3-be7d-7031d86e27dd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:59.152662 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5ea3a9d2-0ece-4318-b458-9815fd9140a8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:59.153146 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5ea3a9d2-0ece-4318-b458-9815fd9140a8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:59.153928 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5ea3a9d2-0ece-4318-b458-9815fd9140a8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:08:59.154327 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5ea3a9d2-0ece-4318-b458-9815fd9140a8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:08:59.182282 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ff484ff5-e3d1-4be3-be7d-7031d86e27dd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053375 May 03 09:08:59.186233 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 568/953] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:59 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:08:59.186406 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5ea3a9d2-0ece-4318-b458-9815fd9140a8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049123 May 03 09:08:59.186406 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 386/954] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:08:59 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:00.198522 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-4ebcff09-5568-4f70-a0b4-26458d50aa0c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:00.199468 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e9533aec-bf9c-4a7c-8e21-d28fed48953c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:00.199857 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-4ebcff09-5568-4f70-a0b4-26458d50aa0c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:00.200333 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e9533aec-bf9c-4a7c-8e21-d28fed48953c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:00.206900 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e9533aec-bf9c-4a7c-8e21-d28fed48953c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:00.207339 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e9533aec-bf9c-4a7c-8e21-d28fed48953c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:00.208324 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e9533aec-bf9c-4a7c-8e21-d28fed48953c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:00.208948 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e9533aec-bf9c-4a7c-8e21-d28fed48953c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:00.209064 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4ebcff09-5568-4f70-a0b4-26458d50aa0c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:00.209672 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4ebcff09-5568-4f70-a0b4-26458d50aa0c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:00.210550 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4ebcff09-5568-4f70-a0b4-26458d50aa0c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:00.210992 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4ebcff09-5568-4f70-a0b4-26458d50aa0c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:00.241643 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e9533aec-bf9c-4a7c-8e21-d28fed48953c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048987 May 03 09:09:00.242223 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 387/955] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:00 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:00.245152 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-4ebcff09-5568-4f70-a0b4-26458d50aa0c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053633 May 03 09:09:00.245913 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 569/956] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:00 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:01.257913 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-92357c59-4cf2-4e56-8e4c-cae8a3c4402c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:01.259388 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-92357c59-4cf2-4e56-8e4c-cae8a3c4402c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:01.261324 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-fe569894-afec-4850-9ffa-5db0067a0219 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:01.262812 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-fe569894-afec-4850-9ffa-5db0067a0219 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:01.270280 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-92357c59-4cf2-4e56-8e4c-cae8a3c4402c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:01.271602 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-92357c59-4cf2-4e56-8e4c-cae8a3c4402c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:01.273392 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fe569894-afec-4850-9ffa-5db0067a0219 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:01.273692 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-92357c59-4cf2-4e56-8e4c-cae8a3c4402c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:01.274161 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fe569894-afec-4850-9ffa-5db0067a0219 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:01.274362 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-92357c59-4cf2-4e56-8e4c-cae8a3c4402c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:01.275367 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fe569894-afec-4850-9ffa-5db0067a0219 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:01.276128 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fe569894-afec-4850-9ffa-5db0067a0219 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:01.306528 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-92357c59-4cf2-4e56-8e4c-cae8a3c4402c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055429 May 03 09:09:01.307267 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 388/957] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:01 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:01.314084 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-fe569894-afec-4850-9ffa-5db0067a0219 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059706 May 03 09:09:01.314635 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 570/958] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:01 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:02.318985 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-99bac4d0-526e-45fa-8859-fb749c1c46f0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:02.321073 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-99bac4d0-526e-45fa-8859-fb749c1c46f0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:02.326709 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-367ffe5e-05ea-4c23-9e6c-19d69b2e3f80 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:02.327643 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-367ffe5e-05ea-4c23-9e6c-19d69b2e3f80 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:02.327959 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-99bac4d0-526e-45fa-8859-fb749c1c46f0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:02.328362 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-99bac4d0-526e-45fa-8859-fb749c1c46f0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:02.329229 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-99bac4d0-526e-45fa-8859-fb749c1c46f0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:02.329562 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-99bac4d0-526e-45fa-8859-fb749c1c46f0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:02.334278 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-367ffe5e-05ea-4c23-9e6c-19d69b2e3f80 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:02.334966 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-367ffe5e-05ea-4c23-9e6c-19d69b2e3f80 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:02.336006 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-367ffe5e-05ea-4c23-9e6c-19d69b2e3f80 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:02.336433 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-367ffe5e-05ea-4c23-9e6c-19d69b2e3f80 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:02.365724 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-99bac4d0-526e-45fa-8859-fb749c1c46f0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050679 May 03 09:09:02.366274 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 389/959] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:02 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:02.369205 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-367ffe5e-05ea-4c23-9e6c-19d69b2e3f80 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046464 May 03 09:09:02.369742 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 571/960] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:02 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:02.551074 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 09:09:02.551420 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: Tue May 3 09:09:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 03 09:09:03.378043 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-641f50ec-7829-4ade-8c4f-d2c45b416cdd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:03.379083 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-641f50ec-7829-4ade-8c4f-d2c45b416cdd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:03.380791 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-7c492a70-01cd-43a0-9e5a-97fdd5fc590b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:03.381857 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-7c492a70-01cd-43a0-9e5a-97fdd5fc590b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:03.386470 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-641f50ec-7829-4ade-8c4f-d2c45b416cdd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:03.386978 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-641f50ec-7829-4ade-8c4f-d2c45b416cdd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:03.387761 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-641f50ec-7829-4ade-8c4f-d2c45b416cdd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:03.388190 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-641f50ec-7829-4ade-8c4f-d2c45b416cdd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:03.388335 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7c492a70-01cd-43a0-9e5a-97fdd5fc590b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:03.388845 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7c492a70-01cd-43a0-9e5a-97fdd5fc590b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:03.389619 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7c492a70-01cd-43a0-9e5a-97fdd5fc590b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:03.390053 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7c492a70-01cd-43a0-9e5a-97fdd5fc590b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:03.420557 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-641f50ec-7829-4ade-8c4f-d2c45b416cdd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046800 May 03 09:09:03.421262 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 390/961] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:03 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:03.424876 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-7c492a70-01cd-43a0-9e5a-97fdd5fc590b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047990 May 03 09:09:03.425476 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 572/962] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:03 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 09:09:04.432564 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f6296ba8-1eda-4dc1-8a71-64feae8f0d4d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:04.433654 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f6296ba8-1eda-4dc1-8a71-64feae8f0d4d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:04.437286 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f181d2ba-edd5-4218-a66d-3f276f90b19f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:04.438221 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f181d2ba-edd5-4218-a66d-3f276f90b19f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:04.439989 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f6296ba8-1eda-4dc1-8a71-64feae8f0d4d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:04.440939 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f6296ba8-1eda-4dc1-8a71-64feae8f0d4d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:04.441930 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f6296ba8-1eda-4dc1-8a71-64feae8f0d4d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:04.442416 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f6296ba8-1eda-4dc1-8a71-64feae8f0d4d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:04.444570 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f181d2ba-edd5-4218-a66d-3f276f90b19f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:04.445050 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f181d2ba-edd5-4218-a66d-3f276f90b19f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:04.445798 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f181d2ba-edd5-4218-a66d-3f276f90b19f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:04.446471 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f181d2ba-edd5-4218-a66d-3f276f90b19f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:04.481235 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f6296ba8-1eda-4dc1-8a71-64feae8f0d4d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053005 May 03 09:09:04.481978 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 391/963] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:04 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:04.486484 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f181d2ba-edd5-4218-a66d-3f276f90b19f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054000 May 03 09:09:04.487058 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 573/964] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:04 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:05.497607 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ad300e9e-a506-4024-882e-9b574809d043 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:05.498846 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ad300e9e-a506-4024-882e-9b574809d043 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:05.502727 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-19d6b48b-06d8-4aa0-bf8b-1cea93180ad0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:05.504267 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-19d6b48b-06d8-4aa0-bf8b-1cea93180ad0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:05.509406 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ad300e9e-a506-4024-882e-9b574809d043 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:05.510114 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ad300e9e-a506-4024-882e-9b574809d043 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:05.511435 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ad300e9e-a506-4024-882e-9b574809d043 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:05.512408 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ad300e9e-a506-4024-882e-9b574809d043 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:05.514498 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-19d6b48b-06d8-4aa0-bf8b-1cea93180ad0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:05.514913 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-19d6b48b-06d8-4aa0-bf8b-1cea93180ad0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:05.515706 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-19d6b48b-06d8-4aa0-bf8b-1cea93180ad0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:05.516168 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-19d6b48b-06d8-4aa0-bf8b-1cea93180ad0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:05.546516 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-19d6b48b-06d8-4aa0-bf8b-1cea93180ad0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050822 May 03 09:09:05.550323 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 574/965] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:05 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:05.552065 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ad300e9e-a506-4024-882e-9b574809d043 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061660 May 03 09:09:05.552633 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 392/966] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:05 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:06.561657 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-18d4901e-e7ad-4310-bab5-867d3de2cd2d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:06.562574 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-18d4901e-e7ad-4310-bab5-867d3de2cd2d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:06.565180 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0fef0978-9171-45f3-bbb9-e69b5ef1e11e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:06.566202 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0fef0978-9171-45f3-bbb9-e69b5ef1e11e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:06.569398 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-18d4901e-e7ad-4310-bab5-867d3de2cd2d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:06.569568 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-18d4901e-e7ad-4310-bab5-867d3de2cd2d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:06.570253 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-18d4901e-e7ad-4310-bab5-867d3de2cd2d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:06.570680 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-18d4901e-e7ad-4310-bab5-867d3de2cd2d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:06.572932 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0fef0978-9171-45f3-bbb9-e69b5ef1e11e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:06.573397 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0fef0978-9171-45f3-bbb9-e69b5ef1e11e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:06.575334 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0fef0978-9171-45f3-bbb9-e69b5ef1e11e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:06.575334 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0fef0978-9171-45f3-bbb9-e69b5ef1e11e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:06.601041 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-18d4901e-e7ad-4310-bab5-867d3de2cd2d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045735 May 03 09:09:06.601739 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 575/967] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:06 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:06.613052 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0fef0978-9171-45f3-bbb9-e69b5ef1e11e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052361 May 03 09:09:06.613783 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 393/968] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:06 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:07.617612 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-0f6989f7-1674-41ec-a989-0c779d6db6e1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:07.619117 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-0f6989f7-1674-41ec-a989-0c779d6db6e1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:07.629197 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a174c342-671f-4128-9ecc-9dad2b0426de tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:07.629952 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0f6989f7-1674-41ec-a989-0c779d6db6e1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:07.630513 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0f6989f7-1674-41ec-a989-0c779d6db6e1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:07.631202 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a174c342-671f-4128-9ecc-9dad2b0426de tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:07.631854 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0f6989f7-1674-41ec-a989-0c779d6db6e1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:07.632614 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0f6989f7-1674-41ec-a989-0c779d6db6e1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:07.641265 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a174c342-671f-4128-9ecc-9dad2b0426de tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:07.641728 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a174c342-671f-4128-9ecc-9dad2b0426de tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:07.642504 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a174c342-671f-4128-9ecc-9dad2b0426de tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:07.642940 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a174c342-671f-4128-9ecc-9dad2b0426de tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:07.665115 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-0f6989f7-1674-41ec-a989-0c779d6db6e1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054644 May 03 09:09:07.669120 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 576/969] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:07 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:07.672565 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a174c342-671f-4128-9ecc-9dad2b0426de tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050137 May 03 09:09:07.676294 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 394/970] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:07 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:08.681022 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-28cbde0a-9cf9-4a0c-8cf0-85ec3694558a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:08.682504 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-28cbde0a-9cf9-4a0c-8cf0-85ec3694558a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:08.687792 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-94dac684-43fa-4bd8-91d2-7ccecb4219ae tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:08.688709 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-94dac684-43fa-4bd8-91d2-7ccecb4219ae tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:08.691175 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-28cbde0a-9cf9-4a0c-8cf0-85ec3694558a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:08.691657 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-28cbde0a-9cf9-4a0c-8cf0-85ec3694558a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:08.693185 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-28cbde0a-9cf9-4a0c-8cf0-85ec3694558a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:08.693941 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-28cbde0a-9cf9-4a0c-8cf0-85ec3694558a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:08.695151 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-94dac684-43fa-4bd8-91d2-7ccecb4219ae tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:08.695920 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-94dac684-43fa-4bd8-91d2-7ccecb4219ae tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:08.696689 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-94dac684-43fa-4bd8-91d2-7ccecb4219ae tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:08.697302 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-94dac684-43fa-4bd8-91d2-7ccecb4219ae tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:08.724415 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-28cbde0a-9cf9-4a0c-8cf0-85ec3694558a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050010 May 03 09:09:08.725299 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 577/971] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:08 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:08.727310 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-94dac684-43fa-4bd8-91d2-7ccecb4219ae tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045171 May 03 09:09:08.733584 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 395/972] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:08 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:09.740342 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-63979f62-35a6-4a55-bc30-4bb01e3b0ef6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:09.741842 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-63979f62-35a6-4a55-bc30-4bb01e3b0ef6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:09.743028 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-678c79cb-2d35-426d-a496-cc5b6c5894ae tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:09.744760 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-678c79cb-2d35-426d-a496-cc5b6c5894ae tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:09.751139 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-63979f62-35a6-4a55-bc30-4bb01e3b0ef6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:09.751590 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-63979f62-35a6-4a55-bc30-4bb01e3b0ef6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:09.752447 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-63979f62-35a6-4a55-bc30-4bb01e3b0ef6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:09.752669 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-678c79cb-2d35-426d-a496-cc5b6c5894ae tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:09.752863 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-63979f62-35a6-4a55-bc30-4bb01e3b0ef6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:09.753159 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-678c79cb-2d35-426d-a496-cc5b6c5894ae tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:09.753927 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-678c79cb-2d35-426d-a496-cc5b6c5894ae tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:09.754490 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-678c79cb-2d35-426d-a496-cc5b6c5894ae tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:09.783325 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-63979f62-35a6-4a55-bc30-4bb01e3b0ef6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049693 May 03 09:09:09.784060 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 578/973] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:09 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:09.784490 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-678c79cb-2d35-426d-a496-cc5b6c5894ae tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048522 May 03 09:09:09.788550 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 396/974] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:09 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:10.798554 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-59b386ab-7fd1-44fa-b8b4-1a9970880420 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:10.799638 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-8dc72d8b-6717-4d77-9e83-74333b2c7f56 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:10.800069 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-59b386ab-7fd1-44fa-b8b4-1a9970880420 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:10.801221 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-8dc72d8b-6717-4d77-9e83-74333b2c7f56 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:10.806595 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-59b386ab-7fd1-44fa-b8b4-1a9970880420 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:10.807057 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-59b386ab-7fd1-44fa-b8b4-1a9970880420 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:10.807613 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8dc72d8b-6717-4d77-9e83-74333b2c7f56 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:10.808049 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-59b386ab-7fd1-44fa-b8b4-1a9970880420 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:10.808156 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8dc72d8b-6717-4d77-9e83-74333b2c7f56 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:10.808488 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-59b386ab-7fd1-44fa-b8b4-1a9970880420 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:10.808836 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8dc72d8b-6717-4d77-9e83-74333b2c7f56 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:10.809267 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8dc72d8b-6717-4d77-9e83-74333b2c7f56 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:10.840534 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-8dc72d8b-6717-4d77-9e83-74333b2c7f56 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046781 May 03 09:09:10.841279 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 397/975] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:10 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:10.842245 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-59b386ab-7fd1-44fa-b8b4-1a9970880420 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049367 May 03 09:09:10.842811 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 579/976] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:10 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:11.856953 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d660a954-9dd6-4f7a-8762-c91d414ffada tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:11.857997 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5eb7a41d-106c-4650-9261-ae1c5ed73ee7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:11.858636 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d660a954-9dd6-4f7a-8762-c91d414ffada tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:11.860732 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5eb7a41d-106c-4650-9261-ae1c5ed73ee7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:11.869244 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d660a954-9dd6-4f7a-8762-c91d414ffada tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:11.870046 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d660a954-9dd6-4f7a-8762-c91d414ffada tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:11.871325 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d660a954-9dd6-4f7a-8762-c91d414ffada tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:11.872146 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d660a954-9dd6-4f7a-8762-c91d414ffada tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:11.872410 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5eb7a41d-106c-4650-9261-ae1c5ed73ee7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:11.872938 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5eb7a41d-106c-4650-9261-ae1c5ed73ee7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:11.874604 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5eb7a41d-106c-4650-9261-ae1c5ed73ee7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:11.875120 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5eb7a41d-106c-4650-9261-ae1c5ed73ee7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:11.903119 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d660a954-9dd6-4f7a-8762-c91d414ffada tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053017 May 03 09:09:11.903702 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 398/977] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:11 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:11.904372 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5eb7a41d-106c-4650-9261-ae1c5ed73ee7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052825 May 03 09:09:11.908184 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 580/978] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:11 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:12.915544 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a1717868-f960-46e2-ab69-79c1d9c34265 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:12.916192 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-525a4d68-09f7-4e62-a01f-5640fe5cd28b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:12.916563 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a1717868-f960-46e2-ab69-79c1d9c34265 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:12.916843 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-525a4d68-09f7-4e62-a01f-5640fe5cd28b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:12.923335 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a1717868-f960-46e2-ab69-79c1d9c34265 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:12.923598 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-525a4d68-09f7-4e62-a01f-5640fe5cd28b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:12.923812 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a1717868-f960-46e2-ab69-79c1d9c34265 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:12.924153 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-525a4d68-09f7-4e62-a01f-5640fe5cd28b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:12.924574 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a1717868-f960-46e2-ab69-79c1d9c34265 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:12.925018 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a1717868-f960-46e2-ab69-79c1d9c34265 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:12.925180 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-525a4d68-09f7-4e62-a01f-5640fe5cd28b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:12.925672 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-525a4d68-09f7-4e62-a01f-5640fe5cd28b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:12.956967 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a1717868-f960-46e2-ab69-79c1d9c34265 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044724 May 03 09:09:12.956967 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 399/979] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:12 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:12.957326 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-525a4d68-09f7-4e62-a01f-5640fe5cd28b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045238 May 03 09:09:12.958192 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 581/980] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:12 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:13.970809 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-3c6c47d5-c267-486d-be7c-32c390525b80 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:13.971798 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-3c6c47d5-c267-486d-be7c-32c390525b80 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:13.972209 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f58198da-f54c-4003-a85d-d294a1c79d7e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:13.973200 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f58198da-f54c-4003-a85d-d294a1c79d7e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:13.978938 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3c6c47d5-c267-486d-be7c-32c390525b80 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:13.979403 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3c6c47d5-c267-486d-be7c-32c390525b80 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:13.979862 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f58198da-f54c-4003-a85d-d294a1c79d7e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:13.980238 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3c6c47d5-c267-486d-be7c-32c390525b80 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:13.980489 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f58198da-f54c-4003-a85d-d294a1c79d7e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:13.980703 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3c6c47d5-c267-486d-be7c-32c390525b80 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:13.981158 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f58198da-f54c-4003-a85d-d294a1c79d7e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:13.981597 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f58198da-f54c-4003-a85d-d294a1c79d7e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:14.012952 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-3c6c47d5-c267-486d-be7c-32c390525b80 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047186 May 03 09:09:14.013147 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 400/981] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:13 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:14.016091 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f58198da-f54c-4003-a85d-d294a1c79d7e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049444 May 03 09:09:14.016658 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 582/982] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:13 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:15.027633 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-37fa1e60-4bd5-4332-a9fd-f0fadb3765f6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:15.029173 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-37fa1e60-4bd5-4332-a9fd-f0fadb3765f6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:15.030637 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-086c4cd0-8340-437e-b9e6-a8b815b5f641 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:15.032023 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-086c4cd0-8340-437e-b9e6-a8b815b5f641 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:15.036794 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-37fa1e60-4bd5-4332-a9fd-f0fadb3765f6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:15.037218 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-37fa1e60-4bd5-4332-a9fd-f0fadb3765f6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:15.038015 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-37fa1e60-4bd5-4332-a9fd-f0fadb3765f6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:15.038230 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-086c4cd0-8340-437e-b9e6-a8b815b5f641 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:15.038427 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-37fa1e60-4bd5-4332-a9fd-f0fadb3765f6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:15.038737 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-086c4cd0-8340-437e-b9e6-a8b815b5f641 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:15.039435 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-086c4cd0-8340-437e-b9e6-a8b815b5f641 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:15.039906 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-086c4cd0-8340-437e-b9e6-a8b815b5f641 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:15.068799 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-37fa1e60-4bd5-4332-a9fd-f0fadb3765f6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047711 May 03 09:09:15.069411 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 401/983] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:15 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:15.069552 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-086c4cd0-8340-437e-b9e6-a8b815b5f641 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045403 May 03 09:09:15.069969 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 583/984] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:15 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:15.515218 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 09:09:15.515218 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: Tue May 3 09:09:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 03 09:09:16.084706 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7855c7a0-dbbb-4346-8c09-326e6564c941 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:16.085529 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-748fc1e7-7b02-4a74-a9e6-d51a4cc3c8bb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:16.086157 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7855c7a0-dbbb-4346-8c09-326e6564c941 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:16.086347 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-748fc1e7-7b02-4a74-a9e6-d51a4cc3c8bb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:16.095288 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-748fc1e7-7b02-4a74-a9e6-d51a4cc3c8bb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:16.095804 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7855c7a0-dbbb-4346-8c09-326e6564c941 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:16.096152 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-748fc1e7-7b02-4a74-a9e6-d51a4cc3c8bb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:16.096302 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7855c7a0-dbbb-4346-8c09-326e6564c941 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:16.096922 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-748fc1e7-7b02-4a74-a9e6-d51a4cc3c8bb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:16.097057 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7855c7a0-dbbb-4346-8c09-326e6564c941 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:16.097353 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-748fc1e7-7b02-4a74-a9e6-d51a4cc3c8bb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:16.097498 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7855c7a0-dbbb-4346-8c09-326e6564c941 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:16.128520 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-748fc1e7-7b02-4a74-a9e6-d51a4cc3c8bb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050261 May 03 09:09:16.129456 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 584/985] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:16 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 09:09:16.134917 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7855c7a0-dbbb-4346-8c09-326e6564c941 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056816 May 03 09:09:16.135659 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 402/986] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:16 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:17.139432 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5efcd9d3-e36c-4431-b6b5-d6ca8967baee tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:17.140405 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5efcd9d3-e36c-4431-b6b5-d6ca8967baee tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:17.146875 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-97b42895-4645-4400-83ba-6051085bf7cc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:17.147436 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5efcd9d3-e36c-4431-b6b5-d6ca8967baee tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:17.147840 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-97b42895-4645-4400-83ba-6051085bf7cc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:17.147990 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5efcd9d3-e36c-4431-b6b5-d6ca8967baee tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:17.148592 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5efcd9d3-e36c-4431-b6b5-d6ca8967baee tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:17.149060 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5efcd9d3-e36c-4431-b6b5-d6ca8967baee tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:17.154281 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-97b42895-4645-4400-83ba-6051085bf7cc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:17.154646 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-97b42895-4645-4400-83ba-6051085bf7cc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:17.155420 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-97b42895-4645-4400-83ba-6051085bf7cc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:17.155876 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-97b42895-4645-4400-83ba-6051085bf7cc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:17.179638 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5efcd9d3-e36c-4431-b6b5-d6ca8967baee tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044127 May 03 09:09:17.180257 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 585/987] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:17 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:17.189627 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-97b42895-4645-4400-83ba-6051085bf7cc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046829 May 03 09:09:17.190467 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 403/988] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:17 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:18.192106 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-0c54e6f4-33eb-4c5b-93f4-dc374b262056 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:18.193086 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-0c54e6f4-33eb-4c5b-93f4-dc374b262056 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:18.200415 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0c54e6f4-33eb-4c5b-93f4-dc374b262056 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:18.200976 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0c54e6f4-33eb-4c5b-93f4-dc374b262056 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:18.201773 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0c54e6f4-33eb-4c5b-93f4-dc374b262056 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:18.202204 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0c54e6f4-33eb-4c5b-93f4-dc374b262056 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:18.202578 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4cd388d5-01f1-488f-a6a3-72a020d67e5c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:18.204190 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4cd388d5-01f1-488f-a6a3-72a020d67e5c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:18.212903 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4cd388d5-01f1-488f-a6a3-72a020d67e5c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:18.213452 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4cd388d5-01f1-488f-a6a3-72a020d67e5c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:18.214280 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4cd388d5-01f1-488f-a6a3-72a020d67e5c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:18.214777 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4cd388d5-01f1-488f-a6a3-72a020d67e5c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:18.233370 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-0c54e6f4-33eb-4c5b-93f4-dc374b262056 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045566 May 03 09:09:18.238290 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 586/989] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:18 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:18.244893 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-4cd388d5-01f1-488f-a6a3-72a020d67e5c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046452 May 03 09:09:18.246730 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 404/990] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:18 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:19.246097 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-954372b8-f7d0-43ca-91c7-2a7a471db54c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:19.247070 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-954372b8-f7d0-43ca-91c7-2a7a471db54c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:19.254021 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-954372b8-f7d0-43ca-91c7-2a7a471db54c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:19.254473 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-954372b8-f7d0-43ca-91c7-2a7a471db54c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:19.255253 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-954372b8-f7d0-43ca-91c7-2a7a471db54c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:19.255692 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-954372b8-f7d0-43ca-91c7-2a7a471db54c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:19.257270 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6608686e-8faf-49eb-b50e-98aac1f3e243 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:19.258319 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6608686e-8faf-49eb-b50e-98aac1f3e243 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:19.265026 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6608686e-8faf-49eb-b50e-98aac1f3e243 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:19.265508 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6608686e-8faf-49eb-b50e-98aac1f3e243 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:19.266276 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6608686e-8faf-49eb-b50e-98aac1f3e243 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:19.266708 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6608686e-8faf-49eb-b50e-98aac1f3e243 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:19.286965 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-954372b8-f7d0-43ca-91c7-2a7a471db54c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044872 May 03 09:09:19.287990 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 587/991] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:19 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:19.299119 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6608686e-8faf-49eb-b50e-98aac1f3e243 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046069 May 03 09:09:19.299706 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 405/992] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:19 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:20.300421 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-4cc2aafd-3cba-4cce-81b7-2721474630d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:20.301424 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-4cc2aafd-3cba-4cce-81b7-2721474630d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:20.308044 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4cc2aafd-3cba-4cce-81b7-2721474630d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:20.308491 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4cc2aafd-3cba-4cce-81b7-2721474630d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:20.309244 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4cc2aafd-3cba-4cce-81b7-2721474630d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:20.309670 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4cc2aafd-3cba-4cce-81b7-2721474630d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:20.310497 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5c546b37-14a7-41c3-bc31-6fdd5571c22d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:20.311428 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5c546b37-14a7-41c3-bc31-6fdd5571c22d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:20.318204 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5c546b37-14a7-41c3-bc31-6fdd5571c22d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:20.318670 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5c546b37-14a7-41c3-bc31-6fdd5571c22d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:20.319448 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5c546b37-14a7-41c3-bc31-6fdd5571c22d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:20.319930 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5c546b37-14a7-41c3-bc31-6fdd5571c22d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:20.351349 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5c546b37-14a7-41c3-bc31-6fdd5571c22d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044766 May 03 09:09:20.351602 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-4cc2aafd-3cba-4cce-81b7-2721474630d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054908 May 03 09:09:20.352217 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 588/993] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:20 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:20.352351 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 406/994] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:20 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:21.362691 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f51fbfaa-be73-47c0-8ea0-478700a7772d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:21.363230 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-af9eab9f-2e44-41a7-9f46-8a0ee595642c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:21.363593 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f51fbfaa-be73-47c0-8ea0-478700a7772d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:21.363811 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-af9eab9f-2e44-41a7-9f46-8a0ee595642c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:21.369971 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-af9eab9f-2e44-41a7-9f46-8a0ee595642c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:21.370122 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f51fbfaa-be73-47c0-8ea0-478700a7772d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:21.370453 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-af9eab9f-2e44-41a7-9f46-8a0ee595642c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:21.370617 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f51fbfaa-be73-47c0-8ea0-478700a7772d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:21.371225 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-af9eab9f-2e44-41a7-9f46-8a0ee595642c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:21.371367 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f51fbfaa-be73-47c0-8ea0-478700a7772d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:21.371666 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-af9eab9f-2e44-41a7-9f46-8a0ee595642c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:21.371846 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f51fbfaa-be73-47c0-8ea0-478700a7772d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:21.401556 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f51fbfaa-be73-47c0-8ea0-478700a7772d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042837 May 03 09:09:21.405432 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-af9eab9f-2e44-41a7-9f46-8a0ee595642c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043153 May 03 09:09:21.405593 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 589/995] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:21 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:21.405694 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 407/996] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:21 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:22.413435 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ee24c717-dfb2-4d6c-a0cf-bd650de1e0c2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:22.413992 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7b5b00ed-24d7-4e19-897a-2cfe2f3366ad tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:22.414369 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ee24c717-dfb2-4d6c-a0cf-bd650de1e0c2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:22.414473 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7b5b00ed-24d7-4e19-897a-2cfe2f3366ad tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:22.420771 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ee24c717-dfb2-4d6c-a0cf-bd650de1e0c2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:22.420971 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7b5b00ed-24d7-4e19-897a-2cfe2f3366ad tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:22.421225 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ee24c717-dfb2-4d6c-a0cf-bd650de1e0c2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:22.421411 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7b5b00ed-24d7-4e19-897a-2cfe2f3366ad tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:22.422003 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ee24c717-dfb2-4d6c-a0cf-bd650de1e0c2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:22.422150 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7b5b00ed-24d7-4e19-897a-2cfe2f3366ad tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:22.422435 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ee24c717-dfb2-4d6c-a0cf-bd650de1e0c2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:22.422593 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7b5b00ed-24d7-4e19-897a-2cfe2f3366ad tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:22.451648 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7b5b00ed-24d7-4e19-897a-2cfe2f3366ad tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042038 May 03 09:09:22.452475 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 408/997] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:22 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:22.452678 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ee24c717-dfb2-4d6c-a0cf-bd650de1e0c2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043281 May 03 09:09:22.453239 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 590/998] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:22 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 09:09:23.463694 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f909b147-318e-4d7f-a7cd-ec8091797beb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:23.464404 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-52673da4-7dad-4d23-b923-13b4f4e2bfc0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:23.464825 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f909b147-318e-4d7f-a7cd-ec8091797beb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:23.465366 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-52673da4-7dad-4d23-b923-13b4f4e2bfc0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:23.472481 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f909b147-318e-4d7f-a7cd-ec8091797beb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:23.472666 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-52673da4-7dad-4d23-b923-13b4f4e2bfc0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:23.472817 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f909b147-318e-4d7f-a7cd-ec8091797beb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:23.472936 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-52673da4-7dad-4d23-b923-13b4f4e2bfc0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:23.473631 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f909b147-318e-4d7f-a7cd-ec8091797beb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:23.473777 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-52673da4-7dad-4d23-b923-13b4f4e2bfc0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:23.474072 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-52673da4-7dad-4d23-b923-13b4f4e2bfc0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:23.474239 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f909b147-318e-4d7f-a7cd-ec8091797beb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:23.504150 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f909b147-318e-4d7f-a7cd-ec8091797beb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044202 May 03 09:09:23.505046 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 409/999] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:23 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:23.506103 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-52673da4-7dad-4d23-b923-13b4f4e2bfc0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045588 May 03 09:09:23.506840 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 591/1000] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:23 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:24.516552 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f0dbeafe-bf6c-4197-9a20-44c766ae3ab0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:24.517680 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f0dbeafe-bf6c-4197-9a20-44c766ae3ab0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:24.518756 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c905ba1c-eac4-4498-a661-6e6332306d5b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:24.527946 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c905ba1c-eac4-4498-a661-6e6332306d5b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:24.528071 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f0dbeafe-bf6c-4197-9a20-44c766ae3ab0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:24.528071 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f0dbeafe-bf6c-4197-9a20-44c766ae3ab0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:24.528071 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f0dbeafe-bf6c-4197-9a20-44c766ae3ab0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:24.528071 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f0dbeafe-bf6c-4197-9a20-44c766ae3ab0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:24.528429 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c905ba1c-eac4-4498-a661-6e6332306d5b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:24.528429 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c905ba1c-eac4-4498-a661-6e6332306d5b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:24.528429 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c905ba1c-eac4-4498-a661-6e6332306d5b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:24.528429 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c905ba1c-eac4-4498-a661-6e6332306d5b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:24.556365 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f0dbeafe-bf6c-4197-9a20-44c766ae3ab0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043761 May 03 09:09:24.560316 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 410/1001] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:24 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:24.560456 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c905ba1c-eac4-4498-a661-6e6332306d5b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043672 May 03 09:09:24.560456 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 592/1002] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:24 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:25.570929 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-bbc79f06-f153-42d4-acf4-4ef96b78e393 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:25.571437 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-7fd102f0-fa2c-44e9-acbc-f481b349d1d2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:25.571835 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-bbc79f06-f153-42d4-acf4-4ef96b78e393 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:25.571947 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-7fd102f0-fa2c-44e9-acbc-f481b349d1d2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:25.578281 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bbc79f06-f153-42d4-acf4-4ef96b78e393 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:25.578461 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7fd102f0-fa2c-44e9-acbc-f481b349d1d2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:25.578730 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bbc79f06-f153-42d4-acf4-4ef96b78e393 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:25.578875 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7fd102f0-fa2c-44e9-acbc-f481b349d1d2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:25.579521 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bbc79f06-f153-42d4-acf4-4ef96b78e393 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:25.579656 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7fd102f0-fa2c-44e9-acbc-f481b349d1d2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:25.579980 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bbc79f06-f153-42d4-acf4-4ef96b78e393 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:25.580138 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7fd102f0-fa2c-44e9-acbc-f481b349d1d2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:25.610285 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-7fd102f0-fa2c-44e9-acbc-f481b349d1d2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043245 May 03 09:09:25.611162 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 593/1003] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:25 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:25.616471 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-bbc79f06-f153-42d4-acf4-4ef96b78e393 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049499 May 03 09:09:25.617239 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 411/1004] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:25 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:26.622823 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-de35530c-9faf-461d-a1f0-f77a115b7ebb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:26.623383 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-de35530c-9faf-461d-a1f0-f77a115b7ebb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:26.628931 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-201f7770-4b4c-4b5c-a214-6c735c3763d8 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:26.630662 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-201f7770-4b4c-4b5c-a214-6c735c3763d8 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:26.633001 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-de35530c-9faf-461d-a1f0-f77a115b7ebb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:26.633732 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-de35530c-9faf-461d-a1f0-f77a115b7ebb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:26.634781 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-de35530c-9faf-461d-a1f0-f77a115b7ebb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:26.635240 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-de35530c-9faf-461d-a1f0-f77a115b7ebb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:26.638246 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-201f7770-4b4c-4b5c-a214-6c735c3763d8 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:26.638750 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-201f7770-4b4c-4b5c-a214-6c735c3763d8 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:26.639609 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-201f7770-4b4c-4b5c-a214-6c735c3763d8 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:26.640305 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-201f7770-4b4c-4b5c-a214-6c735c3763d8 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:26.668574 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-de35530c-9faf-461d-a1f0-f77a115b7ebb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050675 May 03 09:09:26.669050 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 594/1005] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:26 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:26.681757 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-201f7770-4b4c-4b5c-a214-6c735c3763d8 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057465 May 03 09:09:26.682458 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 412/1006] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:26 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:27.683651 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-223f025d-d9d7-4d33-8c5d-355193a0a7d5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:27.685153 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-223f025d-d9d7-4d33-8c5d-355193a0a7d5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:27.694459 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-223f025d-d9d7-4d33-8c5d-355193a0a7d5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:27.694819 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-21a00847-b049-4fbc-bc75-7628323ed8ad tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:27.695288 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-223f025d-d9d7-4d33-8c5d-355193a0a7d5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:27.695682 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-223f025d-d9d7-4d33-8c5d-355193a0a7d5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:27.696130 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-21a00847-b049-4fbc-bc75-7628323ed8ad tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:27.696291 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-223f025d-d9d7-4d33-8c5d-355193a0a7d5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:27.702638 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-21a00847-b049-4fbc-bc75-7628323ed8ad tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:27.703091 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-21a00847-b049-4fbc-bc75-7628323ed8ad tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:27.703960 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-21a00847-b049-4fbc-bc75-7628323ed8ad tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:27.704396 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-21a00847-b049-4fbc-bc75-7628323ed8ad tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:27.726233 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-223f025d-d9d7-4d33-8c5d-355193a0a7d5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049188 May 03 09:09:27.727109 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 595/1007] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:27 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:27.738269 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-21a00847-b049-4fbc-bc75-7628323ed8ad tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047875 May 03 09:09:27.738813 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 413/1008] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:27 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:28.742880 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-171821da-6ba5-4021-b1e0-67a7addae036 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:28.744620 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-171821da-6ba5-4021-b1e0-67a7addae036 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:28.753864 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-dbc61809-6456-45d6-a821-1d7d5aa3592e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:28.754314 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-171821da-6ba5-4021-b1e0-67a7addae036 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:28.754424 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-171821da-6ba5-4021-b1e0-67a7addae036 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:28.754786 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-dbc61809-6456-45d6-a821-1d7d5aa3592e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:28.755174 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-171821da-6ba5-4021-b1e0-67a7addae036 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:28.755604 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-171821da-6ba5-4021-b1e0-67a7addae036 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:28.761351 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dbc61809-6456-45d6-a821-1d7d5aa3592e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:28.761857 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dbc61809-6456-45d6-a821-1d7d5aa3592e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:28.762629 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dbc61809-6456-45d6-a821-1d7d5aa3592e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:28.763061 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dbc61809-6456-45d6-a821-1d7d5aa3592e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:28.784945 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-171821da-6ba5-4021-b1e0-67a7addae036 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049407 May 03 09:09:28.785558 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 596/1009] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:28 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:28.793438 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-dbc61809-6456-45d6-a821-1d7d5aa3592e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046433 May 03 09:09:28.793975 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 414/1010] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:28 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:29.801191 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-333d7089-f676-4049-afa6-2f32cfeafab3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:29.802219 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-333d7089-f676-4049-afa6-2f32cfeafab3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:29.806935 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-8e30af56-01df-49a6-8726-834051bdfc66 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:29.807995 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-8e30af56-01df-49a6-8726-834051bdfc66 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:29.809953 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-333d7089-f676-4049-afa6-2f32cfeafab3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:29.810313 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-333d7089-f676-4049-afa6-2f32cfeafab3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:29.811165 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-333d7089-f676-4049-afa6-2f32cfeafab3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:29.811644 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-333d7089-f676-4049-afa6-2f32cfeafab3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:29.815509 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8e30af56-01df-49a6-8726-834051bdfc66 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:29.816978 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8e30af56-01df-49a6-8726-834051bdfc66 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:29.817857 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8e30af56-01df-49a6-8726-834051bdfc66 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:29.818346 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8e30af56-01df-49a6-8726-834051bdfc66 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:29.844203 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-333d7089-f676-4049-afa6-2f32cfeafab3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049614 May 03 09:09:29.848352 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 597/1011] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:29 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:29.851605 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-8e30af56-01df-49a6-8726-834051bdfc66 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049240 May 03 09:09:29.852178 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 415/1012] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:29 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:30.860580 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-cfb50b7d-0896-44c3-968a-9c6ac9bd4cac tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:30.862054 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-cfb50b7d-0896-44c3-968a-9c6ac9bd4cac tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:30.868853 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-8cff943f-cfec-4742-826d-bcd6ff1f2ba2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:30.870380 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-8cff943f-cfec-4742-826d-bcd6ff1f2ba2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:30.876616 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cfb50b7d-0896-44c3-968a-9c6ac9bd4cac tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:30.877786 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cfb50b7d-0896-44c3-968a-9c6ac9bd4cac tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:30.879129 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cfb50b7d-0896-44c3-968a-9c6ac9bd4cac tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:30.879561 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cfb50b7d-0896-44c3-968a-9c6ac9bd4cac tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:30.880170 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8cff943f-cfec-4742-826d-bcd6ff1f2ba2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:30.880615 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8cff943f-cfec-4742-826d-bcd6ff1f2ba2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:30.881399 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8cff943f-cfec-4742-826d-bcd6ff1f2ba2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:30.881793 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8cff943f-cfec-4742-826d-bcd6ff1f2ba2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:30.909946 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-cfb50b7d-0896-44c3-968a-9c6ac9bd4cac tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056064 May 03 09:09:30.910923 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 598/1013] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:30 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:30.922206 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-8cff943f-cfec-4742-826d-bcd6ff1f2ba2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055938 May 03 09:09:30.922206 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 416/1014] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:30 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:31.925417 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-6bb460ca-2d8d-42a8-9ea5-59c3e3b25100 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:31.926557 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-6bb460ca-2d8d-42a8-9ea5-59c3e3b25100 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:31.929537 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a03299ec-bf46-4a0a-a543-7a179a8ae75d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:31.929949 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a03299ec-bf46-4a0a-a543-7a179a8ae75d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:31.932929 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6bb460ca-2d8d-42a8-9ea5-59c3e3b25100 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:31.933286 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6bb460ca-2d8d-42a8-9ea5-59c3e3b25100 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:31.934045 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6bb460ca-2d8d-42a8-9ea5-59c3e3b25100 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:31.934481 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6bb460ca-2d8d-42a8-9ea5-59c3e3b25100 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:31.936514 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a03299ec-bf46-4a0a-a543-7a179a8ae75d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:31.936972 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a03299ec-bf46-4a0a-a543-7a179a8ae75d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:31.937749 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a03299ec-bf46-4a0a-a543-7a179a8ae75d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:31.939222 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a03299ec-bf46-4a0a-a543-7a179a8ae75d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:31.964834 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-6bb460ca-2d8d-42a8-9ea5-59c3e3b25100 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046199 May 03 09:09:31.968579 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 599/1015] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:31 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:31.971616 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a03299ec-bf46-4a0a-a543-7a179a8ae75d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047626 May 03 09:09:31.972203 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 417/1016] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:31 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:32.981688 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-1aa15c54-0935-4d91-a5c0-bfa314357c12 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:32.983387 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-1aa15c54-0935-4d91-a5c0-bfa314357c12 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:32.990821 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ca5cf31b-34cc-4807-85ef-61494c5d2c22 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:32.992723 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ca5cf31b-34cc-4807-85ef-61494c5d2c22 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:32.995481 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1aa15c54-0935-4d91-a5c0-bfa314357c12 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:32.996209 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1aa15c54-0935-4d91-a5c0-bfa314357c12 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:32.997529 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1aa15c54-0935-4d91-a5c0-bfa314357c12 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:32.998199 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1aa15c54-0935-4d91-a5c0-bfa314357c12 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:33.003557 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ca5cf31b-34cc-4807-85ef-61494c5d2c22 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:33.004289 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ca5cf31b-34cc-4807-85ef-61494c5d2c22 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:33.005824 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ca5cf31b-34cc-4807-85ef-61494c5d2c22 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:33.006480 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ca5cf31b-34cc-4807-85ef-61494c5d2c22 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:33.039487 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ca5cf31b-34cc-4807-85ef-61494c5d2c22 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055173 May 03 09:09:33.039487 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 418/1017] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:32 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:33.197033 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-1aa15c54-0935-4d91-a5c0-bfa314357c12 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.222463 May 03 09:09:33.197578 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 600/1018] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:32 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:34.054010 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5975405c-c8f3-48a4-9dd6-ecbae41b972b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:34.054946 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5975405c-c8f3-48a4-9dd6-ecbae41b972b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:34.061576 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5975405c-c8f3-48a4-9dd6-ecbae41b972b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:34.062053 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5975405c-c8f3-48a4-9dd6-ecbae41b972b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:34.062816 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5975405c-c8f3-48a4-9dd6-ecbae41b972b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:34.063250 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5975405c-c8f3-48a4-9dd6-ecbae41b972b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:34.092247 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5975405c-c8f3-48a4-9dd6-ecbae41b972b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044170 May 03 09:09:34.092603 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 419/1019] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:34 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:34.209020 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ac9eeb93-0ddb-437c-a944-0e5b1078b46c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:34.210053 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ac9eeb93-0ddb-437c-a944-0e5b1078b46c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:34.216842 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ac9eeb93-0ddb-437c-a944-0e5b1078b46c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:34.217298 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ac9eeb93-0ddb-437c-a944-0e5b1078b46c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:34.218072 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ac9eeb93-0ddb-437c-a944-0e5b1078b46c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:34.218546 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ac9eeb93-0ddb-437c-a944-0e5b1078b46c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:34.248766 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ac9eeb93-0ddb-437c-a944-0e5b1078b46c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043839 May 03 09:09:34.249319 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 601/1020] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:34 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:35.108534 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-46308fd5-f262-4e3c-b89e-802f7b042fd1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:35.110070 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-46308fd5-f262-4e3c-b89e-802f7b042fd1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:35.118826 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-46308fd5-f262-4e3c-b89e-802f7b042fd1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:35.119258 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-46308fd5-f262-4e3c-b89e-802f7b042fd1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:35.120090 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-46308fd5-f262-4e3c-b89e-802f7b042fd1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:35.120527 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-46308fd5-f262-4e3c-b89e-802f7b042fd1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:35.159710 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-46308fd5-f262-4e3c-b89e-802f7b042fd1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052304 May 03 09:09:35.162013 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 420/1021] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:35 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:35.260921 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3710a98b-2193-45e3-9922-74c1965166cd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:35.261839 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-3710a98b-2193-45e3-9922-74c1965166cd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:35.270399 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3710a98b-2193-45e3-9922-74c1965166cd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:35.270855 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3710a98b-2193-45e3-9922-74c1965166cd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:35.272366 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3710a98b-2193-45e3-9922-74c1965166cd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:35.272366 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3710a98b-2193-45e3-9922-74c1965166cd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:35.301294 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-3710a98b-2193-45e3-9922-74c1965166cd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044297 May 03 09:09:35.301834 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 602/1022] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:35 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 09:09:36.173766 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c6ec8fe6-ca76-4381-97ae-3bd25fc1d934 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:36.175279 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c6ec8fe6-ca76-4381-97ae-3bd25fc1d934 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:36.185371 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c6ec8fe6-ca76-4381-97ae-3bd25fc1d934 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:36.186129 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c6ec8fe6-ca76-4381-97ae-3bd25fc1d934 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:36.187394 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c6ec8fe6-ca76-4381-97ae-3bd25fc1d934 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:36.188168 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c6ec8fe6-ca76-4381-97ae-3bd25fc1d934 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:36.222243 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c6ec8fe6-ca76-4381-97ae-3bd25fc1d934 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055235 May 03 09:09:36.222881 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 421/1023] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:36 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 09:09:36.317136 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c3193f6d-8e7e-441f-80d2-11301acdd690 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:36.318324 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c3193f6d-8e7e-441f-80d2-11301acdd690 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:36.324803 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c3193f6d-8e7e-441f-80d2-11301acdd690 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:36.325238 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c3193f6d-8e7e-441f-80d2-11301acdd690 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:36.325996 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c3193f6d-8e7e-441f-80d2-11301acdd690 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:36.326418 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c3193f6d-8e7e-441f-80d2-11301acdd690 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:36.354331 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c3193f6d-8e7e-441f-80d2-11301acdd690 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043181 May 03 09:09:36.354876 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 603/1024] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:36 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:37.234532 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e852c3c4-7d3b-44ce-8646-088c46d58a00 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:37.235515 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e852c3c4-7d3b-44ce-8646-088c46d58a00 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:37.242867 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e852c3c4-7d3b-44ce-8646-088c46d58a00 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:37.243288 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e852c3c4-7d3b-44ce-8646-088c46d58a00 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:37.244129 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e852c3c4-7d3b-44ce-8646-088c46d58a00 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:37.244575 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e852c3c4-7d3b-44ce-8646-088c46d58a00 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:37.273958 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e852c3c4-7d3b-44ce-8646-088c46d58a00 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043464 May 03 09:09:37.274524 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 422/1025] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:37 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:37.365874 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5bcc8496-9a76-4a73-91db-2348213b05e4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:37.366862 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5bcc8496-9a76-4a73-91db-2348213b05e4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:37.373647 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5bcc8496-9a76-4a73-91db-2348213b05e4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:37.374073 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5bcc8496-9a76-4a73-91db-2348213b05e4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:37.374859 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5bcc8496-9a76-4a73-91db-2348213b05e4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:37.375294 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5bcc8496-9a76-4a73-91db-2348213b05e4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:37.405187 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5bcc8496-9a76-4a73-91db-2348213b05e4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043295 May 03 09:09:37.405773 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 604/1026] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:37 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:38.290377 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-30a9cf27-23fd-407d-93b3-2f0393c9a074 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:38.291853 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-30a9cf27-23fd-407d-93b3-2f0393c9a074 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:38.306238 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-30a9cf27-23fd-407d-93b3-2f0393c9a074 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:38.306697 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-30a9cf27-23fd-407d-93b3-2f0393c9a074 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:38.307524 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-30a9cf27-23fd-407d-93b3-2f0393c9a074 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:38.307973 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-30a9cf27-23fd-407d-93b3-2f0393c9a074 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:38.338117 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-30a9cf27-23fd-407d-93b3-2f0393c9a074 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054721 May 03 09:09:38.339156 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 423/1027] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:38 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:38.417040 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-76cb7273-75b3-4bc6-a9a3-419f608b30b8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:38.417983 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-76cb7273-75b3-4bc6-a9a3-419f608b30b8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:38.424490 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-76cb7273-75b3-4bc6-a9a3-419f608b30b8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:38.425000 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-76cb7273-75b3-4bc6-a9a3-419f608b30b8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:38.425819 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-76cb7273-75b3-4bc6-a9a3-419f608b30b8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:38.426283 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-76cb7273-75b3-4bc6-a9a3-419f608b30b8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:38.455437 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-76cb7273-75b3-4bc6-a9a3-419f608b30b8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042486 May 03 09:09:38.456034 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 605/1028] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:38 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:39.354670 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-26404622-b1f5-4be2-85df-d977ef761f5e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:39.355952 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-26404622-b1f5-4be2-85df-d977ef761f5e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:39.364890 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-26404622-b1f5-4be2-85df-d977ef761f5e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:39.365546 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-26404622-b1f5-4be2-85df-d977ef761f5e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:39.366649 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-26404622-b1f5-4be2-85df-d977ef761f5e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:39.367396 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-26404622-b1f5-4be2-85df-d977ef761f5e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:39.403050 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-26404622-b1f5-4be2-85df-d977ef761f5e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054783 May 03 09:09:39.403608 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 424/1029] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:39 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:39.466819 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f01c3ea5-8f53-4821-a5c2-fced2ac4221f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:39.467645 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f01c3ea5-8f53-4821-a5c2-fced2ac4221f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:39.475139 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f01c3ea5-8f53-4821-a5c2-fced2ac4221f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:39.475650 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f01c3ea5-8f53-4821-a5c2-fced2ac4221f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:39.476518 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f01c3ea5-8f53-4821-a5c2-fced2ac4221f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:39.477003 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f01c3ea5-8f53-4821-a5c2-fced2ac4221f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:39.509138 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f01c3ea5-8f53-4821-a5c2-fced2ac4221f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046265 May 03 09:09:39.509686 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 606/1030] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:39 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:40.419207 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-848c8b10-78e8-406c-8398-cda43dca5809 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:40.420638 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-848c8b10-78e8-406c-8398-cda43dca5809 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:40.431501 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-848c8b10-78e8-406c-8398-cda43dca5809 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:40.431981 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-848c8b10-78e8-406c-8398-cda43dca5809 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:40.432783 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-848c8b10-78e8-406c-8398-cda43dca5809 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:40.433212 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-848c8b10-78e8-406c-8398-cda43dca5809 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:40.462855 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-848c8b10-78e8-406c-8398-cda43dca5809 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050569 May 03 09:09:40.463452 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 425/1031] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:40 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:40.520330 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f097a8ad-d6d0-45df-b3d7-e2382d4e6f42 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:40.521851 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f097a8ad-d6d0-45df-b3d7-e2382d4e6f42 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:40.528482 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f097a8ad-d6d0-45df-b3d7-e2382d4e6f42 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:40.528945 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f097a8ad-d6d0-45df-b3d7-e2382d4e6f42 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:40.529702 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f097a8ad-d6d0-45df-b3d7-e2382d4e6f42 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:40.530122 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f097a8ad-d6d0-45df-b3d7-e2382d4e6f42 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:40.558180 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f097a8ad-d6d0-45df-b3d7-e2382d4e6f42 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041734 May 03 09:09:40.558723 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 607/1032] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:40 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:41.479122 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-cee281e2-3b99-40a4-bba8-8d68baeb7059 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:41.480187 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-cee281e2-3b99-40a4-bba8-8d68baeb7059 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:41.487947 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cee281e2-3b99-40a4-bba8-8d68baeb7059 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:41.488503 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cee281e2-3b99-40a4-bba8-8d68baeb7059 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:41.489452 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cee281e2-3b99-40a4-bba8-8d68baeb7059 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:41.489989 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cee281e2-3b99-40a4-bba8-8d68baeb7059 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:41.523363 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-cee281e2-3b99-40a4-bba8-8d68baeb7059 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051095 May 03 09:09:41.523960 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 426/1033] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:41 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:41.569907 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3777954b-d8e9-4242-b5fd-545168bf5665 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:41.570848 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-3777954b-d8e9-4242-b5fd-545168bf5665 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:41.577582 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3777954b-d8e9-4242-b5fd-545168bf5665 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:41.578057 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3777954b-d8e9-4242-b5fd-545168bf5665 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:41.578826 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3777954b-d8e9-4242-b5fd-545168bf5665 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:41.579236 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3777954b-d8e9-4242-b5fd-545168bf5665 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:41.607964 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-3777954b-d8e9-4242-b5fd-545168bf5665 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041976 May 03 09:09:41.608525 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 608/1034] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:41 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:42.539632 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f379f9e3-499a-4530-8064-b07bd9372786 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:42.541066 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f379f9e3-499a-4530-8064-b07bd9372786 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:42.548590 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f379f9e3-499a-4530-8064-b07bd9372786 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:42.549122 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f379f9e3-499a-4530-8064-b07bd9372786 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:42.549982 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f379f9e3-499a-4530-8064-b07bd9372786 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:42.550466 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f379f9e3-499a-4530-8064-b07bd9372786 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:42.582280 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f379f9e3-499a-4530-8064-b07bd9372786 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049415 May 03 09:09:42.582841 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 427/1035] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:42 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:42.619034 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-807e8ee3-83d2-4bf1-b5a5-a3ca3c0bdc59 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:42.620082 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-807e8ee3-83d2-4bf1-b5a5-a3ca3c0bdc59 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:42.626551 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-807e8ee3-83d2-4bf1-b5a5-a3ca3c0bdc59 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:42.626984 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-807e8ee3-83d2-4bf1-b5a5-a3ca3c0bdc59 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:42.627785 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-807e8ee3-83d2-4bf1-b5a5-a3ca3c0bdc59 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:42.628232 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-807e8ee3-83d2-4bf1-b5a5-a3ca3c0bdc59 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:42.671403 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-807e8ee3-83d2-4bf1-b5a5-a3ca3c0bdc59 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056177 May 03 09:09:42.672323 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 609/1036] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:42 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:43.599505 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e465e02f-827a-421d-bc55-43b477ee83bb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:43.601836 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e465e02f-827a-421d-bc55-43b477ee83bb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:43.611533 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e465e02f-827a-421d-bc55-43b477ee83bb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:43.612341 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e465e02f-827a-421d-bc55-43b477ee83bb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:43.613609 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e465e02f-827a-421d-bc55-43b477ee83bb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:43.614293 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e465e02f-827a-421d-bc55-43b477ee83bb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:43.645711 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e465e02f-827a-421d-bc55-43b477ee83bb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054032 May 03 09:09:43.646293 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 428/1037] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:43 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:43.685184 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-97b7f03c-b2bd-4377-bd4a-55de972aef2b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:43.686125 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-97b7f03c-b2bd-4377-bd4a-55de972aef2b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:43.692922 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-97b7f03c-b2bd-4377-bd4a-55de972aef2b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:43.693381 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-97b7f03c-b2bd-4377-bd4a-55de972aef2b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:43.694127 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-97b7f03c-b2bd-4377-bd4a-55de972aef2b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:43.694572 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-97b7f03c-b2bd-4377-bd4a-55de972aef2b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:43.723696 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-97b7f03c-b2bd-4377-bd4a-55de972aef2b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042401 May 03 09:09:43.727628 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 610/1038] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:43 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:44.661822 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6f21b844-29fe-4bd9-bdcb-a44f9004f896 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:44.664268 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6f21b844-29fe-4bd9-bdcb-a44f9004f896 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:44.670953 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6f21b844-29fe-4bd9-bdcb-a44f9004f896 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:44.671399 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6f21b844-29fe-4bd9-bdcb-a44f9004f896 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:44.672205 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6f21b844-29fe-4bd9-bdcb-a44f9004f896 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:44.672632 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6f21b844-29fe-4bd9-bdcb-a44f9004f896 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:44.702269 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6f21b844-29fe-4bd9-bdcb-a44f9004f896 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047215 May 03 09:09:44.702828 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 429/1039] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:44 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:44.737144 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ccdfe91d-7336-4cb6-a11c-51adbc38f755 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:44.738205 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ccdfe91d-7336-4cb6-a11c-51adbc38f755 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:44.745399 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ccdfe91d-7336-4cb6-a11c-51adbc38f755 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:44.745823 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ccdfe91d-7336-4cb6-a11c-51adbc38f755 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:44.747133 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ccdfe91d-7336-4cb6-a11c-51adbc38f755 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:44.747946 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ccdfe91d-7336-4cb6-a11c-51adbc38f755 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:44.779038 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ccdfe91d-7336-4cb6-a11c-51adbc38f755 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045915 May 03 09:09:44.782865 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 611/1040] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:44 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:45.718514 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6bb94957-2f32-4846-8729-fea08317121e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:45.720880 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6bb94957-2f32-4846-8729-fea08317121e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:45.730995 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6bb94957-2f32-4846-8729-fea08317121e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:45.731850 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6bb94957-2f32-4846-8729-fea08317121e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:45.733106 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6bb94957-2f32-4846-8729-fea08317121e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:45.733837 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6bb94957-2f32-4846-8729-fea08317121e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:45.767047 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6bb94957-2f32-4846-8729-fea08317121e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055462 May 03 09:09:45.767621 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 430/1041] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:45 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:45.790889 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f938b50f-1b4c-4bd8-884a-ce66c8dc8737 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:45.792042 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f938b50f-1b4c-4bd8-884a-ce66c8dc8737 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:45.799658 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f938b50f-1b4c-4bd8-884a-ce66c8dc8737 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:45.800154 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f938b50f-1b4c-4bd8-884a-ce66c8dc8737 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:45.800935 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f938b50f-1b4c-4bd8-884a-ce66c8dc8737 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:45.801374 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f938b50f-1b4c-4bd8-884a-ce66c8dc8737 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:45.839390 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f938b50f-1b4c-4bd8-884a-ce66c8dc8737 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052531 May 03 09:09:45.843724 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 612/1042] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:45 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:46.779077 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6cfc17a9-82b4-4dda-8765-2c064089ad67 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:46.780138 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6cfc17a9-82b4-4dda-8765-2c064089ad67 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:46.789540 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6cfc17a9-82b4-4dda-8765-2c064089ad67 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:46.789993 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6cfc17a9-82b4-4dda-8765-2c064089ad67 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:46.790817 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6cfc17a9-82b4-4dda-8765-2c064089ad67 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:46.791263 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6cfc17a9-82b4-4dda-8765-2c064089ad67 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:46.822770 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6cfc17a9-82b4-4dda-8765-2c064089ad67 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047808 May 03 09:09:46.826598 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 431/1043] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:46 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:46.850972 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d3a1c43b-0b72-4e2f-a8dc-245b781c9bf2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:46.852010 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d3a1c43b-0b72-4e2f-a8dc-245b781c9bf2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:46.858782 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d3a1c43b-0b72-4e2f-a8dc-245b781c9bf2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:46.859224 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d3a1c43b-0b72-4e2f-a8dc-245b781c9bf2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:46.860264 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d3a1c43b-0b72-4e2f-a8dc-245b781c9bf2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:46.860672 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d3a1c43b-0b72-4e2f-a8dc-245b781c9bf2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:46.890971 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d3a1c43b-0b72-4e2f-a8dc-245b781c9bf2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044010 May 03 09:09:46.894908 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 613/1044] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:46 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:47.835068 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-cffa5335-fcfd-42ec-bae3-6a919b32cb3f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:47.836024 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-cffa5335-fcfd-42ec-bae3-6a919b32cb3f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:47.843316 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cffa5335-fcfd-42ec-bae3-6a919b32cb3f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:47.843805 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cffa5335-fcfd-42ec-bae3-6a919b32cb3f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:47.844683 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cffa5335-fcfd-42ec-bae3-6a919b32cb3f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:47.845434 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cffa5335-fcfd-42ec-bae3-6a919b32cb3f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:47.877485 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-cffa5335-fcfd-42ec-bae3-6a919b32cb3f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046573 May 03 09:09:47.878035 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 432/1045] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:47 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:47.902823 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-fae86b6e-a6da-489d-8d3e-69c0e38a1825 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:47.903756 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-fae86b6e-a6da-489d-8d3e-69c0e38a1825 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:47.911377 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fae86b6e-a6da-489d-8d3e-69c0e38a1825 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:47.911933 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fae86b6e-a6da-489d-8d3e-69c0e38a1825 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:47.912880 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fae86b6e-a6da-489d-8d3e-69c0e38a1825 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:47.913128 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fae86b6e-a6da-489d-8d3e-69c0e38a1825 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:47.952466 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-fae86b6e-a6da-489d-8d3e-69c0e38a1825 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053591 May 03 09:09:47.955713 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 614/1046] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:47 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:48.890928 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-54e3ed87-927e-49e1-8b6e-fda4487eb10c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:48.891957 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-54e3ed87-927e-49e1-8b6e-fda4487eb10c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:48.899520 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-54e3ed87-927e-49e1-8b6e-fda4487eb10c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:48.900127 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-54e3ed87-927e-49e1-8b6e-fda4487eb10c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:48.901011 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-54e3ed87-927e-49e1-8b6e-fda4487eb10c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:48.901460 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-54e3ed87-927e-49e1-8b6e-fda4487eb10c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:48.933039 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-54e3ed87-927e-49e1-8b6e-fda4487eb10c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047127 May 03 09:09:48.933639 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 433/1047] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:48 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 09:09:48.965079 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-fa590349-1e23-4710-8b04-de37f89f4416 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:48.966170 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-fa590349-1e23-4710-8b04-de37f89f4416 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:48.973062 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fa590349-1e23-4710-8b04-de37f89f4416 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:48.973495 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fa590349-1e23-4710-8b04-de37f89f4416 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:48.974262 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fa590349-1e23-4710-8b04-de37f89f4416 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:48.974703 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fa590349-1e23-4710-8b04-de37f89f4416 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:49.004698 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-fa590349-1e23-4710-8b04-de37f89f4416 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043750 May 03 09:09:49.005381 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 615/1048] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:48 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:49.947419 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-3a945d0a-6968-46d7-9d95-e302a0887a54 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:49.948385 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-3a945d0a-6968-46d7-9d95-e302a0887a54 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:49.955082 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3a945d0a-6968-46d7-9d95-e302a0887a54 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:49.956089 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3a945d0a-6968-46d7-9d95-e302a0887a54 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:49.956443 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3a945d0a-6968-46d7-9d95-e302a0887a54 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:49.956779 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3a945d0a-6968-46d7-9d95-e302a0887a54 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:49.987551 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-3a945d0a-6968-46d7-9d95-e302a0887a54 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045971 May 03 09:09:49.988165 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 434/1049] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:49 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:50.016407 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-106f2f91-f467-400b-bb46-2353f6c0d0a3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:50.017306 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-106f2f91-f467-400b-bb46-2353f6c0d0a3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:50.023568 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-106f2f91-f467-400b-bb46-2353f6c0d0a3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:50.024043 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-106f2f91-f467-400b-bb46-2353f6c0d0a3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:50.024875 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-106f2f91-f467-400b-bb46-2353f6c0d0a3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:50.025307 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-106f2f91-f467-400b-bb46-2353f6c0d0a3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:50.054777 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-106f2f91-f467-400b-bb46-2353f6c0d0a3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042304 May 03 09:09:50.055484 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 616/1050] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:50 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:51.003548 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d963654a-ff53-4e6f-832b-43d3fc9aae50 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:51.005156 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d963654a-ff53-4e6f-832b-43d3fc9aae50 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:51.015727 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d963654a-ff53-4e6f-832b-43d3fc9aae50 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:51.016558 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d963654a-ff53-4e6f-832b-43d3fc9aae50 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:51.017843 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d963654a-ff53-4e6f-832b-43d3fc9aae50 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:51.018642 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d963654a-ff53-4e6f-832b-43d3fc9aae50 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:51.051241 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d963654a-ff53-4e6f-832b-43d3fc9aae50 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054495 May 03 09:09:51.051824 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 435/1051] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:50 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:51.066796 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a38c5ff2-a2e4-4128-aed1-e72b5e73d7aa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:51.067720 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a38c5ff2-a2e4-4128-aed1-e72b5e73d7aa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:51.074529 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a38c5ff2-a2e4-4128-aed1-e72b5e73d7aa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:51.074982 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a38c5ff2-a2e4-4128-aed1-e72b5e73d7aa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:51.075791 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a38c5ff2-a2e4-4128-aed1-e72b5e73d7aa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:51.076234 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a38c5ff2-a2e4-4128-aed1-e72b5e73d7aa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:51.113396 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a38c5ff2-a2e4-4128-aed1-e72b5e73d7aa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050648 May 03 09:09:51.117182 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 617/1052] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:51 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:52.067204 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-43b278f2-a45c-4b34-9ce4-1157438d177f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:52.068796 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-43b278f2-a45c-4b34-9ce4-1157438d177f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:52.076765 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-43b278f2-a45c-4b34-9ce4-1157438d177f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:52.077220 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-43b278f2-a45c-4b34-9ce4-1157438d177f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:52.078010 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-43b278f2-a45c-4b34-9ce4-1157438d177f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:52.078449 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-43b278f2-a45c-4b34-9ce4-1157438d177f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:52.108565 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-43b278f2-a45c-4b34-9ce4-1157438d177f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047927 May 03 09:09:52.109133 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 436/1053] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:52 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:52.125653 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-8732db11-fcff-40e0-b113-a65eb351be7d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:52.126621 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-8732db11-fcff-40e0-b113-a65eb351be7d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:52.133033 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8732db11-fcff-40e0-b113-a65eb351be7d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:52.133490 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8732db11-fcff-40e0-b113-a65eb351be7d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:52.134342 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8732db11-fcff-40e0-b113-a65eb351be7d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:52.134784 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8732db11-fcff-40e0-b113-a65eb351be7d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:52.165577 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-8732db11-fcff-40e0-b113-a65eb351be7d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043931 May 03 09:09:52.166406 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 618/1054] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:52 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:53.124959 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-830f0efd-ed8d-4e36-a1bc-b50a2116a0a6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:53.126464 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-830f0efd-ed8d-4e36-a1bc-b50a2116a0a6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:53.137140 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-830f0efd-ed8d-4e36-a1bc-b50a2116a0a6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:53.137881 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-830f0efd-ed8d-4e36-a1bc-b50a2116a0a6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:53.139158 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-830f0efd-ed8d-4e36-a1bc-b50a2116a0a6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:53.139897 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-830f0efd-ed8d-4e36-a1bc-b50a2116a0a6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:53.173586 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-830f0efd-ed8d-4e36-a1bc-b50a2116a0a6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055497 May 03 09:09:53.174364 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 437/1055] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:53 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:53.177704 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3de36395-fb7c-4a4f-a254-1c2c77c09bca tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:53.178639 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-3de36395-fb7c-4a4f-a254-1c2c77c09bca tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:53.185741 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3de36395-fb7c-4a4f-a254-1c2c77c09bca tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:53.186186 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3de36395-fb7c-4a4f-a254-1c2c77c09bca tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:53.186960 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3de36395-fb7c-4a4f-a254-1c2c77c09bca tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:53.187386 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3de36395-fb7c-4a4f-a254-1c2c77c09bca tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:53.219795 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-3de36395-fb7c-4a4f-a254-1c2c77c09bca tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046449 May 03 09:09:53.220368 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 619/1056] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:53 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:54.189235 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-cb27a875-ae26-458a-8ec4-1c615d5ff495 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:54.190776 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-cb27a875-ae26-458a-8ec4-1c615d5ff495 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:54.199627 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cb27a875-ae26-458a-8ec4-1c615d5ff495 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:54.200123 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cb27a875-ae26-458a-8ec4-1c615d5ff495 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:54.200910 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cb27a875-ae26-458a-8ec4-1c615d5ff495 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:54.201369 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cb27a875-ae26-458a-8ec4-1c615d5ff495 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:54.232991 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-cb27a875-ae26-458a-8ec4-1c615d5ff495 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050475 May 03 09:09:54.233167 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9dda165b-fd09-4199-bfa0-e32a204d3477 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:54.233885 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 438/1057] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:54 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:54.238782 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9dda165b-fd09-4199-bfa0-e32a204d3477 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:54.245904 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9dda165b-fd09-4199-bfa0-e32a204d3477 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:54.246373 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9dda165b-fd09-4199-bfa0-e32a204d3477 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:54.247133 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9dda165b-fd09-4199-bfa0-e32a204d3477 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:54.247561 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9dda165b-fd09-4199-bfa0-e32a204d3477 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:54.276405 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9dda165b-fd09-4199-bfa0-e32a204d3477 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048343 May 03 09:09:54.276935 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 620/1058] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:54 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:55.245852 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-613c914a-aca6-439d-95fa-57e69317e9cc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:55.246805 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-613c914a-aca6-439d-95fa-57e69317e9cc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:55.253421 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-613c914a-aca6-439d-95fa-57e69317e9cc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:55.253873 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-613c914a-aca6-439d-95fa-57e69317e9cc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:55.254649 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-613c914a-aca6-439d-95fa-57e69317e9cc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:55.255121 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-613c914a-aca6-439d-95fa-57e69317e9cc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:55.286522 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-613c914a-aca6-439d-95fa-57e69317e9cc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044595 May 03 09:09:55.287075 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 439/1059] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:55 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:55.289961 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-6d492912-78ae-41db-9f28-eb904349ef8f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:55.290954 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-6d492912-78ae-41db-9f28-eb904349ef8f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:55.297899 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6d492912-78ae-41db-9f28-eb904349ef8f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:55.298412 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6d492912-78ae-41db-9f28-eb904349ef8f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:55.299249 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6d492912-78ae-41db-9f28-eb904349ef8f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:55.299719 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6d492912-78ae-41db-9f28-eb904349ef8f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:55.329525 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-6d492912-78ae-41db-9f28-eb904349ef8f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043991 May 03 09:09:55.330348 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 621/1060] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:55 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:56.302480 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-8d48a6b6-3627-42b5-8733-02f624d9745c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:56.304062 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-8d48a6b6-3627-42b5-8733-02f624d9745c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:56.312457 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8d48a6b6-3627-42b5-8733-02f624d9745c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:56.312893 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8d48a6b6-3627-42b5-8733-02f624d9745c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:56.313707 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8d48a6b6-3627-42b5-8733-02f624d9745c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:56.314136 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8d48a6b6-3627-42b5-8733-02f624d9745c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:56.341040 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-fbe18bf6-4cca-4302-8335-a97cc746d320 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:56.341954 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-fbe18bf6-4cca-4302-8335-a97cc746d320 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:56.345181 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-8d48a6b6-3627-42b5-8733-02f624d9745c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049338 May 03 09:09:56.346386 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 440/1061] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:56 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:56.349046 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fbe18bf6-4cca-4302-8335-a97cc746d320 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:56.349498 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fbe18bf6-4cca-4302-8335-a97cc746d320 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:56.350275 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fbe18bf6-4cca-4302-8335-a97cc746d320 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:56.350713 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fbe18bf6-4cca-4302-8335-a97cc746d320 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:56.379825 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-fbe18bf6-4cca-4302-8335-a97cc746d320 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042811 May 03 09:09:56.380680 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 622/1062] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:56 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:57.358153 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7715e975-b492-40f3-b77e-1cbc38599ca7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:57.359068 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7715e975-b492-40f3-b77e-1cbc38599ca7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:57.365478 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7715e975-b492-40f3-b77e-1cbc38599ca7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:57.365917 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7715e975-b492-40f3-b77e-1cbc38599ca7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:57.366682 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7715e975-b492-40f3-b77e-1cbc38599ca7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:57.367114 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7715e975-b492-40f3-b77e-1cbc38599ca7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:57.390770 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c955a9ce-1a1a-4ebb-ab8f-677d18bc4c0e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:57.394577 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c955a9ce-1a1a-4ebb-ab8f-677d18bc4c0e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:57.398194 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7715e975-b492-40f3-b77e-1cbc38599ca7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044748 May 03 09:09:57.398542 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c955a9ce-1a1a-4ebb-ab8f-677d18bc4c0e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:57.399073 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c955a9ce-1a1a-4ebb-ab8f-677d18bc4c0e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:57.400056 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c955a9ce-1a1a-4ebb-ab8f-677d18bc4c0e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:57.400586 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c955a9ce-1a1a-4ebb-ab8f-677d18bc4c0e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:57.402496 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 441/1063] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:57 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:57.432488 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c955a9ce-1a1a-4ebb-ab8f-677d18bc4c0e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043723 May 03 09:09:57.433283 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 623/1064] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:57 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:58.411590 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7540c22b-d0d7-40bb-a095-2c4f0ab357e3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:58.412701 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7540c22b-d0d7-40bb-a095-2c4f0ab357e3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:58.420588 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7540c22b-d0d7-40bb-a095-2c4f0ab357e3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:58.421139 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7540c22b-d0d7-40bb-a095-2c4f0ab357e3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:58.422013 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7540c22b-d0d7-40bb-a095-2c4f0ab357e3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:58.422524 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7540c22b-d0d7-40bb-a095-2c4f0ab357e3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:58.444316 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ef34c5ff-e637-4f2f-8939-0a016ea8a7ae tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:58.445261 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ef34c5ff-e637-4f2f-8939-0a016ea8a7ae tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:58.456658 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7540c22b-d0d7-40bb-a095-2c4f0ab357e3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049869 May 03 09:09:58.457526 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 442/1065] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:58 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:58.459187 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ef34c5ff-e637-4f2f-8939-0a016ea8a7ae tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:58.459999 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ef34c5ff-e637-4f2f-8939-0a016ea8a7ae tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:58.460802 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ef34c5ff-e637-4f2f-8939-0a016ea8a7ae tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:58.461442 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ef34c5ff-e637-4f2f-8939-0a016ea8a7ae tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:58.492501 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ef34c5ff-e637-4f2f-8939-0a016ea8a7ae tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052196 May 03 09:09:58.493380 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 624/1066] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:58 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:59.477216 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2f69798a-83dc-4214-8144-463611dde180 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:59.478746 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-2f69798a-83dc-4214-8144-463611dde180 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:59.486004 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2f69798a-83dc-4214-8144-463611dde180 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:59.486450 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2f69798a-83dc-4214-8144-463611dde180 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:59.487217 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2f69798a-83dc-4214-8144-463611dde180 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:59.487648 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2f69798a-83dc-4214-8144-463611dde180 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:59.504923 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-1c0a973b-18c2-4396-8aa2-80ccde77e496 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:09:59.505959 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-1c0a973b-18c2-4396-8aa2-80ccde77e496 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:09:59.512641 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1c0a973b-18c2-4396-8aa2-80ccde77e496 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:59.513057 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1c0a973b-18c2-4396-8aa2-80ccde77e496 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:59.514070 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1c0a973b-18c2-4396-8aa2-80ccde77e496 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:09:59.514498 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1c0a973b-18c2-4396-8aa2-80ccde77e496 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:09:59.517787 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-2f69798a-83dc-4214-8144-463611dde180 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047752 May 03 09:09:59.518577 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 443/1067] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:59 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:09:59.543808 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-1c0a973b-18c2-4396-8aa2-80ccde77e496 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043085 May 03 09:09:59.544377 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 625/1068] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:09:59 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:00.531479 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5f4c6c8f-e084-40b7-9191-7ce33ff3c0a7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:00.532322 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5f4c6c8f-e084-40b7-9191-7ce33ff3c0a7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:00.539134 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5f4c6c8f-e084-40b7-9191-7ce33ff3c0a7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:00.539583 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5f4c6c8f-e084-40b7-9191-7ce33ff3c0a7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:00.540375 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5f4c6c8f-e084-40b7-9191-7ce33ff3c0a7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:00.540809 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5f4c6c8f-e084-40b7-9191-7ce33ff3c0a7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:00.555649 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-13aa2aec-2319-4ee8-ad8c-e8a9d10efc8c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:00.556633 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-13aa2aec-2319-4ee8-ad8c-e8a9d10efc8c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:00.563465 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-13aa2aec-2319-4ee8-ad8c-e8a9d10efc8c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:00.563959 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-13aa2aec-2319-4ee8-ad8c-e8a9d10efc8c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:00.564822 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-13aa2aec-2319-4ee8-ad8c-e8a9d10efc8c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:00.565279 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-13aa2aec-2319-4ee8-ad8c-e8a9d10efc8c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:00.572530 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5f4c6c8f-e084-40b7-9191-7ce33ff3c0a7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045259 May 03 09:10:00.573395 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 444/1069] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:00 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:00.594348 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-13aa2aec-2319-4ee8-ad8c-e8a9d10efc8c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042648 May 03 09:10:00.594940 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 626/1070] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:00 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:01.588851 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b8658ddc-4313-4e30-8d49-1bbe32987c81 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:01.589827 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b8658ddc-4313-4e30-8d49-1bbe32987c81 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:01.596956 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b8658ddc-4313-4e30-8d49-1bbe32987c81 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:01.597405 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b8658ddc-4313-4e30-8d49-1bbe32987c81 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:01.598165 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b8658ddc-4313-4e30-8d49-1bbe32987c81 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:01.598595 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b8658ddc-4313-4e30-8d49-1bbe32987c81 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:01.606638 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-2f6dda62-e846-4cba-8f8a-935cb304598c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:01.607578 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-2f6dda62-e846-4cba-8f8a-935cb304598c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:01.615901 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2f6dda62-e846-4cba-8f8a-935cb304598c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:01.616351 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2f6dda62-e846-4cba-8f8a-935cb304598c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:01.617127 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2f6dda62-e846-4cba-8f8a-935cb304598c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:01.617560 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2f6dda62-e846-4cba-8f8a-935cb304598c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:01.628443 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b8658ddc-4313-4e30-8d49-1bbe32987c81 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046470 May 03 09:10:01.632343 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 445/1071] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:01 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:01.647282 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-2f6dda62-e846-4cba-8f8a-935cb304598c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044620 May 03 09:10:01.647880 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 627/1072] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:01 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:02.644569 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6317207c-2bce-410b-9695-9f0c61ae8d3a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:02.646036 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6317207c-2bce-410b-9695-9f0c61ae8d3a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:02.656689 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6317207c-2bce-410b-9695-9f0c61ae8d3a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:02.657426 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6317207c-2bce-410b-9695-9f0c61ae8d3a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:02.658671 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6317207c-2bce-410b-9695-9f0c61ae8d3a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:02.659386 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6317207c-2bce-410b-9695-9f0c61ae8d3a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:02.663097 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-1d8ba7e9-3eef-4ed6-879a-21b302055fa7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:02.664636 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-1d8ba7e9-3eef-4ed6-879a-21b302055fa7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:02.672184 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1d8ba7e9-3eef-4ed6-879a-21b302055fa7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:02.672653 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1d8ba7e9-3eef-4ed6-879a-21b302055fa7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:02.673427 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1d8ba7e9-3eef-4ed6-879a-21b302055fa7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:02.673853 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1d8ba7e9-3eef-4ed6-879a-21b302055fa7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:02.693326 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6317207c-2bce-410b-9695-9f0c61ae8d3a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055456 May 03 09:10:02.697841 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 446/1073] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:02 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:02.704215 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-1d8ba7e9-3eef-4ed6-879a-21b302055fa7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048162 May 03 09:10:02.704793 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 628/1074] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:02 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:03.709747 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6faed02f-4b8c-45df-aafa-d34acce91e85 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:03.711229 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6faed02f-4b8c-45df-aafa-d34acce91e85 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:03.717942 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c4e5f0d4-4c06-4072-8056-58667ef82ba8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:03.718928 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c4e5f0d4-4c06-4072-8056-58667ef82ba8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:03.719364 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6faed02f-4b8c-45df-aafa-d34acce91e85 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:03.719848 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6faed02f-4b8c-45df-aafa-d34acce91e85 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:03.720978 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6faed02f-4b8c-45df-aafa-d34acce91e85 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:03.721416 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6faed02f-4b8c-45df-aafa-d34acce91e85 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:03.727896 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c4e5f0d4-4c06-4072-8056-58667ef82ba8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:03.728359 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c4e5f0d4-4c06-4072-8056-58667ef82ba8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:03.729133 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c4e5f0d4-4c06-4072-8056-58667ef82ba8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:03.729565 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c4e5f0d4-4c06-4072-8056-58667ef82ba8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:03.751147 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6faed02f-4b8c-45df-aafa-d34acce91e85 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048068 May 03 09:10:03.755299 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 447/1075] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:03 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:03.761219 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c4e5f0d4-4c06-4072-8056-58667ef82ba8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047898 May 03 09:10:03.761791 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 629/1076] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:03 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:04.767233 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e2378bfb-a511-48c5-b7de-d62b86abfeb0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:04.768777 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e2378bfb-a511-48c5-b7de-d62b86abfeb0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:04.776334 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-95fc208a-92ad-47f3-8cac-2b7016f0d0d7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:04.777855 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-95fc208a-92ad-47f3-8cac-2b7016f0d0d7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:04.779087 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e2378bfb-a511-48c5-b7de-d62b86abfeb0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:04.779846 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e2378bfb-a511-48c5-b7de-d62b86abfeb0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:04.781159 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e2378bfb-a511-48c5-b7de-d62b86abfeb0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:04.781884 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e2378bfb-a511-48c5-b7de-d62b86abfeb0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:04.787814 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-95fc208a-92ad-47f3-8cac-2b7016f0d0d7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:04.788567 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-95fc208a-92ad-47f3-8cac-2b7016f0d0d7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:04.789986 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-95fc208a-92ad-47f3-8cac-2b7016f0d0d7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:04.790614 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-95fc208a-92ad-47f3-8cac-2b7016f0d0d7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:04.815481 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e2378bfb-a511-48c5-b7de-d62b86abfeb0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054921 May 03 09:10:04.816512 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 448/1077] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:04 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:04.823146 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-95fc208a-92ad-47f3-8cac-2b7016f0d0d7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053398 May 03 09:10:04.823725 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 630/1078] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:04 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:05.830740 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9fc514d4-68ab-49e3-bbde-8f1b6fa82c51 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:05.832251 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9fc514d4-68ab-49e3-bbde-8f1b6fa82c51 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:05.840799 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d17c75c9-4eb3-4564-8821-ca18e5423d38 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:05.842804 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d17c75c9-4eb3-4564-8821-ca18e5423d38 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:05.842919 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9fc514d4-68ab-49e3-bbde-8f1b6fa82c51 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:05.842919 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9fc514d4-68ab-49e3-bbde-8f1b6fa82c51 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:05.844251 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9fc514d4-68ab-49e3-bbde-8f1b6fa82c51 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:05.845457 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9fc514d4-68ab-49e3-bbde-8f1b6fa82c51 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:05.849012 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d17c75c9-4eb3-4564-8821-ca18e5423d38 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:05.849443 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d17c75c9-4eb3-4564-8821-ca18e5423d38 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:05.850204 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d17c75c9-4eb3-4564-8821-ca18e5423d38 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:05.850737 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d17c75c9-4eb3-4564-8821-ca18e5423d38 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:05.876072 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9fc514d4-68ab-49e3-bbde-8f1b6fa82c51 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051945 May 03 09:10:05.876998 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 449/1079] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:05 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:05.879909 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d17c75c9-4eb3-4564-8821-ca18e5423d38 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045655 May 03 09:10:05.880456 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 631/1080] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:05 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:06.892489 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c3832509-d4e7-4e38-860e-d6c557ee5353 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:06.893971 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c3832509-d4e7-4e38-860e-d6c557ee5353 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:06.895585 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-393d4f29-ec12-4833-b0ab-abe56d12bb48 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:06.897135 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-393d4f29-ec12-4833-b0ab-abe56d12bb48 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:06.904768 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c3832509-d4e7-4e38-860e-d6c557ee5353 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:06.905516 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c3832509-d4e7-4e38-860e-d6c557ee5353 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:06.906977 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c3832509-d4e7-4e38-860e-d6c557ee5353 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:06.907697 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c3832509-d4e7-4e38-860e-d6c557ee5353 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:06.907945 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-393d4f29-ec12-4833-b0ab-abe56d12bb48 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:06.908690 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-393d4f29-ec12-4833-b0ab-abe56d12bb48 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:06.909760 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-393d4f29-ec12-4833-b0ab-abe56d12bb48 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:06.910483 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-393d4f29-ec12-4833-b0ab-abe56d12bb48 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:06.943305 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-393d4f29-ec12-4833-b0ab-abe56d12bb48 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054213 May 03 09:10:06.943879 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 632/1081] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:06 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:06.947130 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c3832509-d4e7-4e38-860e-d6c557ee5353 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061578 May 03 09:10:06.947725 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 450/1082] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:06 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:07.959841 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c8c9ef49-f4e9-4bef-9172-44e957a88406 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:07.962297 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c8c9ef49-f4e9-4bef-9172-44e957a88406 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:07.963677 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-32fa69a1-f7da-496d-86e9-1cba91c3d16f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:07.965402 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-32fa69a1-f7da-496d-86e9-1cba91c3d16f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:07.970370 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c8c9ef49-f4e9-4bef-9172-44e957a88406 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:07.971214 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c8c9ef49-f4e9-4bef-9172-44e957a88406 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:07.972015 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-32fa69a1-f7da-496d-86e9-1cba91c3d16f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:07.972167 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c8c9ef49-f4e9-4bef-9172-44e957a88406 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:07.972449 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c8c9ef49-f4e9-4bef-9172-44e957a88406 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:07.972617 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-32fa69a1-f7da-496d-86e9-1cba91c3d16f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:07.973175 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-32fa69a1-f7da-496d-86e9-1cba91c3d16f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:07.973641 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-32fa69a1-f7da-496d-86e9-1cba91c3d16f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:08.002690 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c8c9ef49-f4e9-4bef-9172-44e957a88406 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049979 May 03 09:10:08.003463 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 633/1083] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:07 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:08.003932 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-32fa69a1-f7da-496d-86e9-1cba91c3d16f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047713 May 03 09:10:08.004549 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 451/1084] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:07 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:09.019150 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5eb5a83c-e6ca-423a-988a-dd33f1bf35c1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:09.020285 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-25e44f25-548c-47e2-bf1d-e8991ef95d3d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:09.021024 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5eb5a83c-e6ca-423a-988a-dd33f1bf35c1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:09.021843 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-25e44f25-548c-47e2-bf1d-e8991ef95d3d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:09.030148 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5eb5a83c-e6ca-423a-988a-dd33f1bf35c1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:09.030571 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5eb5a83c-e6ca-423a-988a-dd33f1bf35c1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:09.031283 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-25e44f25-548c-47e2-bf1d-e8991ef95d3d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:09.031450 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5eb5a83c-e6ca-423a-988a-dd33f1bf35c1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:09.031705 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-25e44f25-548c-47e2-bf1d-e8991ef95d3d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:09.031853 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5eb5a83c-e6ca-423a-988a-dd33f1bf35c1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:09.032505 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-25e44f25-548c-47e2-bf1d-e8991ef95d3d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:09.033066 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-25e44f25-548c-47e2-bf1d-e8991ef95d3d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:09.061746 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5eb5a83c-e6ca-423a-988a-dd33f1bf35c1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049227 May 03 09:10:09.064111 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 634/1085] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:09 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:09.064251 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-25e44f25-548c-47e2-bf1d-e8991ef95d3d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049655 May 03 09:10:09.067461 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 452/1086] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:09 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:10.078347 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c3c2aef2-cd8c-4404-9de8-305417446524 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:10.079198 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-4894c605-3ab2-4246-bb46-0e506164aafe tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:10.079648 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c3c2aef2-cd8c-4404-9de8-305417446524 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:10.079812 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-4894c605-3ab2-4246-bb46-0e506164aafe tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:10.086849 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c3c2aef2-cd8c-4404-9de8-305417446524 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:10.087361 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4894c605-3ab2-4246-bb46-0e506164aafe tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:10.087560 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c3c2aef2-cd8c-4404-9de8-305417446524 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:10.087956 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4894c605-3ab2-4246-bb46-0e506164aafe tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:10.088405 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c3c2aef2-cd8c-4404-9de8-305417446524 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:10.088908 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4894c605-3ab2-4246-bb46-0e506164aafe tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:10.089082 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c3c2aef2-cd8c-4404-9de8-305417446524 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:10.089438 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4894c605-3ab2-4246-bb46-0e506164aafe tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:10.121731 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-4894c605-3ab2-4246-bb46-0e506164aafe tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049135 May 03 09:10:10.122549 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c3c2aef2-cd8c-4404-9de8-305417446524 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049669 May 03 09:10:10.122700 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 635/1087] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:10 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:10.126273 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 453/1088] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:10 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:11.137865 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-58a326ba-9cde-47bb-b628-1787116485c9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:11.138766 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a3b3db0a-7bb2-4820-9a01-a84e6ac6d8b2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:11.139349 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-58a326ba-9cde-47bb-b628-1787116485c9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:11.139963 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a3b3db0a-7bb2-4820-9a01-a84e6ac6d8b2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:11.150026 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-58a326ba-9cde-47bb-b628-1787116485c9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:11.150457 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a3b3db0a-7bb2-4820-9a01-a84e6ac6d8b2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:11.150737 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-58a326ba-9cde-47bb-b628-1787116485c9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:11.151181 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a3b3db0a-7bb2-4820-9a01-a84e6ac6d8b2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:11.152091 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-58a326ba-9cde-47bb-b628-1787116485c9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:11.152482 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a3b3db0a-7bb2-4820-9a01-a84e6ac6d8b2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:11.152830 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-58a326ba-9cde-47bb-b628-1787116485c9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:11.153359 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a3b3db0a-7bb2-4820-9a01-a84e6ac6d8b2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:11.184850 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a3b3db0a-7bb2-4820-9a01-a84e6ac6d8b2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053740 May 03 09:10:11.185429 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 454/1089] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:11 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:11.190006 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-58a326ba-9cde-47bb-b628-1787116485c9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058983 May 03 09:10:11.190579 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 636/1090] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:11 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:12.201000 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a14e0ce3-78e1-4ec6-96b8-de074e289624 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:12.201931 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a14e0ce3-78e1-4ec6-96b8-de074e289624 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:12.203675 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b4e528c4-9d5a-4d5f-adbe-526d0757f87f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:12.205725 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b4e528c4-9d5a-4d5f-adbe-526d0757f87f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:12.208766 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a14e0ce3-78e1-4ec6-96b8-de074e289624 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:12.209682 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a14e0ce3-78e1-4ec6-96b8-de074e289624 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:12.211078 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a14e0ce3-78e1-4ec6-96b8-de074e289624 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:12.212342 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a14e0ce3-78e1-4ec6-96b8-de074e289624 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:12.213031 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b4e528c4-9d5a-4d5f-adbe-526d0757f87f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:12.213538 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b4e528c4-9d5a-4d5f-adbe-526d0757f87f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:12.214381 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b4e528c4-9d5a-4d5f-adbe-526d0757f87f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:12.214874 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b4e528c4-9d5a-4d5f-adbe-526d0757f87f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:12.243492 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a14e0ce3-78e1-4ec6-96b8-de074e289624 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049215 May 03 09:10:12.245152 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b4e528c4-9d5a-4d5f-adbe-526d0757f87f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046156 May 03 09:10:12.245739 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 455/1091] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:12 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:12.246116 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 637/1092] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:12 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:13.261289 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5f2bde53-5d33-4daf-9ffe-6609ceadf25b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:13.262191 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-950097d6-4971-4d70-b6ea-dd2fb8985ade tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:13.262763 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5f2bde53-5d33-4daf-9ffe-6609ceadf25b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:13.263686 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-950097d6-4971-4d70-b6ea-dd2fb8985ade tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:13.272865 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5f2bde53-5d33-4daf-9ffe-6609ceadf25b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:13.273606 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5f2bde53-5d33-4daf-9ffe-6609ceadf25b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:13.274017 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-950097d6-4971-4d70-b6ea-dd2fb8985ade tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:13.274951 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-950097d6-4971-4d70-b6ea-dd2fb8985ade tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:13.275197 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5f2bde53-5d33-4daf-9ffe-6609ceadf25b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:13.275722 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5f2bde53-5d33-4daf-9ffe-6609ceadf25b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:13.276282 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-950097d6-4971-4d70-b6ea-dd2fb8985ade tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:13.277042 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-950097d6-4971-4d70-b6ea-dd2fb8985ade tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:13.306470 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5f2bde53-5d33-4daf-9ffe-6609ceadf25b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051816 May 03 09:10:13.307167 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 456/1093] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:13 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:13.312857 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-950097d6-4971-4d70-b6ea-dd2fb8985ade tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058253 May 03 09:10:13.313427 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 638/1094] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:13 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:14.322285 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4c09cf75-38eb-454b-9938-76a5875e96eb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:14.324758 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4c09cf75-38eb-454b-9938-76a5875e96eb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:14.328364 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-695e335c-c614-43c9-89e0-ca9fdf8f73af tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:14.329130 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-695e335c-c614-43c9-89e0-ca9fdf8f73af tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:14.331874 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4c09cf75-38eb-454b-9938-76a5875e96eb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:14.332324 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4c09cf75-38eb-454b-9938-76a5875e96eb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:14.333056 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4c09cf75-38eb-454b-9938-76a5875e96eb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:14.333654 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4c09cf75-38eb-454b-9938-76a5875e96eb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:14.335895 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-695e335c-c614-43c9-89e0-ca9fdf8f73af tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:14.336584 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-695e335c-c614-43c9-89e0-ca9fdf8f73af tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:14.337315 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-695e335c-c614-43c9-89e0-ca9fdf8f73af tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:14.337895 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-695e335c-c614-43c9-89e0-ca9fdf8f73af tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:14.366102 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-4c09cf75-38eb-454b-9938-76a5875e96eb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050484 May 03 09:10:14.366875 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 457/1095] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:14 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:14.369716 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-695e335c-c614-43c9-89e0-ca9fdf8f73af tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047934 May 03 09:10:14.370498 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 639/1096] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:14 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:15.381570 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-50a38b3c-2139-4ff2-a6be-102c82ceacce tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:15.384114 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-50a38b3c-2139-4ff2-a6be-102c82ceacce tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:15.385362 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3ea54ef9-30a8-41da-8076-dd917c73f7c4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:15.386857 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-3ea54ef9-30a8-41da-8076-dd917c73f7c4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:15.393116 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-50a38b3c-2139-4ff2-a6be-102c82ceacce tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:15.393621 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-50a38b3c-2139-4ff2-a6be-102c82ceacce tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:15.394309 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3ea54ef9-30a8-41da-8076-dd917c73f7c4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:15.394426 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-50a38b3c-2139-4ff2-a6be-102c82ceacce tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:15.394771 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3ea54ef9-30a8-41da-8076-dd917c73f7c4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:15.394904 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-50a38b3c-2139-4ff2-a6be-102c82ceacce tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:15.395543 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3ea54ef9-30a8-41da-8076-dd917c73f7c4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:15.396026 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3ea54ef9-30a8-41da-8076-dd917c73f7c4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:15.426622 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-50a38b3c-2139-4ff2-a6be-102c82ceacce tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051677 May 03 09:10:15.426866 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-3ea54ef9-30a8-41da-8076-dd917c73f7c4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048240 May 03 09:10:15.427188 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 458/1097] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:15 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:15.430640 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 640/1098] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:15 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:16.441251 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ec7bda7a-322a-478b-8d2a-95bfe61274b9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:16.442412 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ec7bda7a-322a-478b-8d2a-95bfe61274b9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:16.445126 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-7f16feaa-ecea-4fdb-bc29-60dc6f05c63d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:16.446260 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-7f16feaa-ecea-4fdb-bc29-60dc6f05c63d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:16.450280 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ec7bda7a-322a-478b-8d2a-95bfe61274b9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:16.450838 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ec7bda7a-322a-478b-8d2a-95bfe61274b9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:16.452157 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ec7bda7a-322a-478b-8d2a-95bfe61274b9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:16.452568 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ec7bda7a-322a-478b-8d2a-95bfe61274b9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:16.453871 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7f16feaa-ecea-4fdb-bc29-60dc6f05c63d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:16.454582 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7f16feaa-ecea-4fdb-bc29-60dc6f05c63d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:16.455542 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7f16feaa-ecea-4fdb-bc29-60dc6f05c63d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:16.456111 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7f16feaa-ecea-4fdb-bc29-60dc6f05c63d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:16.486585 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ec7bda7a-322a-478b-8d2a-95bfe61274b9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050486 May 03 09:10:16.490362 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 459/1099] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:16 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:16.490513 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-7f16feaa-ecea-4fdb-bc29-60dc6f05c63d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051645 May 03 09:10:16.490927 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 641/1100] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:16 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:17.502599 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-54d37eda-81f1-4f7b-9074-ee6d5ec8c3a3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:17.504007 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-54d37eda-81f1-4f7b-9074-ee6d5ec8c3a3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:17.506082 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-92951ac7-9e2e-4bd4-8351-9c1445ee5a96 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:17.507747 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-92951ac7-9e2e-4bd4-8351-9c1445ee5a96 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:17.515095 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-54d37eda-81f1-4f7b-9074-ee6d5ec8c3a3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:17.515567 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-54d37eda-81f1-4f7b-9074-ee6d5ec8c3a3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:17.516375 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-92951ac7-9e2e-4bd4-8351-9c1445ee5a96 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:17.516510 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-54d37eda-81f1-4f7b-9074-ee6d5ec8c3a3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:17.516829 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-54d37eda-81f1-4f7b-9074-ee6d5ec8c3a3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:17.516968 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-92951ac7-9e2e-4bd4-8351-9c1445ee5a96 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:17.517600 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-92951ac7-9e2e-4bd4-8351-9c1445ee5a96 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:17.518027 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-92951ac7-9e2e-4bd4-8351-9c1445ee5a96 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:17.546015 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-54d37eda-81f1-4f7b-9074-ee6d5ec8c3a3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050458 May 03 09:10:17.546739 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 460/1101] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:17 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:17.548302 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-92951ac7-9e2e-4bd4-8351-9c1445ee5a96 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049124 May 03 09:10:17.551950 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 642/1102] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:17 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:18.561805 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f92a3ec3-4811-4108-bb8b-3e59e840e2cc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:18.562751 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f92a3ec3-4811-4108-bb8b-3e59e840e2cc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:18.563619 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f4325158-a4ec-4e6f-b41d-09ee1111e92c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:18.564902 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f4325158-a4ec-4e6f-b41d-09ee1111e92c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:18.569330 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f92a3ec3-4811-4108-bb8b-3e59e840e2cc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:18.569777 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f92a3ec3-4811-4108-bb8b-3e59e840e2cc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:18.570544 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f92a3ec3-4811-4108-bb8b-3e59e840e2cc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:18.570973 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f92a3ec3-4811-4108-bb8b-3e59e840e2cc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:18.571430 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f4325158-a4ec-4e6f-b41d-09ee1111e92c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:18.571919 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f4325158-a4ec-4e6f-b41d-09ee1111e92c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:18.574029 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f4325158-a4ec-4e6f-b41d-09ee1111e92c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:18.574029 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f4325158-a4ec-4e6f-b41d-09ee1111e92c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:18.601828 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f92a3ec3-4811-4108-bb8b-3e59e840e2cc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046498 May 03 09:10:18.605430 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f4325158-a4ec-4e6f-b41d-09ee1111e92c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048362 May 03 09:10:18.605842 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 461/1103] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:18 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:18.606239 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 643/1104] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:18 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:19.617808 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-8ec9107b-2328-4aec-aa23-800de6c30f0d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:19.619541 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-8ec9107b-2328-4aec-aa23-800de6c30f0d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:19.621031 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9431704f-d17a-49dc-badc-86aaf3122642 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:19.622315 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9431704f-d17a-49dc-badc-86aaf3122642 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:19.629432 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8ec9107b-2328-4aec-aa23-800de6c30f0d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:19.630168 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8ec9107b-2328-4aec-aa23-800de6c30f0d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:19.631432 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8ec9107b-2328-4aec-aa23-800de6c30f0d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:19.632190 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8ec9107b-2328-4aec-aa23-800de6c30f0d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:19.632906 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9431704f-d17a-49dc-badc-86aaf3122642 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:19.633635 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9431704f-d17a-49dc-badc-86aaf3122642 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:19.634894 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9431704f-d17a-49dc-badc-86aaf3122642 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:19.635900 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9431704f-d17a-49dc-badc-86aaf3122642 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:19.668044 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-8ec9107b-2328-4aec-aa23-800de6c30f0d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057082 May 03 09:10:19.668643 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 462/1105] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:19 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:19.668837 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9431704f-d17a-49dc-badc-86aaf3122642 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054673 May 03 09:10:19.669641 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 644/1106] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:19 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:20.684167 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a22959f3-0fdb-481d-8bc7-0c76ee0fab14 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:20.685034 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b08de228-9a01-475c-b53a-1246ea0ed3a3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:20.686235 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b08de228-9a01-475c-b53a-1246ea0ed3a3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:20.687347 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a22959f3-0fdb-481d-8bc7-0c76ee0fab14 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:20.693166 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b08de228-9a01-475c-b53a-1246ea0ed3a3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:20.693615 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b08de228-9a01-475c-b53a-1246ea0ed3a3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:20.693760 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a22959f3-0fdb-481d-8bc7-0c76ee0fab14 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:20.694067 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a22959f3-0fdb-481d-8bc7-0c76ee0fab14 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:20.694386 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b08de228-9a01-475c-b53a-1246ea0ed3a3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:20.694815 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b08de228-9a01-475c-b53a-1246ea0ed3a3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:20.694961 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a22959f3-0fdb-481d-8bc7-0c76ee0fab14 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:20.695242 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a22959f3-0fdb-481d-8bc7-0c76ee0fab14 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:20.725874 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a22959f3-0fdb-481d-8bc7-0c76ee0fab14 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048358 May 03 09:10:20.729764 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 463/1107] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:20 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:20.730034 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b08de228-9a01-475c-b53a-1246ea0ed3a3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049410 May 03 09:10:20.730034 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 645/1108] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:20 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:21.741728 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d9d7d1ae-7215-4e6d-9c5d-3d3ca7f47b27 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:21.743021 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-47eba08d-b0a8-4434-8566-77842e173e91 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:21.743664 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d9d7d1ae-7215-4e6d-9c5d-3d3ca7f47b27 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:21.744473 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-47eba08d-b0a8-4434-8566-77842e173e91 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:21.752763 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-47eba08d-b0a8-4434-8566-77842e173e91 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:21.753330 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d9d7d1ae-7215-4e6d-9c5d-3d3ca7f47b27 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:21.753472 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-47eba08d-b0a8-4434-8566-77842e173e91 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:21.753952 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d9d7d1ae-7215-4e6d-9c5d-3d3ca7f47b27 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:21.754107 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-47eba08d-b0a8-4434-8566-77842e173e91 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:21.754366 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-47eba08d-b0a8-4434-8566-77842e173e91 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:21.754736 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d9d7d1ae-7215-4e6d-9c5d-3d3ca7f47b27 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:21.755250 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d9d7d1ae-7215-4e6d-9c5d-3d3ca7f47b27 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:21.784173 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-47eba08d-b0a8-4434-8566-77842e173e91 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048110 May 03 09:10:21.785052 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 646/1109] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:21 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:21.786208 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d9d7d1ae-7215-4e6d-9c5d-3d3ca7f47b27 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051100 May 03 09:10:21.786917 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 464/1110] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:21 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:22.799305 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-fc69f539-d580-4db1-b5be-f3e1225ccb5c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:22.800451 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-da84f6d6-49e7-466f-b21e-c8a8351d0778 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:22.800996 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-fc69f539-d580-4db1-b5be-f3e1225ccb5c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:22.801588 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-da84f6d6-49e7-466f-b21e-c8a8351d0778 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:22.808555 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fc69f539-d580-4db1-b5be-f3e1225ccb5c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:22.809162 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fc69f539-d580-4db1-b5be-f3e1225ccb5c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:22.809621 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-da84f6d6-49e7-466f-b21e-c8a8351d0778 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:22.810194 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-da84f6d6-49e7-466f-b21e-c8a8351d0778 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:22.810911 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fc69f539-d580-4db1-b5be-f3e1225ccb5c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:22.811176 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-da84f6d6-49e7-466f-b21e-c8a8351d0778 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:22.811469 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fc69f539-d580-4db1-b5be-f3e1225ccb5c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:22.811753 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-da84f6d6-49e7-466f-b21e-c8a8351d0778 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:22.844081 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-da84f6d6-49e7-466f-b21e-c8a8351d0778 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048662 May 03 09:10:22.848237 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 465/1111] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:22 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:22.848381 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-fc69f539-d580-4db1-b5be-f3e1225ccb5c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051615 May 03 09:10:22.848381 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 647/1112] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:22 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:23.860034 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-8a8a71cd-1464-4d84-95e9-7692750f95c7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:23.861219 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-94f1d7a5-83be-4430-b33c-20ba98264593 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:23.861919 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-8a8a71cd-1464-4d84-95e9-7692750f95c7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:23.862760 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-94f1d7a5-83be-4430-b33c-20ba98264593 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:23.872934 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8a8a71cd-1464-4d84-95e9-7692750f95c7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:23.873684 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8a8a71cd-1464-4d84-95e9-7692750f95c7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:23.874314 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-94f1d7a5-83be-4430-b33c-20ba98264593 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:23.874709 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8a8a71cd-1464-4d84-95e9-7692750f95c7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:23.874847 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-94f1d7a5-83be-4430-b33c-20ba98264593 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:23.875235 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8a8a71cd-1464-4d84-95e9-7692750f95c7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:23.875521 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-94f1d7a5-83be-4430-b33c-20ba98264593 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:23.876038 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-94f1d7a5-83be-4430-b33c-20ba98264593 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:23.905944 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-8a8a71cd-1464-4d84-95e9-7692750f95c7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052930 May 03 09:10:23.908235 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-94f1d7a5-83be-4430-b33c-20ba98264593 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053578 May 03 09:10:23.909247 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 648/1113] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:23 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:23.909388 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 466/1114] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:23 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:24.921654 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ef875ea0-2195-40d0-918c-80c0c8bbda79 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:24.922594 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ef875ea0-2195-40d0-918c-80c0c8bbda79 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:24.922831 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-26bd5af1-5f18-4dea-97ee-c3631f17c0e0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:10:24.923788 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-26bd5af1-5f18-4dea-97ee-c3631f17c0e0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:24.929184 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ef875ea0-2195-40d0-918c-80c0c8bbda79 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:24.930052 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ef875ea0-2195-40d0-918c-80c0c8bbda79 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:24.930427 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-26bd5af1-5f18-4dea-97ee-c3631f17c0e0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:24.930574 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ef875ea0-2195-40d0-918c-80c0c8bbda79 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:24.930885 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ef875ea0-2195-40d0-918c-80c0c8bbda79 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:24.930979 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-26bd5af1-5f18-4dea-97ee-c3631f17c0e0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:24.931802 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-26bd5af1-5f18-4dea-97ee-c3631f17c0e0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:24.932073 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-26bd5af1-5f18-4dea-97ee-c3631f17c0e0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:24.960350 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ef875ea0-2195-40d0-918c-80c0c8bbda79 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045249 May 03 09:10:24.961122 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 649/1115] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:24 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:25.015650 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-26bd5af1-5f18-4dea-97ee-c3631f17c0e0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "POST /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/action" status: 200 len: 76767 microversion: 2.1 time: 0.098040 May 03 09:10:25.016885 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 467/1116] 10.222.0.11 () {60 vars in 1277 bytes} [Tue May 3 09:10:24 2022] POST /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b/action => generated 76767 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:10:25.976865 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e86afe99-da20-416f-b4b1-fbae76e4be97 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:25.978344 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e86afe99-da20-416f-b4b1-fbae76e4be97 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:25.988489 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e86afe99-da20-416f-b4b1-fbae76e4be97 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:25.989242 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e86afe99-da20-416f-b4b1-fbae76e4be97 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:25.990484 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e86afe99-da20-416f-b4b1-fbae76e4be97 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:25.991211 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e86afe99-da20-416f-b4b1-fbae76e4be97 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:26.024029 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e86afe99-da20-416f-b4b1-fbae76e4be97 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054192 May 03 09:10:26.024605 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 650/1117] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:25 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:27.041168 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-144c3117-2105-4ad1-9664-5842f79ae771 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:27.043087 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-144c3117-2105-4ad1-9664-5842f79ae771 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:27.051438 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-144c3117-2105-4ad1-9664-5842f79ae771 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:27.052068 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-144c3117-2105-4ad1-9664-5842f79ae771 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:27.052689 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-144c3117-2105-4ad1-9664-5842f79ae771 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:27.053130 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-144c3117-2105-4ad1-9664-5842f79ae771 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:27.084514 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-144c3117-2105-4ad1-9664-5842f79ae771 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050708 May 03 09:10:27.085084 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 468/1118] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:27 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:28.097066 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-68e4fa3c-3240-412d-b25c-589fd2eb72fb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:28.097990 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-68e4fa3c-3240-412d-b25c-589fd2eb72fb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:28.104073 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-68e4fa3c-3240-412d-b25c-589fd2eb72fb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:28.104517 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-68e4fa3c-3240-412d-b25c-589fd2eb72fb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:28.105275 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-68e4fa3c-3240-412d-b25c-589fd2eb72fb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:28.105726 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-68e4fa3c-3240-412d-b25c-589fd2eb72fb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:28.134114 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-68e4fa3c-3240-412d-b25c-589fd2eb72fb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041429 May 03 09:10:28.134692 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 651/1119] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:28 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:29.150275 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-bab2b429-e0d1-4666-86fb-bbf4026e3112 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:29.151802 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-bab2b429-e0d1-4666-86fb-bbf4026e3112 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:29.160090 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bab2b429-e0d1-4666-86fb-bbf4026e3112 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:29.160557 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bab2b429-e0d1-4666-86fb-bbf4026e3112 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:29.161479 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bab2b429-e0d1-4666-86fb-bbf4026e3112 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:29.161734 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bab2b429-e0d1-4666-86fb-bbf4026e3112 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:29.191649 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-bab2b429-e0d1-4666-86fb-bbf4026e3112 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048137 May 03 09:10:29.192563 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 469/1120] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:29 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:30.206162 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-31bd5da1-4aac-4606-9243-cda931d5e3c8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:30.207822 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-31bd5da1-4aac-4606-9243-cda931d5e3c8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:30.216625 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-31bd5da1-4aac-4606-9243-cda931d5e3c8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:30.216625 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-31bd5da1-4aac-4606-9243-cda931d5e3c8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:30.217288 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-31bd5da1-4aac-4606-9243-cda931d5e3c8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:30.217725 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-31bd5da1-4aac-4606-9243-cda931d5e3c8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:30.248420 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-31bd5da1-4aac-4606-9243-cda931d5e3c8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047204 May 03 09:10:30.248985 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 652/1121] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:30 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:31.265070 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-aaf51590-b1a1-418a-b9d7-ab943a5ae7b1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:31.266445 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-aaf51590-b1a1-418a-b9d7-ab943a5ae7b1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:31.277173 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aaf51590-b1a1-418a-b9d7-ab943a5ae7b1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:31.277844 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aaf51590-b1a1-418a-b9d7-ab943a5ae7b1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:31.279145 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aaf51590-b1a1-418a-b9d7-ab943a5ae7b1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:31.279916 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aaf51590-b1a1-418a-b9d7-ab943a5ae7b1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:31.311092 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-aaf51590-b1a1-418a-b9d7-ab943a5ae7b1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052853 May 03 09:10:31.311720 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 470/1122] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:31 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:32.323335 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-7161b378-10f2-4c85-bb48-2806e418ef75 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:32.324329 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-7161b378-10f2-4c85-bb48-2806e418ef75 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:32.331572 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7161b378-10f2-4c85-bb48-2806e418ef75 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:32.331572 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7161b378-10f2-4c85-bb48-2806e418ef75 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:32.332304 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7161b378-10f2-4c85-bb48-2806e418ef75 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:32.332742 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7161b378-10f2-4c85-bb48-2806e418ef75 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:32.364077 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-7161b378-10f2-4c85-bb48-2806e418ef75 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044127 May 03 09:10:32.364344 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 653/1123] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:32 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:33.378069 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-8933bf52-046d-4c97-a5c6-e7a7d7c8cd2a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:33.379170 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-8933bf52-046d-4c97-a5c6-e7a7d7c8cd2a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:33.386947 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8933bf52-046d-4c97-a5c6-e7a7d7c8cd2a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:33.387748 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8933bf52-046d-4c97-a5c6-e7a7d7c8cd2a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:33.388400 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8933bf52-046d-4c97-a5c6-e7a7d7c8cd2a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:33.388912 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8933bf52-046d-4c97-a5c6-e7a7d7c8cd2a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:33.421171 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-8933bf52-046d-4c97-a5c6-e7a7d7c8cd2a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048851 May 03 09:10:33.421733 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 471/1124] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:33 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:34.437314 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-082bc7aa-45e3-4f4d-8597-5bfc877f265d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:34.438605 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-082bc7aa-45e3-4f4d-8597-5bfc877f265d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:34.446673 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-082bc7aa-45e3-4f4d-8597-5bfc877f265d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:34.447234 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-082bc7aa-45e3-4f4d-8597-5bfc877f265d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:34.448219 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-082bc7aa-45e3-4f4d-8597-5bfc877f265d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:34.448793 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-082bc7aa-45e3-4f4d-8597-5bfc877f265d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:34.483226 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-082bc7aa-45e3-4f4d-8597-5bfc877f265d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052572 May 03 09:10:34.484102 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 654/1125] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:34 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:35.499210 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-99e00845-9d8c-491a-9262-6402e621c047 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:35.500737 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-99e00845-9d8c-491a-9262-6402e621c047 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:35.511429 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-99e00845-9d8c-491a-9262-6402e621c047 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:35.512233 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-99e00845-9d8c-491a-9262-6402e621c047 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:35.513527 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-99e00845-9d8c-491a-9262-6402e621c047 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:35.514265 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-99e00845-9d8c-491a-9262-6402e621c047 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:35.545856 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-99e00845-9d8c-491a-9262-6402e621c047 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053532 May 03 09:10:35.546464 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 472/1126] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:35 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:36.562599 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-663aca74-e772-4b5f-baeb-7c63de6fd97b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:36.563922 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-663aca74-e772-4b5f-baeb-7c63de6fd97b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:36.570460 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-663aca74-e772-4b5f-baeb-7c63de6fd97b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:36.570928 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-663aca74-e772-4b5f-baeb-7c63de6fd97b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:36.571727 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-663aca74-e772-4b5f-baeb-7c63de6fd97b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:36.572214 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-663aca74-e772-4b5f-baeb-7c63de6fd97b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:36.602784 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-663aca74-e772-4b5f-baeb-7c63de6fd97b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047180 May 03 09:10:36.603353 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 655/1127] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:36 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:37.618932 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e258f437-5980-4f6c-9b1f-65f3ad8f9555 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:37.621183 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e258f437-5980-4f6c-9b1f-65f3ad8f9555 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:37.631322 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e258f437-5980-4f6c-9b1f-65f3ad8f9555 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:37.632145 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e258f437-5980-4f6c-9b1f-65f3ad8f9555 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:37.633458 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e258f437-5980-4f6c-9b1f-65f3ad8f9555 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:37.634179 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e258f437-5980-4f6c-9b1f-65f3ad8f9555 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:37.668400 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e258f437-5980-4f6c-9b1f-65f3ad8f9555 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056335 May 03 09:10:37.669167 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 473/1128] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:37 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:38.690068 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ebc954f7-49a7-4a58-9e85-0ffaddf1b0da tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:38.691121 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ebc954f7-49a7-4a58-9e85-0ffaddf1b0da tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:38.697389 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ebc954f7-49a7-4a58-9e85-0ffaddf1b0da tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:38.697833 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ebc954f7-49a7-4a58-9e85-0ffaddf1b0da tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:38.698592 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ebc954f7-49a7-4a58-9e85-0ffaddf1b0da tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:38.699038 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ebc954f7-49a7-4a58-9e85-0ffaddf1b0da tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:38.727835 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ebc954f7-49a7-4a58-9e85-0ffaddf1b0da tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043701 May 03 09:10:38.728640 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 656/1129] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:38 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:39.743836 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-82c478d4-66ff-4ed9-9ca4-fba97026f737 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:39.745727 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-82c478d4-66ff-4ed9-9ca4-fba97026f737 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:39.756074 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-82c478d4-66ff-4ed9-9ca4-fba97026f737 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:39.756839 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-82c478d4-66ff-4ed9-9ca4-fba97026f737 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:39.759314 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-82c478d4-66ff-4ed9-9ca4-fba97026f737 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:39.759314 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-82c478d4-66ff-4ed9-9ca4-fba97026f737 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:39.792037 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-82c478d4-66ff-4ed9-9ca4-fba97026f737 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054480 May 03 09:10:39.792594 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 474/1130] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:39 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:40.807612 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d0b1d7de-7d86-439e-a3fa-d935da752f03 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:40.809638 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d0b1d7de-7d86-439e-a3fa-d935da752f03 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:40.820039 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d0b1d7de-7d86-439e-a3fa-d935da752f03 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:40.820840 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d0b1d7de-7d86-439e-a3fa-d935da752f03 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:40.822304 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d0b1d7de-7d86-439e-a3fa-d935da752f03 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:40.823084 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d0b1d7de-7d86-439e-a3fa-d935da752f03 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:40.855667 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d0b1d7de-7d86-439e-a3fa-d935da752f03 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054615 May 03 09:10:40.856341 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 657/1131] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:40 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:41.873381 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2183cfa4-6b28-459f-a003-c1e61245d26d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:41.874129 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-2183cfa4-6b28-459f-a003-c1e61245d26d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:41.881734 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2183cfa4-6b28-459f-a003-c1e61245d26d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:41.882201 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2183cfa4-6b28-459f-a003-c1e61245d26d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:41.882958 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2183cfa4-6b28-459f-a003-c1e61245d26d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:41.883389 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2183cfa4-6b28-459f-a003-c1e61245d26d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:41.915584 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-2183cfa4-6b28-459f-a003-c1e61245d26d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049314 May 03 09:10:41.919444 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 475/1132] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:41 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:42.931119 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b6f3108b-b224-4859-80aa-8565a8ed4cdb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:42.932733 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b6f3108b-b224-4859-80aa-8565a8ed4cdb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:42.943580 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b6f3108b-b224-4859-80aa-8565a8ed4cdb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:42.944437 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b6f3108b-b224-4859-80aa-8565a8ed4cdb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:42.945772 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b6f3108b-b224-4859-80aa-8565a8ed4cdb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:42.946499 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b6f3108b-b224-4859-80aa-8565a8ed4cdb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:42.980159 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b6f3108b-b224-4859-80aa-8565a8ed4cdb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055562 May 03 09:10:42.980713 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 658/1133] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:42 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:43.996684 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-027a2b0b-59ad-48a3-af94-b253cc4bfcba tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:43.998411 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-027a2b0b-59ad-48a3-af94-b253cc4bfcba tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:44.006144 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-027a2b0b-59ad-48a3-af94-b253cc4bfcba tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:44.006597 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-027a2b0b-59ad-48a3-af94-b253cc4bfcba tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:44.007354 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-027a2b0b-59ad-48a3-af94-b253cc4bfcba tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:44.007799 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-027a2b0b-59ad-48a3-af94-b253cc4bfcba tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:44.037274 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-027a2b0b-59ad-48a3-af94-b253cc4bfcba tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047569 May 03 09:10:44.037840 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 476/1134] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:43 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:45.054768 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-7e2e90a4-1804-4943-a5db-8de8526fa8bc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:45.055400 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-7e2e90a4-1804-4943-a5db-8de8526fa8bc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:45.066006 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7e2e90a4-1804-4943-a5db-8de8526fa8bc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:45.066768 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7e2e90a4-1804-4943-a5db-8de8526fa8bc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:45.068105 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7e2e90a4-1804-4943-a5db-8de8526fa8bc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:45.068838 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7e2e90a4-1804-4943-a5db-8de8526fa8bc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:45.103236 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-7e2e90a4-1804-4943-a5db-8de8526fa8bc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056282 May 03 09:10:45.103799 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 659/1135] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:45 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:46.119392 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-8a8088f0-e871-4a2a-b229-7a42af929046 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:46.121741 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-8a8088f0-e871-4a2a-b229-7a42af929046 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:46.129556 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8a8088f0-e871-4a2a-b229-7a42af929046 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:46.129999 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8a8088f0-e871-4a2a-b229-7a42af929046 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:46.130765 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8a8088f0-e871-4a2a-b229-7a42af929046 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:46.131195 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8a8088f0-e871-4a2a-b229-7a42af929046 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:46.160248 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-8a8088f0-e871-4a2a-b229-7a42af929046 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047548 May 03 09:10:46.160826 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 477/1136] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:46 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:47.176352 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-fca5d61b-7095-429b-9620-4b010a465d5a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:47.178124 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-fca5d61b-7095-429b-9620-4b010a465d5a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:47.188861 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fca5d61b-7095-429b-9620-4b010a465d5a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:47.189336 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fca5d61b-7095-429b-9620-4b010a465d5a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:47.190140 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fca5d61b-7095-429b-9620-4b010a465d5a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:47.190578 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fca5d61b-7095-429b-9620-4b010a465d5a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:47.221376 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-fca5d61b-7095-429b-9620-4b010a465d5a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051306 May 03 09:10:47.225057 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 660/1137] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:47 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:48.233243 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-3e2eb1fd-1750-4f90-ae72-0d73272d0a44 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:48.234196 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-3e2eb1fd-1750-4f90-ae72-0d73272d0a44 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:48.240913 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3e2eb1fd-1750-4f90-ae72-0d73272d0a44 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:48.241362 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3e2eb1fd-1750-4f90-ae72-0d73272d0a44 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:48.242155 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3e2eb1fd-1750-4f90-ae72-0d73272d0a44 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:48.242602 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3e2eb1fd-1750-4f90-ae72-0d73272d0a44 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:48.273479 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-3e2eb1fd-1750-4f90-ae72-0d73272d0a44 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044230 May 03 09:10:48.276961 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 478/1138] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:48 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:49.290111 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3c6d9757-5590-4e2f-b375-f57ebae2bdd5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:49.291587 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-3c6d9757-5590-4e2f-b375-f57ebae2bdd5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:49.302343 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3c6d9757-5590-4e2f-b375-f57ebae2bdd5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:49.303093 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3c6d9757-5590-4e2f-b375-f57ebae2bdd5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:49.304752 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3c6d9757-5590-4e2f-b375-f57ebae2bdd5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:49.305489 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3c6d9757-5590-4e2f-b375-f57ebae2bdd5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:49.338965 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-3c6d9757-5590-4e2f-b375-f57ebae2bdd5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055974 May 03 09:10:49.339731 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 661/1139] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:49 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:50.355460 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ec541db3-1927-40ee-aec0-8c19c00d5a17 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:50.357022 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ec541db3-1927-40ee-aec0-8c19c00d5a17 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:50.366194 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ec541db3-1927-40ee-aec0-8c19c00d5a17 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:50.366691 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ec541db3-1927-40ee-aec0-8c19c00d5a17 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:50.367412 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ec541db3-1927-40ee-aec0-8c19c00d5a17 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:50.367893 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ec541db3-1927-40ee-aec0-8c19c00d5a17 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:50.397679 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ec541db3-1927-40ee-aec0-8c19c00d5a17 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048976 May 03 09:10:50.398247 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 479/1140] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:50 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:51.414001 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e808ad21-be9e-4770-995e-64cdb5490163 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:51.416656 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e808ad21-be9e-4770-995e-64cdb5490163 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:51.427443 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e808ad21-be9e-4770-995e-64cdb5490163 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:51.428254 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e808ad21-be9e-4770-995e-64cdb5490163 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:51.429575 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e808ad21-be9e-4770-995e-64cdb5490163 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:51.430321 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e808ad21-be9e-4770-995e-64cdb5490163 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:51.465551 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e808ad21-be9e-4770-995e-64cdb5490163 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058323 May 03 09:10:51.466265 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 662/1141] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:51 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:52.478069 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c78adcae-47e9-499f-ba9a-f7156d0c4762 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:52.478928 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c78adcae-47e9-499f-ba9a-f7156d0c4762 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:52.485785 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c78adcae-47e9-499f-ba9a-f7156d0c4762 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:52.486242 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c78adcae-47e9-499f-ba9a-f7156d0c4762 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:52.487020 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c78adcae-47e9-499f-ba9a-f7156d0c4762 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:52.487462 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c78adcae-47e9-499f-ba9a-f7156d0c4762 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:52.517274 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c78adcae-47e9-499f-ba9a-f7156d0c4762 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043361 May 03 09:10:52.517819 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 480/1142] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:52 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:53.534285 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-54674f78-0937-4c53-8d6c-2c70b625a0d2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:53.535502 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-54674f78-0937-4c53-8d6c-2c70b625a0d2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:53.542077 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-54674f78-0937-4c53-8d6c-2c70b625a0d2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:53.542525 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-54674f78-0937-4c53-8d6c-2c70b625a0d2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:53.543288 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-54674f78-0937-4c53-8d6c-2c70b625a0d2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:53.543724 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-54674f78-0937-4c53-8d6c-2c70b625a0d2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:53.573215 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-54674f78-0937-4c53-8d6c-2c70b625a0d2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045941 May 03 09:10:53.577016 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 663/1143] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:53 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:54.586072 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b519d9fb-4069-4d75-ba09-9b4aa803f0b7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:54.587057 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b519d9fb-4069-4d75-ba09-9b4aa803f0b7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:54.594826 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b519d9fb-4069-4d75-ba09-9b4aa803f0b7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:54.595412 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b519d9fb-4069-4d75-ba09-9b4aa803f0b7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:54.596698 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b519d9fb-4069-4d75-ba09-9b4aa803f0b7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:54.597210 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b519d9fb-4069-4d75-ba09-9b4aa803f0b7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:54.626778 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b519d9fb-4069-4d75-ba09-9b4aa803f0b7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045542 May 03 09:10:54.627343 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 481/1144] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:54 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:55.640671 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-667ceb2d-19e4-4694-830e-ab4032e01eee tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:55.641888 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-667ceb2d-19e4-4694-830e-ab4032e01eee tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:55.649124 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-667ceb2d-19e4-4694-830e-ab4032e01eee tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:55.649574 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-667ceb2d-19e4-4694-830e-ab4032e01eee tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:55.650382 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-667ceb2d-19e4-4694-830e-ab4032e01eee tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:55.650749 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-667ceb2d-19e4-4694-830e-ab4032e01eee tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:55.682040 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-667ceb2d-19e4-4694-830e-ab4032e01eee tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046533 May 03 09:10:55.682649 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 664/1145] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:55 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:56.697310 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-31e38ae4-7942-4e4d-886e-994822178152 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:56.699025 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-31e38ae4-7942-4e4d-886e-994822178152 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:56.709372 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-31e38ae4-7942-4e4d-886e-994822178152 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:56.710051 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-31e38ae4-7942-4e4d-886e-994822178152 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:56.711247 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-31e38ae4-7942-4e4d-886e-994822178152 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:56.712214 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-31e38ae4-7942-4e4d-886e-994822178152 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:56.745429 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-31e38ae4-7942-4e4d-886e-994822178152 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055043 May 03 09:10:56.746195 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 482/1146] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:56 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:57.757263 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-2143499a-357f-4d86-b0ea-0c2891f387ad tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:57.758182 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-2143499a-357f-4d86-b0ea-0c2891f387ad tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:57.765020 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2143499a-357f-4d86-b0ea-0c2891f387ad tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:57.765513 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2143499a-357f-4d86-b0ea-0c2891f387ad tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:57.766315 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2143499a-357f-4d86-b0ea-0c2891f387ad tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:57.766733 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2143499a-357f-4d86-b0ea-0c2891f387ad tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:57.796436 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-2143499a-357f-4d86-b0ea-0c2891f387ad tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043140 May 03 09:10:57.796999 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 665/1147] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:57 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:58.809567 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c16fab52-bb2d-4e7d-9ab0-d63e96750987 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:58.810684 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c16fab52-bb2d-4e7d-9ab0-d63e96750987 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:58.818309 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c16fab52-bb2d-4e7d-9ab0-d63e96750987 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:58.818759 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c16fab52-bb2d-4e7d-9ab0-d63e96750987 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:58.819503 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c16fab52-bb2d-4e7d-9ab0-d63e96750987 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:58.820011 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c16fab52-bb2d-4e7d-9ab0-d63e96750987 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:58.850298 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c16fab52-bb2d-4e7d-9ab0-d63e96750987 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045472 May 03 09:10:58.850865 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 483/1148] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:58 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:10:59.863326 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-6170f81e-92a8-438e-8e21-6e04c88e83dd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:10:59.864408 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-6170f81e-92a8-438e-8e21-6e04c88e83dd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:10:59.871130 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6170f81e-92a8-438e-8e21-6e04c88e83dd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:59.871584 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6170f81e-92a8-438e-8e21-6e04c88e83dd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:59.872372 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6170f81e-92a8-438e-8e21-6e04c88e83dd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:10:59.872835 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6170f81e-92a8-438e-8e21-6e04c88e83dd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:10:59.903114 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-6170f81e-92a8-438e-8e21-6e04c88e83dd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044305 May 03 09:10:59.903538 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 666/1149] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:10:59 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:00.916221 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7883add3-355a-4f5d-97df-6f8206272cc4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:00.917154 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7883add3-355a-4f5d-97df-6f8206272cc4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:00.928587 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7883add3-355a-4f5d-97df-6f8206272cc4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:00.928587 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7883add3-355a-4f5d-97df-6f8206272cc4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:00.929569 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7883add3-355a-4f5d-97df-6f8206272cc4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:00.929747 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7883add3-355a-4f5d-97df-6f8206272cc4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:00.962110 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7883add3-355a-4f5d-97df-6f8206272cc4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049991 May 03 09:11:00.962715 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 484/1150] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:00 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:01.978496 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-99fadacb-a04f-422c-9b54-c224f1aaf66b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:01.980038 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-99fadacb-a04f-422c-9b54-c224f1aaf66b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:01.990702 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-99fadacb-a04f-422c-9b54-c224f1aaf66b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:01.991476 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-99fadacb-a04f-422c-9b54-c224f1aaf66b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:01.993031 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-99fadacb-a04f-422c-9b54-c224f1aaf66b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:01.993761 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-99fadacb-a04f-422c-9b54-c224f1aaf66b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:02.027545 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-99fadacb-a04f-422c-9b54-c224f1aaf66b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056393 May 03 09:11:02.028484 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 667/1151] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:01 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:03.043302 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d18fa3a3-9f51-4485-a781-2070b5cb933a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:03.044685 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d18fa3a3-9f51-4485-a781-2070b5cb933a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:03.054487 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d18fa3a3-9f51-4485-a781-2070b5cb933a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:03.055278 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d18fa3a3-9f51-4485-a781-2070b5cb933a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:03.055808 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d18fa3a3-9f51-4485-a781-2070b5cb933a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:03.056279 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d18fa3a3-9f51-4485-a781-2070b5cb933a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:03.086448 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d18fa3a3-9f51-4485-a781-2070b5cb933a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049903 May 03 09:11:03.087031 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 485/1152] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:03 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:04.272814 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-35dac805-e791-479f-86d6-1593a068a3c2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:04.274495 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-35dac805-e791-479f-86d6-1593a068a3c2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:04.280599 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-35dac805-e791-479f-86d6-1593a068a3c2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:04.281047 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-35dac805-e791-479f-86d6-1593a068a3c2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:04.281811 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-35dac805-e791-479f-86d6-1593a068a3c2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:04.282214 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-35dac805-e791-479f-86d6-1593a068a3c2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:04.312016 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-35dac805-e791-479f-86d6-1593a068a3c2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.215991 May 03 09:11:04.312569 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 668/1153] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:04 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:05.327200 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-679e9fba-bc6c-4157-b076-5b5f878ccee3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:05.328855 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-679e9fba-bc6c-4157-b076-5b5f878ccee3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:05.339078 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-679e9fba-bc6c-4157-b076-5b5f878ccee3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:05.339660 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-679e9fba-bc6c-4157-b076-5b5f878ccee3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:05.340739 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-679e9fba-bc6c-4157-b076-5b5f878ccee3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:05.341330 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-679e9fba-bc6c-4157-b076-5b5f878ccee3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:05.378392 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-679e9fba-bc6c-4157-b076-5b5f878ccee3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057756 May 03 09:11:05.378964 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 486/1154] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:05 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:06.394921 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-18a6a417-e48d-4aba-85d8-7862fd6f99ce tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:06.396611 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-18a6a417-e48d-4aba-85d8-7862fd6f99ce tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:06.407266 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-18a6a417-e48d-4aba-85d8-7862fd6f99ce tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:06.408088 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-18a6a417-e48d-4aba-85d8-7862fd6f99ce tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:06.409333 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-18a6a417-e48d-4aba-85d8-7862fd6f99ce tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:06.410068 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-18a6a417-e48d-4aba-85d8-7862fd6f99ce tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:06.441432 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-18a6a417-e48d-4aba-85d8-7862fd6f99ce tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053388 May 03 09:11:06.442021 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 669/1155] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:06 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:07.457512 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c5d0177a-2be0-45a2-a3f1-b801f47d6671 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:07.458994 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c5d0177a-2be0-45a2-a3f1-b801f47d6671 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:07.467826 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c5d0177a-2be0-45a2-a3f1-b801f47d6671 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:07.467943 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c5d0177a-2be0-45a2-a3f1-b801f47d6671 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:07.468693 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c5d0177a-2be0-45a2-a3f1-b801f47d6671 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:07.469130 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c5d0177a-2be0-45a2-a3f1-b801f47d6671 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:07.499540 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c5d0177a-2be0-45a2-a3f1-b801f47d6671 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048739 May 03 09:11:07.500145 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 487/1156] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:07 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:08.515530 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-4ab1f4bb-25e6-4036-bb60-f5e7be49379a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:08.519180 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-4ab1f4bb-25e6-4036-bb60-f5e7be49379a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:08.527381 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4ab1f4bb-25e6-4036-bb60-f5e7be49379a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:08.528358 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4ab1f4bb-25e6-4036-bb60-f5e7be49379a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:08.529365 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4ab1f4bb-25e6-4036-bb60-f5e7be49379a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:08.530102 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4ab1f4bb-25e6-4036-bb60-f5e7be49379a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:08.564083 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-4ab1f4bb-25e6-4036-bb60-f5e7be49379a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055725 May 03 09:11:08.564653 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 670/1157] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:08 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:09.580318 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-785843df-d134-42f7-aa6f-78ac95845336 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:09.581673 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-785843df-d134-42f7-aa6f-78ac95845336 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:09.591747 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-785843df-d134-42f7-aa6f-78ac95845336 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:09.592106 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-785843df-d134-42f7-aa6f-78ac95845336 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:09.593008 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-785843df-d134-42f7-aa6f-78ac95845336 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:09.593456 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-785843df-d134-42f7-aa6f-78ac95845336 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:09.624951 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-785843df-d134-42f7-aa6f-78ac95845336 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051473 May 03 09:11:09.625557 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 488/1158] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:09 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:10.641588 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-7dcc10f9-5f09-4313-950d-ebaef455e46e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:10.643392 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-7dcc10f9-5f09-4313-950d-ebaef455e46e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:10.653617 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7dcc10f9-5f09-4313-950d-ebaef455e46e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:10.654612 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7dcc10f9-5f09-4313-950d-ebaef455e46e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:10.655977 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7dcc10f9-5f09-4313-950d-ebaef455e46e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:10.656708 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7dcc10f9-5f09-4313-950d-ebaef455e46e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:10.691124 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-7dcc10f9-5f09-4313-950d-ebaef455e46e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056521 May 03 09:11:10.695170 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 671/1159] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:10 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:11.707454 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-3ef4cd1d-2a15-4513-9beb-d894c173d034 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:11.709203 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-3ef4cd1d-2a15-4513-9beb-d894c173d034 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:11.718182 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3ef4cd1d-2a15-4513-9beb-d894c173d034 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:11.718630 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3ef4cd1d-2a15-4513-9beb-d894c173d034 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:11.719392 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3ef4cd1d-2a15-4513-9beb-d894c173d034 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:11.719824 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3ef4cd1d-2a15-4513-9beb-d894c173d034 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:11.751947 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-3ef4cd1d-2a15-4513-9beb-d894c173d034 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051124 May 03 09:11:11.752631 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 489/1160] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:11 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:12.768316 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-96666dbf-0f67-4989-9789-a90a27cac1f3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:12.769824 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-96666dbf-0f67-4989-9789-a90a27cac1f3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:12.779802 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-96666dbf-0f67-4989-9789-a90a27cac1f3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:12.780285 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-96666dbf-0f67-4989-9789-a90a27cac1f3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:12.781056 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-96666dbf-0f67-4989-9789-a90a27cac1f3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:12.781489 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-96666dbf-0f67-4989-9789-a90a27cac1f3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:12.810833 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-96666dbf-0f67-4989-9789-a90a27cac1f3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049529 May 03 09:11:12.811465 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 672/1161] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:12 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:13.826760 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-04b2da09-6816-43db-93be-7f95f462af63 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:13.828439 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-04b2da09-6816-43db-93be-7f95f462af63 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:13.836188 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-04b2da09-6816-43db-93be-7f95f462af63 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:13.836750 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-04b2da09-6816-43db-93be-7f95f462af63 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:13.837713 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-04b2da09-6816-43db-93be-7f95f462af63 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:13.838323 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-04b2da09-6816-43db-93be-7f95f462af63 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:13.871702 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-04b2da09-6816-43db-93be-7f95f462af63 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051455 May 03 09:11:13.872327 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 490/1162] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:13 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:14.887722 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-26e1560f-6620-4965-8932-666c20f50237 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:14.889532 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-26e1560f-6620-4965-8932-666c20f50237 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:14.899848 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-26e1560f-6620-4965-8932-666c20f50237 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:14.900623 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-26e1560f-6620-4965-8932-666c20f50237 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:14.901876 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-26e1560f-6620-4965-8932-666c20f50237 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:14.902590 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-26e1560f-6620-4965-8932-666c20f50237 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:14.932535 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-26e1560f-6620-4965-8932-666c20f50237 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051605 May 03 09:11:14.933271 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 673/1163] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:14 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:15.950059 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-876c7c76-ceef-419c-8c97-a900b1ca4f13 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:15.950851 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-876c7c76-ceef-419c-8c97-a900b1ca4f13 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:15.957561 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-876c7c76-ceef-419c-8c97-a900b1ca4f13 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:15.958015 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-876c7c76-ceef-419c-8c97-a900b1ca4f13 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:15.958824 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-876c7c76-ceef-419c-8c97-a900b1ca4f13 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:15.959265 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-876c7c76-ceef-419c-8c97-a900b1ca4f13 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:15.988347 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-876c7c76-ceef-419c-8c97-a900b1ca4f13 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045375 May 03 09:11:15.989116 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 491/1164] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:15 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:17.005320 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-286d5a97-7a46-415a-8d53-54f56d50cf4a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:17.005948 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-286d5a97-7a46-415a-8d53-54f56d50cf4a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:17.016817 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-286d5a97-7a46-415a-8d53-54f56d50cf4a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:17.017570 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-286d5a97-7a46-415a-8d53-54f56d50cf4a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:17.018841 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-286d5a97-7a46-415a-8d53-54f56d50cf4a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:17.019552 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-286d5a97-7a46-415a-8d53-54f56d50cf4a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:17.054010 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-286d5a97-7a46-415a-8d53-54f56d50cf4a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056275 May 03 09:11:17.054584 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 674/1165] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:16 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:18.070133 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a9bddb50-320d-46db-a396-92f69e36687a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:18.071635 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a9bddb50-320d-46db-a396-92f69e36687a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:18.079667 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a9bddb50-320d-46db-a396-92f69e36687a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:18.080146 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a9bddb50-320d-46db-a396-92f69e36687a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:18.080882 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a9bddb50-320d-46db-a396-92f69e36687a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:18.081347 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a9bddb50-320d-46db-a396-92f69e36687a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:18.111131 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a9bddb50-320d-46db-a396-92f69e36687a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047697 May 03 09:11:18.113402 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 492/1166] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:18 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:19.125731 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-58bb836e-b052-499c-9d06-8b28cf6f7dd0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:19.126649 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-58bb836e-b052-499c-9d06-8b28cf6f7dd0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:19.133142 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-58bb836e-b052-499c-9d06-8b28cf6f7dd0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:19.133585 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-58bb836e-b052-499c-9d06-8b28cf6f7dd0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:19.134397 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-58bb836e-b052-499c-9d06-8b28cf6f7dd0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:19.134821 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-58bb836e-b052-499c-9d06-8b28cf6f7dd0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:19.164930 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-58bb836e-b052-499c-9d06-8b28cf6f7dd0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044965 May 03 09:11:19.165524 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 675/1167] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:19 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:20.180993 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-351e9f49-dc36-4933-b47b-b98cf48ddb91 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:20.182616 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-351e9f49-dc36-4933-b47b-b98cf48ddb91 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:20.191088 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-351e9f49-dc36-4933-b47b-b98cf48ddb91 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:20.191543 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-351e9f49-dc36-4933-b47b-b98cf48ddb91 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:20.192120 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-351e9f49-dc36-4933-b47b-b98cf48ddb91 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:20.192585 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-351e9f49-dc36-4933-b47b-b98cf48ddb91 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:20.224080 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-351e9f49-dc36-4933-b47b-b98cf48ddb91 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049869 May 03 09:11:20.224645 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 493/1168] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:20 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:21.237884 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a9c97af4-f0ab-420c-ac9c-9f8324d0d5e5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:21.238830 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a9c97af4-f0ab-420c-ac9c-9f8324d0d5e5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:21.246133 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a9c97af4-f0ab-420c-ac9c-9f8324d0d5e5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:21.246599 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a9c97af4-f0ab-420c-ac9c-9f8324d0d5e5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:21.247342 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a9c97af4-f0ab-420c-ac9c-9f8324d0d5e5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:21.247800 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a9c97af4-f0ab-420c-ac9c-9f8324d0d5e5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:21.277129 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a9c97af4-f0ab-420c-ac9c-9f8324d0d5e5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043590 May 03 09:11:21.277696 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 676/1169] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:21 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:22.289633 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c7d4e55c-1871-4937-9b51-ac10070a0bb1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:22.290671 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c7d4e55c-1871-4937-9b51-ac10070a0bb1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:22.297286 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c7d4e55c-1871-4937-9b51-ac10070a0bb1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:22.297744 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c7d4e55c-1871-4937-9b51-ac10070a0bb1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:22.298965 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c7d4e55c-1871-4937-9b51-ac10070a0bb1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:22.298965 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c7d4e55c-1871-4937-9b51-ac10070a0bb1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:22.328457 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c7d4e55c-1871-4937-9b51-ac10070a0bb1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042967 May 03 09:11:22.329222 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 494/1170] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:22 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:23.344528 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-257c8c00-f652-4b73-bff9-daa1e4547971 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:23.351838 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-257c8c00-f652-4b73-bff9-daa1e4547971 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:23.364280 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-257c8c00-f652-4b73-bff9-daa1e4547971 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:23.364723 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-257c8c00-f652-4b73-bff9-daa1e4547971 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:23.365493 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-257c8c00-f652-4b73-bff9-daa1e4547971 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:23.365942 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-257c8c00-f652-4b73-bff9-daa1e4547971 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:23.395811 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-257c8c00-f652-4b73-bff9-daa1e4547971 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057999 May 03 09:11:23.396359 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 677/1171] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:23 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:24.411235 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-84b2361d-a99f-4437-af2a-430d503391f4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:24.412756 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-84b2361d-a99f-4437-af2a-430d503391f4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:24.423449 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-84b2361d-a99f-4437-af2a-430d503391f4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:24.424290 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-84b2361d-a99f-4437-af2a-430d503391f4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:24.425627 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-84b2361d-a99f-4437-af2a-430d503391f4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:24.426360 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-84b2361d-a99f-4437-af2a-430d503391f4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:24.460807 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-84b2361d-a99f-4437-af2a-430d503391f4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056593 May 03 09:11:24.461416 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 495/1172] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:24 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:25.480465 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-37fabd54-43bd-4383-898b-4bc021c4190f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:25.483181 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-37fabd54-43bd-4383-898b-4bc021c4190f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:25.493023 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-37fabd54-43bd-4383-898b-4bc021c4190f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:25.493473 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-37fabd54-43bd-4383-898b-4bc021c4190f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:25.494521 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-37fabd54-43bd-4383-898b-4bc021c4190f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:25.494980 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-37fabd54-43bd-4383-898b-4bc021c4190f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:25.525031 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-37fabd54-43bd-4383-898b-4bc021c4190f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054272 May 03 09:11:25.525597 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 678/1173] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:25 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:26.539513 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5bca07d3-835b-4677-b6d5-d99038c64afd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:26.540610 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5bca07d3-835b-4677-b6d5-d99038c64afd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:26.549042 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5bca07d3-835b-4677-b6d5-d99038c64afd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:26.549624 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5bca07d3-835b-4677-b6d5-d99038c64afd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:26.550593 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5bca07d3-835b-4677-b6d5-d99038c64afd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:26.551142 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5bca07d3-835b-4677-b6d5-d99038c64afd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:26.583359 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5bca07d3-835b-4677-b6d5-d99038c64afd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049181 May 03 09:11:26.584238 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 496/1174] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:26 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:27.598532 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-0f6d6185-02b6-4257-b157-d72e987cc063 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:27.600195 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-0f6d6185-02b6-4257-b157-d72e987cc063 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:27.606512 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0f6d6185-02b6-4257-b157-d72e987cc063 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:27.606726 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0f6d6185-02b6-4257-b157-d72e987cc063 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:27.607695 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0f6d6185-02b6-4257-b157-d72e987cc063 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:27.608114 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0f6d6185-02b6-4257-b157-d72e987cc063 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:27.637654 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-0f6d6185-02b6-4257-b157-d72e987cc063 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045452 May 03 09:11:27.638279 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 679/1175] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:27 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:28.652884 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-be63bdc0-4c2f-47e7-8ec4-5f2bdee17bb3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:28.654358 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-be63bdc0-4c2f-47e7-8ec4-5f2bdee17bb3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:28.665287 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-be63bdc0-4c2f-47e7-8ec4-5f2bdee17bb3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:28.666035 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-be63bdc0-4c2f-47e7-8ec4-5f2bdee17bb3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:28.667311 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-be63bdc0-4c2f-47e7-8ec4-5f2bdee17bb3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:28.668070 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-be63bdc0-4c2f-47e7-8ec4-5f2bdee17bb3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:28.700423 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-be63bdc0-4c2f-47e7-8ec4-5f2bdee17bb3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054295 May 03 09:11:28.701148 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 497/1176] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:28 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:29.716473 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-33e83dbb-782b-493d-a6f8-5da5a80780f7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:29.718080 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-33e83dbb-782b-493d-a6f8-5da5a80780f7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:29.726385 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-33e83dbb-782b-493d-a6f8-5da5a80780f7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:29.726827 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-33e83dbb-782b-493d-a6f8-5da5a80780f7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:29.727596 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-33e83dbb-782b-493d-a6f8-5da5a80780f7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:29.728068 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-33e83dbb-782b-493d-a6f8-5da5a80780f7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:29.758588 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-33e83dbb-782b-493d-a6f8-5da5a80780f7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048742 May 03 09:11:29.759165 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 680/1177] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:29 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:30.774843 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-97ac262d-ab58-4e1b-bb33-0ab27959be9b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:30.776362 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-97ac262d-ab58-4e1b-bb33-0ab27959be9b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:30.786446 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-97ac262d-ab58-4e1b-bb33-0ab27959be9b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:30.787192 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-97ac262d-ab58-4e1b-bb33-0ab27959be9b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:30.788510 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-97ac262d-ab58-4e1b-bb33-0ab27959be9b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:30.789222 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-97ac262d-ab58-4e1b-bb33-0ab27959be9b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:30.822851 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-97ac262d-ab58-4e1b-bb33-0ab27959be9b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054897 May 03 09:11:30.823428 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 498/1178] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:30 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:31.838876 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5b367bc8-99a0-47e1-b70a-6d6b80591d8d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:31.840470 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5b367bc8-99a0-47e1-b70a-6d6b80591d8d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:31.849606 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5b367bc8-99a0-47e1-b70a-6d6b80591d8d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:31.850074 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5b367bc8-99a0-47e1-b70a-6d6b80591d8d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:31.850833 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5b367bc8-99a0-47e1-b70a-6d6b80591d8d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:31.851257 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5b367bc8-99a0-47e1-b70a-6d6b80591d8d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:31.879987 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5b367bc8-99a0-47e1-b70a-6d6b80591d8d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047818 May 03 09:11:31.880594 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 681/1179] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:31 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:32.895189 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0cd25b41-a53c-445e-bbe3-89701397631a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:32.896358 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0cd25b41-a53c-445e-bbe3-89701397631a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:32.903092 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0cd25b41-a53c-445e-bbe3-89701397631a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:32.903537 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0cd25b41-a53c-445e-bbe3-89701397631a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:32.904329 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0cd25b41-a53c-445e-bbe3-89701397631a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:32.904756 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0cd25b41-a53c-445e-bbe3-89701397631a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:32.935422 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0cd25b41-a53c-445e-bbe3-89701397631a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045995 May 03 09:11:32.936022 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 499/1180] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:32 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:33.949790 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3df753d9-81a9-4124-9bb2-8b0c9b80971b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:33.950838 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-3df753d9-81a9-4124-9bb2-8b0c9b80971b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:33.959747 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3df753d9-81a9-4124-9bb2-8b0c9b80971b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:33.960272 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3df753d9-81a9-4124-9bb2-8b0c9b80971b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:33.961075 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3df753d9-81a9-4124-9bb2-8b0c9b80971b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:33.961543 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3df753d9-81a9-4124-9bb2-8b0c9b80971b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:33.991626 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-3df753d9-81a9-4124-9bb2-8b0c9b80971b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047384 May 03 09:11:33.992250 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 682/1181] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:33 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:35.007671 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-be9679bf-0286-49cb-bbbf-aea7144dcce2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:35.009145 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-be9679bf-0286-49cb-bbbf-aea7144dcce2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:35.019698 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-be9679bf-0286-49cb-bbbf-aea7144dcce2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:35.020473 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-be9679bf-0286-49cb-bbbf-aea7144dcce2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:35.021213 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-be9679bf-0286-49cb-bbbf-aea7144dcce2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:35.021673 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-be9679bf-0286-49cb-bbbf-aea7144dcce2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:35.051465 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-be9679bf-0286-49cb-bbbf-aea7144dcce2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050439 May 03 09:11:35.052043 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 500/1182] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:34 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:36.067405 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d55d66d5-a286-4a4a-bd7a-150c14f9392d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:36.068411 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d55d66d5-a286-4a4a-bd7a-150c14f9392d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:36.075368 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d55d66d5-a286-4a4a-bd7a-150c14f9392d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:36.075870 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d55d66d5-a286-4a4a-bd7a-150c14f9392d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:36.076674 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d55d66d5-a286-4a4a-bd7a-150c14f9392d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:36.077122 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d55d66d5-a286-4a4a-bd7a-150c14f9392d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:36.108669 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d55d66d5-a286-4a4a-bd7a-150c14f9392d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047941 May 03 09:11:36.109236 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 683/1183] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:36 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:37.126007 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f434152a-7dd9-460f-81e5-9090ce2c8e47 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:37.126632 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f434152a-7dd9-460f-81e5-9090ce2c8e47 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:37.137276 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f434152a-7dd9-460f-81e5-9090ce2c8e47 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:37.138003 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f434152a-7dd9-460f-81e5-9090ce2c8e47 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:37.139261 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f434152a-7dd9-460f-81e5-9090ce2c8e47 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:37.140033 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f434152a-7dd9-460f-81e5-9090ce2c8e47 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:37.172376 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f434152a-7dd9-460f-81e5-9090ce2c8e47 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054079 May 03 09:11:37.173159 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 501/1184] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:37 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:38.190158 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-20665b37-3081-4cfd-a2f3-210eb20fc14c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:38.190804 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-20665b37-3081-4cfd-a2f3-210eb20fc14c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:38.198436 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-20665b37-3081-4cfd-a2f3-210eb20fc14c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:38.198883 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-20665b37-3081-4cfd-a2f3-210eb20fc14c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:38.199634 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-20665b37-3081-4cfd-a2f3-210eb20fc14c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:38.200100 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-20665b37-3081-4cfd-a2f3-210eb20fc14c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:38.231321 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-20665b37-3081-4cfd-a2f3-210eb20fc14c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048978 May 03 09:11:38.232090 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 684/1185] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:38 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:39.243505 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-59485da3-64d0-4bbc-a13d-710cea900bda tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:39.244472 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-59485da3-64d0-4bbc-a13d-710cea900bda tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:39.250970 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-59485da3-64d0-4bbc-a13d-710cea900bda tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:39.251424 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-59485da3-64d0-4bbc-a13d-710cea900bda tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:39.252212 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-59485da3-64d0-4bbc-a13d-710cea900bda tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:39.252652 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-59485da3-64d0-4bbc-a13d-710cea900bda tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:39.284100 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-59485da3-64d0-4bbc-a13d-710cea900bda tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044607 May 03 09:11:39.284948 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 502/1186] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:39 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:40.296442 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a451eb4c-06f0-49e9-9a0d-4bf30010967b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:40.297374 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a451eb4c-06f0-49e9-9a0d-4bf30010967b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:40.304223 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a451eb4c-06f0-49e9-9a0d-4bf30010967b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:40.304676 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a451eb4c-06f0-49e9-9a0d-4bf30010967b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:40.305462 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a451eb4c-06f0-49e9-9a0d-4bf30010967b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:40.306034 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a451eb4c-06f0-49e9-9a0d-4bf30010967b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:40.335833 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a451eb4c-06f0-49e9-9a0d-4bf30010967b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043507 May 03 09:11:40.336423 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 685/1187] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:40 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:41.351943 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6e63a142-61bd-4b95-808b-fc7c5e6d6654 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:41.353048 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6e63a142-61bd-4b95-808b-fc7c5e6d6654 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:41.361250 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6e63a142-61bd-4b95-808b-fc7c5e6d6654 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:41.361811 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6e63a142-61bd-4b95-808b-fc7c5e6d6654 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:41.362771 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6e63a142-61bd-4b95-808b-fc7c5e6d6654 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:41.363311 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6e63a142-61bd-4b95-808b-fc7c5e6d6654 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:41.396354 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6e63a142-61bd-4b95-808b-fc7c5e6d6654 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051192 May 03 09:11:41.398310 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 503/1188] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:41 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:42.412392 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-70f4ce75-73e0-4b03-a4d2-33f097cb1f0d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:42.414059 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-70f4ce75-73e0-4b03-a4d2-33f097cb1f0d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:42.424967 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-70f4ce75-73e0-4b03-a4d2-33f097cb1f0d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:42.425712 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-70f4ce75-73e0-4b03-a4d2-33f097cb1f0d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:42.427083 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-70f4ce75-73e0-4b03-a4d2-33f097cb1f0d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:42.427810 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-70f4ce75-73e0-4b03-a4d2-33f097cb1f0d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:42.460000 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-70f4ce75-73e0-4b03-a4d2-33f097cb1f0d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054339 May 03 09:11:42.460557 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 686/1189] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:42 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:43.476693 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-27e303c5-be61-4eb4-927c-ae1aca505e24 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:43.477971 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-27e303c5-be61-4eb4-927c-ae1aca505e24 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:43.484921 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-27e303c5-be61-4eb4-927c-ae1aca505e24 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:43.485475 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-27e303c5-be61-4eb4-927c-ae1aca505e24 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:43.486256 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-27e303c5-be61-4eb4-927c-ae1aca505e24 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:43.486742 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-27e303c5-be61-4eb4-927c-ae1aca505e24 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:43.519857 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-27e303c5-be61-4eb4-927c-ae1aca505e24 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050324 May 03 09:11:43.520451 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 504/1190] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:43 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:44.535145 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e473a787-6d75-41cf-909d-f0cf6fa6ae54 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:44.536590 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e473a787-6d75-41cf-909d-f0cf6fa6ae54 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:44.547297 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e473a787-6d75-41cf-909d-f0cf6fa6ae54 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:44.547935 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e473a787-6d75-41cf-909d-f0cf6fa6ae54 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:44.549180 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e473a787-6d75-41cf-909d-f0cf6fa6ae54 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:44.549887 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e473a787-6d75-41cf-909d-f0cf6fa6ae54 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:44.582175 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e473a787-6d75-41cf-909d-f0cf6fa6ae54 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053747 May 03 09:11:44.582734 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 687/1191] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:44 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:45.599019 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-24736323-2f1d-4659-a8b4-b58226acb2fb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:45.600452 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-24736323-2f1d-4659-a8b4-b58226acb2fb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:45.608634 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-24736323-2f1d-4659-a8b4-b58226acb2fb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:45.609092 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-24736323-2f1d-4659-a8b4-b58226acb2fb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:45.609862 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-24736323-2f1d-4659-a8b4-b58226acb2fb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:45.610301 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-24736323-2f1d-4659-a8b4-b58226acb2fb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:45.640364 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-24736323-2f1d-4659-a8b4-b58226acb2fb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048717 May 03 09:11:45.640952 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 505/1192] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:45 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:46.653852 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-6fb97c80-77f3-4100-87b7-97ac1f7ab49c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:46.654859 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-6fb97c80-77f3-4100-87b7-97ac1f7ab49c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:46.661566 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6fb97c80-77f3-4100-87b7-97ac1f7ab49c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:46.662000 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6fb97c80-77f3-4100-87b7-97ac1f7ab49c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:46.662785 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6fb97c80-77f3-4100-87b7-97ac1f7ab49c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:46.663187 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6fb97c80-77f3-4100-87b7-97ac1f7ab49c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:46.696742 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-6fb97c80-77f3-4100-87b7-97ac1f7ab49c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047208 May 03 09:11:46.697490 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 688/1193] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:46 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:47.168244 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 09:11:47.168442 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: Tue May 3 09:11:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 03 09:11:47.709066 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c3bb67fb-a29d-413e-a5af-1d08842a46b9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:47.710412 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c3bb67fb-a29d-413e-a5af-1d08842a46b9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:47.716915 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c3bb67fb-a29d-413e-a5af-1d08842a46b9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:47.717361 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c3bb67fb-a29d-413e-a5af-1d08842a46b9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:47.718138 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c3bb67fb-a29d-413e-a5af-1d08842a46b9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:47.718569 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c3bb67fb-a29d-413e-a5af-1d08842a46b9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:47.750007 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c3bb67fb-a29d-413e-a5af-1d08842a46b9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045004 May 03 09:11:47.750568 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 506/1194] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:47 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:48.766626 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-88735222-357e-49e1-854c-cbc7893d1be2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:48.768246 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-88735222-357e-49e1-854c-cbc7893d1be2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:48.778988 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-88735222-357e-49e1-854c-cbc7893d1be2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:48.779732 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-88735222-357e-49e1-854c-cbc7893d1be2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:48.781056 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-88735222-357e-49e1-854c-cbc7893d1be2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:48.781818 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-88735222-357e-49e1-854c-cbc7893d1be2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:48.816802 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-88735222-357e-49e1-854c-cbc7893d1be2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057325 May 03 09:11:48.817367 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 689/1195] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:48 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:49.828860 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-33bbbe9f-c495-4508-8855-fe838dd85990 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:49.829807 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-33bbbe9f-c495-4508-8855-fe838dd85990 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:49.836571 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-33bbbe9f-c495-4508-8855-fe838dd85990 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:49.837026 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-33bbbe9f-c495-4508-8855-fe838dd85990 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:49.837810 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-33bbbe9f-c495-4508-8855-fe838dd85990 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:49.838243 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-33bbbe9f-c495-4508-8855-fe838dd85990 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:49.880880 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-33bbbe9f-c495-4508-8855-fe838dd85990 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056037 May 03 09:11:49.881466 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 507/1196] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:49 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:50.896075 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9d58af9e-d687-4df7-87d0-3775f2e55dbf tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:50.897567 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9d58af9e-d687-4df7-87d0-3775f2e55dbf tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:50.907610 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9d58af9e-d687-4df7-87d0-3775f2e55dbf tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:50.908339 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9d58af9e-d687-4df7-87d0-3775f2e55dbf tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:50.909374 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9d58af9e-d687-4df7-87d0-3775f2e55dbf tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:50.909980 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9d58af9e-d687-4df7-87d0-3775f2e55dbf tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:50.941616 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9d58af9e-d687-4df7-87d0-3775f2e55dbf tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052351 May 03 09:11:50.942144 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 690/1197] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:50 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:51.955142 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-680d334d-ee37-40ea-a9c5-c8ff8dafa4d2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:51.956670 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-680d334d-ee37-40ea-a9c5-c8ff8dafa4d2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:51.967029 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-680d334d-ee37-40ea-a9c5-c8ff8dafa4d2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:51.967488 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-680d334d-ee37-40ea-a9c5-c8ff8dafa4d2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:51.968653 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-680d334d-ee37-40ea-a9c5-c8ff8dafa4d2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:51.968755 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-680d334d-ee37-40ea-a9c5-c8ff8dafa4d2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:51.998303 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-680d334d-ee37-40ea-a9c5-c8ff8dafa4d2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048508 May 03 09:11:51.998878 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 508/1198] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:51 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:53.010218 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-21ffbd33-5fe7-4370-bcd7-69b5f5ef9c81 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:53.011149 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-21ffbd33-5fe7-4370-bcd7-69b5f5ef9c81 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:53.018344 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-21ffbd33-5fe7-4370-bcd7-69b5f5ef9c81 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:53.018790 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-21ffbd33-5fe7-4370-bcd7-69b5f5ef9c81 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:53.019571 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-21ffbd33-5fe7-4370-bcd7-69b5f5ef9c81 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:53.020045 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-21ffbd33-5fe7-4370-bcd7-69b5f5ef9c81 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:53.049381 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-21ffbd33-5fe7-4370-bcd7-69b5f5ef9c81 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043278 May 03 09:11:53.049965 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 691/1199] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:53 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:54.067873 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e3e5c599-558b-4f1a-af89-47591fd05728 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:54.070434 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e3e5c599-558b-4f1a-af89-47591fd05728 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:54.081807 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e3e5c599-558b-4f1a-af89-47591fd05728 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:54.082607 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e3e5c599-558b-4f1a-af89-47591fd05728 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:54.083868 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e3e5c599-558b-4f1a-af89-47591fd05728 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:54.085120 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e3e5c599-558b-4f1a-af89-47591fd05728 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:54.119073 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e3e5c599-558b-4f1a-af89-47591fd05728 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060051 May 03 09:11:54.119667 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 509/1200] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:54 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:55.132546 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-7a5851f1-4bce-4bf1-9868-efabaa2bdc3f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:55.133584 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-7a5851f1-4bce-4bf1-9868-efabaa2bdc3f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:55.140889 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7a5851f1-4bce-4bf1-9868-efabaa2bdc3f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:55.141344 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7a5851f1-4bce-4bf1-9868-efabaa2bdc3f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:55.142158 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7a5851f1-4bce-4bf1-9868-efabaa2bdc3f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:55.142720 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7a5851f1-4bce-4bf1-9868-efabaa2bdc3f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:55.172481 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-7a5851f1-4bce-4bf1-9868-efabaa2bdc3f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044521 May 03 09:11:55.173254 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 692/1201] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:55 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:56.188908 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9de819bb-8266-4dd3-ae4d-91d6dd1822e1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:56.190457 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9de819bb-8266-4dd3-ae4d-91d6dd1822e1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:56.201489 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9de819bb-8266-4dd3-ae4d-91d6dd1822e1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:56.202132 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9de819bb-8266-4dd3-ae4d-91d6dd1822e1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:56.202900 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9de819bb-8266-4dd3-ae4d-91d6dd1822e1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:56.203301 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9de819bb-8266-4dd3-ae4d-91d6dd1822e1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:56.233941 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9de819bb-8266-4dd3-ae4d-91d6dd1822e1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051831 May 03 09:11:56.234515 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 510/1202] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:56 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:57.246103 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-444554a9-0aac-4949-be52-38f46b04edb0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:57.247043 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-444554a9-0aac-4949-be52-38f46b04edb0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:57.253537 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-444554a9-0aac-4949-be52-38f46b04edb0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:57.253987 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-444554a9-0aac-4949-be52-38f46b04edb0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:57.254757 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-444554a9-0aac-4949-be52-38f46b04edb0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:57.255196 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-444554a9-0aac-4949-be52-38f46b04edb0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:57.285516 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-444554a9-0aac-4949-be52-38f46b04edb0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043607 May 03 09:11:57.286052 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 693/1203] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:57 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:58.299163 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f3ffb362-5d77-4e8c-9e0e-9ed118e6b681 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:58.300125 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f3ffb362-5d77-4e8c-9e0e-9ed118e6b681 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:58.306765 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f3ffb362-5d77-4e8c-9e0e-9ed118e6b681 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:58.307207 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f3ffb362-5d77-4e8c-9e0e-9ed118e6b681 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:58.308005 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f3ffb362-5d77-4e8c-9e0e-9ed118e6b681 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:58.308435 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f3ffb362-5d77-4e8c-9e0e-9ed118e6b681 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:58.337984 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f3ffb362-5d77-4e8c-9e0e-9ed118e6b681 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043620 May 03 09:11:58.339923 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 511/1204] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:58 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:11:58.400294 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 09:11:58.400806 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: Tue May 3 09:11:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 03 09:11:59.353910 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-82b30824-f779-4b51-ad99-7990e291ece2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:11:59.355445 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-82b30824-f779-4b51-ad99-7990e291ece2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:11:59.367745 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-82b30824-f779-4b51-ad99-7990e291ece2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:59.367745 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-82b30824-f779-4b51-ad99-7990e291ece2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:59.369012 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-82b30824-f779-4b51-ad99-7990e291ece2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:11:59.369012 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-82b30824-f779-4b51-ad99-7990e291ece2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:11:59.400650 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-82b30824-f779-4b51-ad99-7990e291ece2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053417 May 03 09:11:59.401483 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 694/1205] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:11:59 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:00.417198 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-66033810-b4d3-4c14-a690-58389dfc0999 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:00.418744 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-66033810-b4d3-4c14-a690-58389dfc0999 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:00.426446 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-66033810-b4d3-4c14-a690-58389dfc0999 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:00.427148 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-66033810-b4d3-4c14-a690-58389dfc0999 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:00.427638 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-66033810-b4d3-4c14-a690-58389dfc0999 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:00.428104 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-66033810-b4d3-4c14-a690-58389dfc0999 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:00.457711 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-66033810-b4d3-4c14-a690-58389dfc0999 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047205 May 03 09:12:00.458487 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 512/1206] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:00 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:01.472183 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-53d9065a-f38f-478f-aad0-6b591d242781 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:01.473410 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-53d9065a-f38f-478f-aad0-6b591d242781 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:01.482089 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-53d9065a-f38f-478f-aad0-6b591d242781 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:01.482715 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-53d9065a-f38f-478f-aad0-6b591d242781 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:01.483820 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-53d9065a-f38f-478f-aad0-6b591d242781 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:01.484347 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-53d9065a-f38f-478f-aad0-6b591d242781 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:01.513867 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-53d9065a-f38f-478f-aad0-6b591d242781 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047523 May 03 09:12:01.514416 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 695/1207] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:01 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:02.530268 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0bb47d2e-2444-41b4-a61b-256c231bddda tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:02.531534 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0bb47d2e-2444-41b4-a61b-256c231bddda tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:02.538909 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0bb47d2e-2444-41b4-a61b-256c231bddda tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:02.539378 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0bb47d2e-2444-41b4-a61b-256c231bddda tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:02.540237 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0bb47d2e-2444-41b4-a61b-256c231bddda tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:02.540687 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0bb47d2e-2444-41b4-a61b-256c231bddda tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:02.571908 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0bb47d2e-2444-41b4-a61b-256c231bddda tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048550 May 03 09:12:02.572474 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 513/1208] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:02 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:03.586116 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f8a43ccf-76af-4966-a2dd-0fab6a5521d8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:03.587049 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f8a43ccf-76af-4966-a2dd-0fab6a5521d8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:03.596340 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f8a43ccf-76af-4966-a2dd-0fab6a5521d8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:03.596670 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 09:12:03.597087 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f8a43ccf-76af-4966-a2dd-0fab6a5521d8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:03.597299 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: Tue May 3 09:12:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 03 09:12:03.597539 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f8a43ccf-76af-4966-a2dd-0fab6a5521d8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:03.597999 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f8a43ccf-76af-4966-a2dd-0fab6a5521d8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:03.627947 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f8a43ccf-76af-4966-a2dd-0fab6a5521d8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047812 May 03 09:12:03.628471 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 696/1209] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:03 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:03.698465 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-50565960-8d5c-4348-9890-94f051094cd2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:03.698960 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-50565960-8d5c-4348-9890-94f051094cd2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:03.705790 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-50565960-8d5c-4348-9890-94f051094cd2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:03.706240 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-50565960-8d5c-4348-9890-94f051094cd2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:03.707020 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-50565960-8d5c-4348-9890-94f051094cd2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:03.707454 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-50565960-8d5c-4348-9890-94f051094cd2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:03.732940 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-50565960-8d5c-4348-9890-94f051094cd2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Going to try to terminate instance {{(pid=123392) delete /opt/stack/nova/nova/compute/api.py:2664}} May 03 09:12:03.816770 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-50565960-8d5c-4348-9890-94f051094cd2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "DELETE /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 204 len: 0 microversion: 2.20 time: 0.121906 May 03 09:12:03.817504 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 514/1210] 10.222.0.11 () {60 vars in 1279 bytes} [Tue May 3 09:12:03 2022] DELETE /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 03 09:12:03.826017 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-676b7a48-d717-4a2b-b103-5734036c411b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:03.826629 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-676b7a48-d717-4a2b-b103-5734036c411b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:03.832787 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-676b7a48-d717-4a2b-b103-5734036c411b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:03.833241 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-676b7a48-d717-4a2b-b103-5734036c411b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:03.834009 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-676b7a48-d717-4a2b-b103-5734036c411b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:03.834450 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-676b7a48-d717-4a2b-b103-5734036c411b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:04.020778 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-676b7a48-d717-4a2b-b103-5734036c411b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:04.029727 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-676b7a48-d717-4a2b-b103-5734036c411b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:04.031324 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-676b7a48-d717-4a2b-b103-5734036c411b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:04.032539 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-676b7a48-d717-4a2b-b103-5734036c411b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.210489 May 03 09:12:04.033226 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 697/1211] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:12:03 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:12:04.644228 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-086cd106-49a1-4537-8528-7c2cfe787c04 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:04.645577 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-086cd106-49a1-4537-8528-7c2cfe787c04 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:04.653622 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-086cd106-49a1-4537-8528-7c2cfe787c04 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:04.654166 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-086cd106-49a1-4537-8528-7c2cfe787c04 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:04.655082 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-086cd106-49a1-4537-8528-7c2cfe787c04 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:04.655586 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-086cd106-49a1-4537-8528-7c2cfe787c04 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:04.685979 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-086cd106-49a1-4537-8528-7c2cfe787c04 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048838 May 03 09:12:04.686777 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 515/1212] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:04 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:05.052570 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f6aa1e54-4954-4ef6-b63b-3292a1fca118 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:05.053192 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f6aa1e54-4954-4ef6-b63b-3292a1fca118 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:05.060049 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f6aa1e54-4954-4ef6-b63b-3292a1fca118 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:05.060506 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f6aa1e54-4954-4ef6-b63b-3292a1fca118 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:05.061244 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f6aa1e54-4954-4ef6-b63b-3292a1fca118 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:05.061715 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f6aa1e54-4954-4ef6-b63b-3292a1fca118 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:05.194512 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f6aa1e54-4954-4ef6-b63b-3292a1fca118 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:05.203059 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f6aa1e54-4954-4ef6-b63b-3292a1fca118 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:05.204624 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f6aa1e54-4954-4ef6-b63b-3292a1fca118 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:05.205867 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f6aa1e54-4954-4ef6-b63b-3292a1fca118 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.157259 May 03 09:12:05.206392 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 698/1213] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:12:05 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:12:05.702689 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b032e239-5ea2-4107-b7ab-4f89d9d9d4eb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:05.704256 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b032e239-5ea2-4107-b7ab-4f89d9d9d4eb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:05.712738 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b032e239-5ea2-4107-b7ab-4f89d9d9d4eb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:05.713182 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b032e239-5ea2-4107-b7ab-4f89d9d9d4eb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:05.713938 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b032e239-5ea2-4107-b7ab-4f89d9d9d4eb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:05.714374 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b032e239-5ea2-4107-b7ab-4f89d9d9d4eb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:05.744599 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b032e239-5ea2-4107-b7ab-4f89d9d9d4eb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049069 May 03 09:12:05.745260 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 516/1214] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:05 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:06.225466 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-0485263b-7c25-4af1-ac0b-d9b0cef1b9cc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:06.227140 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-0485263b-7c25-4af1-ac0b-d9b0cef1b9cc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:06.234229 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0485263b-7c25-4af1-ac0b-d9b0cef1b9cc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:06.234690 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0485263b-7c25-4af1-ac0b-d9b0cef1b9cc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:06.235447 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0485263b-7c25-4af1-ac0b-d9b0cef1b9cc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:06.235915 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0485263b-7c25-4af1-ac0b-d9b0cef1b9cc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:06.373236 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-0485263b-7c25-4af1-ac0b-d9b0cef1b9cc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:06.386120 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-0485263b-7c25-4af1-ac0b-d9b0cef1b9cc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:06.388161 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-0485263b-7c25-4af1-ac0b-d9b0cef1b9cc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:06.389614 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-0485263b-7c25-4af1-ac0b-d9b0cef1b9cc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.169476 May 03 09:12:06.390432 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 699/1215] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:12:06 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:12:06.758725 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-acee7faa-109a-4514-add4-6c5e8ded900f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:06.759954 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-acee7faa-109a-4514-add4-6c5e8ded900f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:06.768745 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-acee7faa-109a-4514-add4-6c5e8ded900f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:06.769307 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-acee7faa-109a-4514-add4-6c5e8ded900f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:06.770332 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-acee7faa-109a-4514-add4-6c5e8ded900f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:06.770892 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-acee7faa-109a-4514-add4-6c5e8ded900f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:06.805212 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-acee7faa-109a-4514-add4-6c5e8ded900f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051719 May 03 09:12:06.805890 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 517/1216] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:06 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:07.412120 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-77a5e2c0-75f2-421a-870b-1d57b886483d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:07.412864 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-77a5e2c0-75f2-421a-870b-1d57b886483d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:07.420569 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-77a5e2c0-75f2-421a-870b-1d57b886483d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:07.421082 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-77a5e2c0-75f2-421a-870b-1d57b886483d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:07.421975 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-77a5e2c0-75f2-421a-870b-1d57b886483d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:07.422488 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-77a5e2c0-75f2-421a-870b-1d57b886483d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:07.553500 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-77a5e2c0-75f2-421a-870b-1d57b886483d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:07.562154 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-77a5e2c0-75f2-421a-870b-1d57b886483d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:07.563629 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-77a5e2c0-75f2-421a-870b-1d57b886483d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:07.564815 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-77a5e2c0-75f2-421a-870b-1d57b886483d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.158711 May 03 09:12:07.565367 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 700/1217] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:12:07 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:12:07.821571 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-db822a20-cd26-4004-8409-4bd96a284aa1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:07.823702 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-db822a20-cd26-4004-8409-4bd96a284aa1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:07.833392 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-db822a20-cd26-4004-8409-4bd96a284aa1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:07.833845 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-db822a20-cd26-4004-8409-4bd96a284aa1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:07.834614 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-db822a20-cd26-4004-8409-4bd96a284aa1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:07.835040 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-db822a20-cd26-4004-8409-4bd96a284aa1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:07.865045 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-db822a20-cd26-4004-8409-4bd96a284aa1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050343 May 03 09:12:07.865598 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 518/1218] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:07 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:08.587571 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-09b5ae6a-a5e1-4395-8a67-96ce79781329 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:08.588508 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-09b5ae6a-a5e1-4395-8a67-96ce79781329 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:08.599668 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-09b5ae6a-a5e1-4395-8a67-96ce79781329 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:08.600463 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-09b5ae6a-a5e1-4395-8a67-96ce79781329 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:08.601726 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-09b5ae6a-a5e1-4395-8a67-96ce79781329 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:08.602445 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-09b5ae6a-a5e1-4395-8a67-96ce79781329 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:08.744622 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-09b5ae6a-a5e1-4395-8a67-96ce79781329 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:08.757205 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-09b5ae6a-a5e1-4395-8a67-96ce79781329 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:08.759578 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-09b5ae6a-a5e1-4395-8a67-96ce79781329 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:08.761422 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-09b5ae6a-a5e1-4395-8a67-96ce79781329 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.180347 May 03 09:12:08.762249 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 701/1219] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:12:08 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:12:08.881072 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-69bcd108-1af6-43db-9831-b70a08f3bcc9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:08.881453 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-69bcd108-1af6-43db-9831-b70a08f3bcc9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:08.888256 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-69bcd108-1af6-43db-9831-b70a08f3bcc9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:08.888683 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-69bcd108-1af6-43db-9831-b70a08f3bcc9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:08.889446 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-69bcd108-1af6-43db-9831-b70a08f3bcc9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:08.889880 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-69bcd108-1af6-43db-9831-b70a08f3bcc9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:08.921611 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-69bcd108-1af6-43db-9831-b70a08f3bcc9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047081 May 03 09:12:08.922198 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 519/1220] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:08 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:09.784250 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d3f57810-7916-4981-aba6-1e2df5a66b5a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:09.785297 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d3f57810-7916-4981-aba6-1e2df5a66b5a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:09.792904 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d3f57810-7916-4981-aba6-1e2df5a66b5a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:09.793400 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d3f57810-7916-4981-aba6-1e2df5a66b5a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:09.794234 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d3f57810-7916-4981-aba6-1e2df5a66b5a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:09.794708 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d3f57810-7916-4981-aba6-1e2df5a66b5a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:09.932976 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-67ec4ff7-19eb-46ba-9be5-2ce5d6a38dc2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:09.934257 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-67ec4ff7-19eb-46ba-9be5-2ce5d6a38dc2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:09.935710 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d3f57810-7916-4981-aba6-1e2df5a66b5a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:09.940836 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-67ec4ff7-19eb-46ba-9be5-2ce5d6a38dc2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:09.941239 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-67ec4ff7-19eb-46ba-9be5-2ce5d6a38dc2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:09.942301 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-67ec4ff7-19eb-46ba-9be5-2ce5d6a38dc2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:09.942748 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-67ec4ff7-19eb-46ba-9be5-2ce5d6a38dc2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:09.944541 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d3f57810-7916-4981-aba6-1e2df5a66b5a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:09.945918 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d3f57810-7916-4981-aba6-1e2df5a66b5a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:09.947131 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d3f57810-7916-4981-aba6-1e2df5a66b5a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.169531 May 03 09:12:09.947951 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 702/1221] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:12:09 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:12:09.972544 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-67ec4ff7-19eb-46ba-9be5-2ce5d6a38dc2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043550 May 03 09:12:09.973112 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 520/1222] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:09 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:10.970086 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-955f6103-bd87-45bc-8eaf-75993c5b657a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:10.971533 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-955f6103-bd87-45bc-8eaf-75993c5b657a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:10.982213 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-955f6103-bd87-45bc-8eaf-75993c5b657a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:10.982966 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-955f6103-bd87-45bc-8eaf-75993c5b657a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:10.984284 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-955f6103-bd87-45bc-8eaf-75993c5b657a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:10.984972 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-955f6103-bd87-45bc-8eaf-75993c5b657a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:10.988728 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d7e53009-e67e-4077-98f3-21f8673e5e86 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:10.989836 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d7e53009-e67e-4077-98f3-21f8673e5e86 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:10.996400 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d7e53009-e67e-4077-98f3-21f8673e5e86 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:10.997008 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d7e53009-e67e-4077-98f3-21f8673e5e86 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:10.997820 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d7e53009-e67e-4077-98f3-21f8673e5e86 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:10.998200 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d7e53009-e67e-4077-98f3-21f8673e5e86 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:11.028545 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d7e53009-e67e-4077-98f3-21f8673e5e86 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046768 May 03 09:12:11.029435 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 521/1223] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:10 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:11.117860 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-955f6103-bd87-45bc-8eaf-75993c5b657a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:11.130436 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-955f6103-bd87-45bc-8eaf-75993c5b657a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:11.131964 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-955f6103-bd87-45bc-8eaf-75993c5b657a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:11.133155 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-955f6103-bd87-45bc-8eaf-75993c5b657a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.169792 May 03 09:12:11.133680 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 703/1224] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:12:10 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:12:12.044835 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-bb8bea01-0165-4d66-a646-d8523ce743b8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:12.046311 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-bb8bea01-0165-4d66-a646-d8523ce743b8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:12.057114 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bb8bea01-0165-4d66-a646-d8523ce743b8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:12.057859 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bb8bea01-0165-4d66-a646-d8523ce743b8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:12.059180 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bb8bea01-0165-4d66-a646-d8523ce743b8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:12.059945 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bb8bea01-0165-4d66-a646-d8523ce743b8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:12.092081 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-bb8bea01-0165-4d66-a646-d8523ce743b8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053995 May 03 09:12:12.092622 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 522/1225] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:12 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:12.154022 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c6186305-f6aa-44b0-8730-9f873c553b53 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:12.154649 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c6186305-f6aa-44b0-8730-9f873c553b53 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:12.163400 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c6186305-f6aa-44b0-8730-9f873c553b53 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:12.163868 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c6186305-f6aa-44b0-8730-9f873c553b53 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:12.164656 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c6186305-f6aa-44b0-8730-9f873c553b53 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:12.165087 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c6186305-f6aa-44b0-8730-9f873c553b53 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:12.304982 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c6186305-f6aa-44b0-8730-9f873c553b53 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:12.314067 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c6186305-f6aa-44b0-8730-9f873c553b53 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:12.315687 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c6186305-f6aa-44b0-8730-9f873c553b53 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:12.316922 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c6186305-f6aa-44b0-8730-9f873c553b53 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.168993 May 03 09:12:12.317507 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 704/1226] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:12:12 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:12:13.108749 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b5314683-c5b9-4ef0-8b13-256a5b3488ae tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:13.110357 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b5314683-c5b9-4ef0-8b13-256a5b3488ae tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:13.119546 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b5314683-c5b9-4ef0-8b13-256a5b3488ae tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:13.120019 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b5314683-c5b9-4ef0-8b13-256a5b3488ae tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:13.120789 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b5314683-c5b9-4ef0-8b13-256a5b3488ae tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:13.121239 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b5314683-c5b9-4ef0-8b13-256a5b3488ae tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:13.152198 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b5314683-c5b9-4ef0-8b13-256a5b3488ae tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050309 May 03 09:12:13.152765 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 523/1227] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:13 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:13.338852 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e289b807-7d66-4244-b46f-18f7461ed573 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:13.340025 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e289b807-7d66-4244-b46f-18f7461ed573 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:13.350953 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e289b807-7d66-4244-b46f-18f7461ed573 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:13.351413 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e289b807-7d66-4244-b46f-18f7461ed573 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:13.352207 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e289b807-7d66-4244-b46f-18f7461ed573 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:13.352652 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e289b807-7d66-4244-b46f-18f7461ed573 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:13.482881 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e289b807-7d66-4244-b46f-18f7461ed573 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:13.491476 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e289b807-7d66-4244-b46f-18f7461ed573 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:13.493117 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e289b807-7d66-4244-b46f-18f7461ed573 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:13.494274 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e289b807-7d66-4244-b46f-18f7461ed573 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.162107 May 03 09:12:13.494816 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 705/1228] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:12:13 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:12:14.168643 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-71a4740b-8299-425f-a268-2dc6a21e9965 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:14.171009 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-71a4740b-8299-425f-a268-2dc6a21e9965 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:14.181097 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-71a4740b-8299-425f-a268-2dc6a21e9965 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:14.181835 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-71a4740b-8299-425f-a268-2dc6a21e9965 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:14.183106 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-71a4740b-8299-425f-a268-2dc6a21e9965 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:14.183875 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-71a4740b-8299-425f-a268-2dc6a21e9965 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:14.217482 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-71a4740b-8299-425f-a268-2dc6a21e9965 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055722 May 03 09:12:14.218264 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 524/1229] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:14 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:14.516326 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b58bdb39-fb89-448c-8788-e09380f27542 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:14.517206 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b58bdb39-fb89-448c-8788-e09380f27542 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:14.526356 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b58bdb39-fb89-448c-8788-e09380f27542 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:14.526805 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b58bdb39-fb89-448c-8788-e09380f27542 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:14.527578 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b58bdb39-fb89-448c-8788-e09380f27542 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:14.528037 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b58bdb39-fb89-448c-8788-e09380f27542 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:14.662363 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b58bdb39-fb89-448c-8788-e09380f27542 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:14.670831 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b58bdb39-fb89-448c-8788-e09380f27542 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:14.672386 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b58bdb39-fb89-448c-8788-e09380f27542 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:14.673550 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b58bdb39-fb89-448c-8788-e09380f27542 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.163843 May 03 09:12:14.674107 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 706/1230] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:12:14 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:12:15.229804 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ed8d3c7d-9b90-423e-ab0f-0a708ecea852 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:15.230741 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ed8d3c7d-9b90-423e-ab0f-0a708ecea852 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:15.237583 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ed8d3c7d-9b90-423e-ab0f-0a708ecea852 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:15.238037 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ed8d3c7d-9b90-423e-ab0f-0a708ecea852 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:15.238811 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ed8d3c7d-9b90-423e-ab0f-0a708ecea852 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:15.239252 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ed8d3c7d-9b90-423e-ab0f-0a708ecea852 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:15.269499 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ed8d3c7d-9b90-423e-ab0f-0a708ecea852 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043676 May 03 09:12:15.270064 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 525/1231] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:15 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:15.696020 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-15b8480e-9787-42bb-82ab-cdb2e5aa4ace tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:15.696735 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-15b8480e-9787-42bb-82ab-cdb2e5aa4ace tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:15.704310 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-15b8480e-9787-42bb-82ab-cdb2e5aa4ace tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:15.704837 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-15b8480e-9787-42bb-82ab-cdb2e5aa4ace tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:15.705703 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-15b8480e-9787-42bb-82ab-cdb2e5aa4ace tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:15.706213 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-15b8480e-9787-42bb-82ab-cdb2e5aa4ace tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:15.808085 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 09:12:15.808291 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: Tue May 3 09:12:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 03 09:12:15.836746 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-15b8480e-9787-42bb-82ab-cdb2e5aa4ace tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:15.845012 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-15b8480e-9787-42bb-82ab-cdb2e5aa4ace tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:15.846950 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-15b8480e-9787-42bb-82ab-cdb2e5aa4ace tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:15.848138 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-15b8480e-9787-42bb-82ab-cdb2e5aa4ace tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.158793 May 03 09:12:15.848715 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 707/1232] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:12:15 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:12:16.284393 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d664e9c2-3c3b-44a9-84e3-5aa991111954 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:16.285363 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d664e9c2-3c3b-44a9-84e3-5aa991111954 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:16.292394 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d664e9c2-3c3b-44a9-84e3-5aa991111954 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:16.292873 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d664e9c2-3c3b-44a9-84e3-5aa991111954 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:16.293584 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d664e9c2-3c3b-44a9-84e3-5aa991111954 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:16.294018 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d664e9c2-3c3b-44a9-84e3-5aa991111954 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:16.324259 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d664e9c2-3c3b-44a9-84e3-5aa991111954 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046358 May 03 09:12:16.328052 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 526/1233] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:16 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:16.866721 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d6732c75-02a0-4d3b-b74e-e089fe273ef7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:16.867391 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d6732c75-02a0-4d3b-b74e-e089fe273ef7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:16.874260 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d6732c75-02a0-4d3b-b74e-e089fe273ef7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:16.874709 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d6732c75-02a0-4d3b-b74e-e089fe273ef7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:16.875468 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d6732c75-02a0-4d3b-b74e-e089fe273ef7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:16.875935 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d6732c75-02a0-4d3b-b74e-e089fe273ef7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:17.015835 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d6732c75-02a0-4d3b-b74e-e089fe273ef7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:17.027372 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d6732c75-02a0-4d3b-b74e-e089fe273ef7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:17.028891 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d6732c75-02a0-4d3b-b74e-e089fe273ef7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:17.030046 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d6732c75-02a0-4d3b-b74e-e089fe273ef7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.167267 May 03 09:12:17.030600 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 708/1234] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:12:16 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:12:17.340476 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5e0ed9a5-34fd-4828-9067-8af8c2b64aa4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:17.344720 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5e0ed9a5-34fd-4828-9067-8af8c2b64aa4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:17.354063 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5e0ed9a5-34fd-4828-9067-8af8c2b64aa4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:17.354515 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5e0ed9a5-34fd-4828-9067-8af8c2b64aa4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:17.355286 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5e0ed9a5-34fd-4828-9067-8af8c2b64aa4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:17.355724 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5e0ed9a5-34fd-4828-9067-8af8c2b64aa4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:17.384987 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5e0ed9a5-34fd-4828-9067-8af8c2b64aa4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051513 May 03 09:12:17.385765 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 527/1235] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:17 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:18.065056 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-1ad3b01f-120d-484d-9f69-ebad533e2509 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:18.065877 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-1ad3b01f-120d-484d-9f69-ebad533e2509 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:18.075176 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1ad3b01f-120d-484d-9f69-ebad533e2509 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:18.075750 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1ad3b01f-120d-484d-9f69-ebad533e2509 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:18.076526 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1ad3b01f-120d-484d-9f69-ebad533e2509 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:18.077002 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1ad3b01f-120d-484d-9f69-ebad533e2509 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:18.219370 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-1ad3b01f-120d-484d-9f69-ebad533e2509 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:18.228601 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-1ad3b01f-120d-484d-9f69-ebad533e2509 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:18.230092 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-1ad3b01f-120d-484d-9f69-ebad533e2509 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:18.231308 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-1ad3b01f-120d-484d-9f69-ebad533e2509 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.178310 May 03 09:12:18.231955 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 709/1236] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:12:18 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:12:18.405270 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d03ce5f7-06f5-4c7b-8bba-80d8ea26820d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:18.406352 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d03ce5f7-06f5-4c7b-8bba-80d8ea26820d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:18.414094 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d03ce5f7-06f5-4c7b-8bba-80d8ea26820d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:18.414611 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d03ce5f7-06f5-4c7b-8bba-80d8ea26820d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:18.415511 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d03ce5f7-06f5-4c7b-8bba-80d8ea26820d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:18.416071 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d03ce5f7-06f5-4c7b-8bba-80d8ea26820d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:18.448083 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d03ce5f7-06f5-4c7b-8bba-80d8ea26820d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053681 May 03 09:12:18.448622 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 528/1237] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:18 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:19.253220 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-8e0e3f1e-71c4-4614-8cb2-26ffaf0a51a0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:19.254197 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-8e0e3f1e-71c4-4614-8cb2-26ffaf0a51a0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:19.264334 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8e0e3f1e-71c4-4614-8cb2-26ffaf0a51a0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:19.265026 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8e0e3f1e-71c4-4614-8cb2-26ffaf0a51a0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:19.266173 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8e0e3f1e-71c4-4614-8cb2-26ffaf0a51a0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:19.266827 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8e0e3f1e-71c4-4614-8cb2-26ffaf0a51a0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:19.410561 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-8e0e3f1e-71c4-4614-8cb2-26ffaf0a51a0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:19.418996 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-8e0e3f1e-71c4-4614-8cb2-26ffaf0a51a0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:19.420546 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-8e0e3f1e-71c4-4614-8cb2-26ffaf0a51a0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:19.421736 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-8e0e3f1e-71c4-4614-8cb2-26ffaf0a51a0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.174748 May 03 09:12:19.422305 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 710/1238] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:12:19 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:12:19.460145 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5bd8b030-d82f-49e2-b9cd-c37a1a174dc0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:19.461140 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5bd8b030-d82f-49e2-b9cd-c37a1a174dc0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:19.469255 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5bd8b030-d82f-49e2-b9cd-c37a1a174dc0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:19.469929 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5bd8b030-d82f-49e2-b9cd-c37a1a174dc0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:19.471074 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5bd8b030-d82f-49e2-b9cd-c37a1a174dc0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:19.471523 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5bd8b030-d82f-49e2-b9cd-c37a1a174dc0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:19.512070 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5bd8b030-d82f-49e2-b9cd-c37a1a174dc0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055943 May 03 09:12:19.512624 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 529/1239] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:19 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:20.451558 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b7067c73-9a2f-455d-a944-2433b7ef4aff tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:20.452641 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b7067c73-9a2f-455d-a944-2433b7ef4aff tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:20.462567 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b7067c73-9a2f-455d-a944-2433b7ef4aff tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:20.463025 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b7067c73-9a2f-455d-a944-2433b7ef4aff tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:20.463798 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b7067c73-9a2f-455d-a944-2433b7ef4aff tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:20.464264 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b7067c73-9a2f-455d-a944-2433b7ef4aff tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:20.524054 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-bc8ccd8d-99ee-4c62-bc15-1ccb6faadc06 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:20.524986 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-bc8ccd8d-99ee-4c62-bc15-1ccb6faadc06 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:20.531073 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bc8ccd8d-99ee-4c62-bc15-1ccb6faadc06 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:20.531558 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bc8ccd8d-99ee-4c62-bc15-1ccb6faadc06 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:20.532378 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bc8ccd8d-99ee-4c62-bc15-1ccb6faadc06 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:20.532817 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bc8ccd8d-99ee-4c62-bc15-1ccb6faadc06 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:20.562736 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-bc8ccd8d-99ee-4c62-bc15-1ccb6faadc06 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042824 May 03 09:12:20.569042 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 530/1240] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:20 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 09:12:20.606268 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b7067c73-9a2f-455d-a944-2433b7ef4aff tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:20.614814 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b7067c73-9a2f-455d-a944-2433b7ef4aff tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:20.616344 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b7067c73-9a2f-455d-a944-2433b7ef4aff tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:20.617633 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b7067c73-9a2f-455d-a944-2433b7ef4aff tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.172908 May 03 09:12:20.618159 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 711/1241] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:12:20 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:12:21.579288 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-25daa62b-961d-4785-b4aa-e74da3536321 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:21.579941 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-25daa62b-961d-4785-b4aa-e74da3536321 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:21.590678 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-25daa62b-961d-4785-b4aa-e74da3536321 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:21.591435 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-25daa62b-961d-4785-b4aa-e74da3536321 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:21.593484 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-25daa62b-961d-4785-b4aa-e74da3536321 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:21.594237 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-25daa62b-961d-4785-b4aa-e74da3536321 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:21.628211 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-25daa62b-961d-4785-b4aa-e74da3536321 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056650 May 03 09:12:21.629010 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 531/1242] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:21 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:21.641786 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e34560bf-069e-4a47-9243-b973be364b31 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:21.642397 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e34560bf-069e-4a47-9243-b973be364b31 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:21.648958 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e34560bf-069e-4a47-9243-b973be364b31 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:21.649409 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e34560bf-069e-4a47-9243-b973be364b31 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:21.650173 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e34560bf-069e-4a47-9243-b973be364b31 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:21.650611 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e34560bf-069e-4a47-9243-b973be364b31 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:21.787158 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e34560bf-069e-4a47-9243-b973be364b31 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:21.795705 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e34560bf-069e-4a47-9243-b973be364b31 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:21.797231 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e34560bf-069e-4a47-9243-b973be364b31 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:21.798416 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e34560bf-069e-4a47-9243-b973be364b31 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.160646 May 03 09:12:21.798972 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 712/1243] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:12:21 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:12:22.644434 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9542d2a8-d67a-4c1e-800c-17cc2c3a0e28 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:22.646152 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9542d2a8-d67a-4c1e-800c-17cc2c3a0e28 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:22.653561 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9542d2a8-d67a-4c1e-800c-17cc2c3a0e28 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:22.654014 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9542d2a8-d67a-4c1e-800c-17cc2c3a0e28 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:22.654786 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9542d2a8-d67a-4c1e-800c-17cc2c3a0e28 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:22.655228 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9542d2a8-d67a-4c1e-800c-17cc2c3a0e28 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:22.684530 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9542d2a8-d67a-4c1e-800c-17cc2c3a0e28 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046746 May 03 09:12:22.685108 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 532/1244] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:22 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:22.820890 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b21c6ea8-e2a2-4277-9e0b-de45a93e9795 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:22.821893 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b21c6ea8-e2a2-4277-9e0b-de45a93e9795 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:22.832610 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b21c6ea8-e2a2-4277-9e0b-de45a93e9795 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:22.833400 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b21c6ea8-e2a2-4277-9e0b-de45a93e9795 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:22.834676 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b21c6ea8-e2a2-4277-9e0b-de45a93e9795 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:22.835408 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b21c6ea8-e2a2-4277-9e0b-de45a93e9795 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:22.964172 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b21c6ea8-e2a2-4277-9e0b-de45a93e9795 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:22.973236 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b21c6ea8-e2a2-4277-9e0b-de45a93e9795 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:22.974727 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b21c6ea8-e2a2-4277-9e0b-de45a93e9795 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:22.975951 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b21c6ea8-e2a2-4277-9e0b-de45a93e9795 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.161815 May 03 09:12:22.976563 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 713/1245] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:12:22 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:12:23.700800 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f45b7f43-12ac-4484-9bef-504a7ba44382 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:23.702518 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f45b7f43-12ac-4484-9bef-504a7ba44382 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:23.712112 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f45b7f43-12ac-4484-9bef-504a7ba44382 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:23.712556 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f45b7f43-12ac-4484-9bef-504a7ba44382 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:23.713364 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f45b7f43-12ac-4484-9bef-504a7ba44382 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:23.713791 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f45b7f43-12ac-4484-9bef-504a7ba44382 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:23.744168 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f45b7f43-12ac-4484-9bef-504a7ba44382 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050318 May 03 09:12:23.744729 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 533/1246] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:23 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:23.998970 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a9e0962a-850d-42a4-9157-9c039e9afddc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:23.999897 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a9e0962a-850d-42a4-9157-9c039e9afddc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:24.009739 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a9e0962a-850d-42a4-9157-9c039e9afddc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:24.010188 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a9e0962a-850d-42a4-9157-9c039e9afddc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:24.010951 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a9e0962a-850d-42a4-9157-9c039e9afddc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:24.011386 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a9e0962a-850d-42a4-9157-9c039e9afddc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:24.147507 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a9e0962a-850d-42a4-9157-9c039e9afddc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:24.156575 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a9e0962a-850d-42a4-9157-9c039e9afddc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:24.158064 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a9e0962a-850d-42a4-9157-9c039e9afddc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:24.159225 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a9e0962a-850d-42a4-9157-9c039e9afddc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.167125 May 03 09:12:24.159744 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 714/1247] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:12:23 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:12:24.759031 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f104f5da-cd7e-4cfe-b6ff-b9a212a64524 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:24.760386 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f104f5da-cd7e-4cfe-b6ff-b9a212a64524 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:24.768387 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f104f5da-cd7e-4cfe-b6ff-b9a212a64524 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:24.768943 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f104f5da-cd7e-4cfe-b6ff-b9a212a64524 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:24.769895 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f104f5da-cd7e-4cfe-b6ff-b9a212a64524 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:24.770437 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f104f5da-cd7e-4cfe-b6ff-b9a212a64524 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:24.803753 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f104f5da-cd7e-4cfe-b6ff-b9a212a64524 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051100 May 03 09:12:24.804400 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 534/1248] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:24 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:25.177332 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-fb759ce7-b4db-4bb9-b820-f7c4656df795 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:25.178173 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-fb759ce7-b4db-4bb9-b820-f7c4656df795 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:25.185872 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fb759ce7-b4db-4bb9-b820-f7c4656df795 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:25.186325 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fb759ce7-b4db-4bb9-b820-f7c4656df795 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:25.187100 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fb759ce7-b4db-4bb9-b820-f7c4656df795 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:25.187528 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fb759ce7-b4db-4bb9-b820-f7c4656df795 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:25.316710 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-fb759ce7-b4db-4bb9-b820-f7c4656df795 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:25.325312 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-fb759ce7-b4db-4bb9-b820-f7c4656df795 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:25.326815 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-fb759ce7-b4db-4bb9-b820-f7c4656df795 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:25.328380 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-fb759ce7-b4db-4bb9-b820-f7c4656df795 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.155122 May 03 09:12:25.328970 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 715/1249] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:12:25 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:12:25.819685 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-1a78fc6d-b710-465b-9e36-559412188ee1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:25.821410 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-1a78fc6d-b710-465b-9e36-559412188ee1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:25.832016 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1a78fc6d-b710-465b-9e36-559412188ee1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:25.832773 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1a78fc6d-b710-465b-9e36-559412188ee1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:25.834053 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1a78fc6d-b710-465b-9e36-559412188ee1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:25.834781 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1a78fc6d-b710-465b-9e36-559412188ee1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:25.864976 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-1a78fc6d-b710-465b-9e36-559412188ee1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051897 May 03 09:12:25.865539 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 535/1250] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:25 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:26.349120 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a886b09c-cf52-4caf-8577-031953a19696 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:26.349924 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a886b09c-cf52-4caf-8577-031953a19696 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:26.357533 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a886b09c-cf52-4caf-8577-031953a19696 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:26.357979 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a886b09c-cf52-4caf-8577-031953a19696 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:26.358751 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a886b09c-cf52-4caf-8577-031953a19696 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:26.359176 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a886b09c-cf52-4caf-8577-031953a19696 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:26.508770 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a886b09c-cf52-4caf-8577-031953a19696 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:26.519406 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a886b09c-cf52-4caf-8577-031953a19696 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:26.521021 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a886b09c-cf52-4caf-8577-031953a19696 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:26.522216 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a886b09c-cf52-4caf-8577-031953a19696 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.178975 May 03 09:12:26.522758 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 716/1251] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:12:26 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:12:26.881862 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-75e62f44-a28a-4f7f-84b5-079b8467396c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:26.884393 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-75e62f44-a28a-4f7f-84b5-079b8467396c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:26.890530 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-75e62f44-a28a-4f7f-84b5-079b8467396c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:26.890975 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-75e62f44-a28a-4f7f-84b5-079b8467396c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:26.891779 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-75e62f44-a28a-4f7f-84b5-079b8467396c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:26.892243 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-75e62f44-a28a-4f7f-84b5-079b8467396c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:26.923253 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-75e62f44-a28a-4f7f-84b5-079b8467396c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048785 May 03 09:12:26.924240 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 536/1252] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:26 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:27.549464 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-1e024924-d6df-4a12-b6d4-c74f2815ebe9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:27.550153 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-1e024924-d6df-4a12-b6d4-c74f2815ebe9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:27.561085 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1e024924-d6df-4a12-b6d4-c74f2815ebe9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:27.562335 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1e024924-d6df-4a12-b6d4-c74f2815ebe9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:27.563973 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1e024924-d6df-4a12-b6d4-c74f2815ebe9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:27.564414 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1e024924-d6df-4a12-b6d4-c74f2815ebe9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:27.701829 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-1e024924-d6df-4a12-b6d4-c74f2815ebe9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:27.712890 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-1e024924-d6df-4a12-b6d4-c74f2815ebe9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:27.715229 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-1e024924-d6df-4a12-b6d4-c74f2815ebe9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:27.717113 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-1e024924-d6df-4a12-b6d4-c74f2815ebe9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.173535 May 03 09:12:27.717891 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 717/1253] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:12:27 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:12:27.935736 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9730e345-498a-4418-9a49-06435f96e8b0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:27.937327 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9730e345-498a-4418-9a49-06435f96e8b0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:27.947834 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9730e345-498a-4418-9a49-06435f96e8b0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:27.948596 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9730e345-498a-4418-9a49-06435f96e8b0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:27.949812 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9730e345-498a-4418-9a49-06435f96e8b0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:27.950534 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9730e345-498a-4418-9a49-06435f96e8b0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:27.984653 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9730e345-498a-4418-9a49-06435f96e8b0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053667 May 03 09:12:27.985217 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 537/1254] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:27 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:28.743185 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-8b3d5bac-7904-466e-bbde-6581f9a50a46 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:28.744192 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-8b3d5bac-7904-466e-bbde-6581f9a50a46 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:28.752213 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8b3d5bac-7904-466e-bbde-6581f9a50a46 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:28.752704 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8b3d5bac-7904-466e-bbde-6581f9a50a46 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:28.753629 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8b3d5bac-7904-466e-bbde-6581f9a50a46 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:28.754159 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8b3d5bac-7904-466e-bbde-6581f9a50a46 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:28.887860 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-8b3d5bac-7904-466e-bbde-6581f9a50a46 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:28.896299 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-8b3d5bac-7904-466e-bbde-6581f9a50a46 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:28.897767 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-8b3d5bac-7904-466e-bbde-6581f9a50a46 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:28.899040 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-8b3d5bac-7904-466e-bbde-6581f9a50a46 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.162504 May 03 09:12:28.899593 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 718/1255] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:12:28 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:12:29.000561 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c877ea08-d9a2-40ff-9e81-747fc2610ef2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:29.001899 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c877ea08-d9a2-40ff-9e81-747fc2610ef2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:29.011802 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c877ea08-d9a2-40ff-9e81-747fc2610ef2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:29.012271 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c877ea08-d9a2-40ff-9e81-747fc2610ef2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:29.013045 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c877ea08-d9a2-40ff-9e81-747fc2610ef2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:29.013485 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c877ea08-d9a2-40ff-9e81-747fc2610ef2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:29.043532 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c877ea08-d9a2-40ff-9e81-747fc2610ef2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049749 May 03 09:12:29.044160 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 538/1256] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:28 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:29.924796 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a3c9a6ea-7d21-489f-a37c-b0aa288713cf tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:29.925509 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a3c9a6ea-7d21-489f-a37c-b0aa288713cf tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:29.935114 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a3c9a6ea-7d21-489f-a37c-b0aa288713cf tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:29.935666 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a3c9a6ea-7d21-489f-a37c-b0aa288713cf tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:29.936653 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a3c9a6ea-7d21-489f-a37c-b0aa288713cf tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:29.937216 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a3c9a6ea-7d21-489f-a37c-b0aa288713cf tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:30.054742 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d6ee8667-59cf-4c04-a2d0-ce091f8156ef tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:30.055662 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d6ee8667-59cf-4c04-a2d0-ce091f8156ef tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:30.062661 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d6ee8667-59cf-4c04-a2d0-ce091f8156ef tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:30.063109 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d6ee8667-59cf-4c04-a2d0-ce091f8156ef tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:30.066518 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a3c9a6ea-7d21-489f-a37c-b0aa288713cf tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:30.069941 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d6ee8667-59cf-4c04-a2d0-ce091f8156ef tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:30.070396 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d6ee8667-59cf-4c04-a2d0-ce091f8156ef tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:30.075295 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a3c9a6ea-7d21-489f-a37c-b0aa288713cf tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:30.076830 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a3c9a6ea-7d21-489f-a37c-b0aa288713cf tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:30.078061 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a3c9a6ea-7d21-489f-a37c-b0aa288713cf tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.159250 May 03 09:12:30.078603 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 719/1257] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:12:29 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:12:30.099917 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d6ee8667-59cf-4c04-a2d0-ce091f8156ef tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049046 May 03 09:12:30.100464 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 539/1258] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:30 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:31.100177 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-54d35c63-2d0f-4d7f-9fd8-405e2c4c4264 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:31.101154 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-54d35c63-2d0f-4d7f-9fd8-405e2c4c4264 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:31.112685 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-54d35c63-2d0f-4d7f-9fd8-405e2c4c4264 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:31.113821 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-54d35c63-2d0f-4d7f-9fd8-405e2c4c4264 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:31.114664 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-54d35c63-2d0f-4d7f-9fd8-405e2c4c4264 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:31.114960 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-21c50ab1-616e-43ed-b53a-24e69ed32f67 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:31.115681 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-54d35c63-2d0f-4d7f-9fd8-405e2c4c4264 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:31.116479 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-21c50ab1-616e-43ed-b53a-24e69ed32f67 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:31.124387 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-21c50ab1-616e-43ed-b53a-24e69ed32f67 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:31.124831 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-21c50ab1-616e-43ed-b53a-24e69ed32f67 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:31.125569 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-21c50ab1-616e-43ed-b53a-24e69ed32f67 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:31.126026 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-21c50ab1-616e-43ed-b53a-24e69ed32f67 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:31.154944 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-21c50ab1-616e-43ed-b53a-24e69ed32f67 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046822 May 03 09:12:31.155528 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 540/1259] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:31 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:31.250180 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-54d35c63-2d0f-4d7f-9fd8-405e2c4c4264 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:31.258332 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-54d35c63-2d0f-4d7f-9fd8-405e2c4c4264 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:31.259795 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-54d35c63-2d0f-4d7f-9fd8-405e2c4c4264 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:31.261042 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-54d35c63-2d0f-4d7f-9fd8-405e2c4c4264 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.167789 May 03 09:12:31.261614 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 720/1260] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:12:31 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:12:32.171562 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ee8fee99-1b5e-4d50-a25d-d9a5bebc32f8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:32.173121 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ee8fee99-1b5e-4d50-a25d-d9a5bebc32f8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:32.183963 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ee8fee99-1b5e-4d50-a25d-d9a5bebc32f8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:32.184715 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ee8fee99-1b5e-4d50-a25d-d9a5bebc32f8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:32.186026 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ee8fee99-1b5e-4d50-a25d-d9a5bebc32f8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:32.186712 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ee8fee99-1b5e-4d50-a25d-d9a5bebc32f8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:32.222283 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ee8fee99-1b5e-4d50-a25d-d9a5bebc32f8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057750 May 03 09:12:32.226257 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 541/1261] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:32 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:32.279353 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ddbcea6e-5fab-4389-9d09-7996cabb8e76 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:32.280099 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ddbcea6e-5fab-4389-9d09-7996cabb8e76 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:32.286834 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ddbcea6e-5fab-4389-9d09-7996cabb8e76 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:32.287282 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ddbcea6e-5fab-4389-9d09-7996cabb8e76 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:32.288086 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ddbcea6e-5fab-4389-9d09-7996cabb8e76 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:32.288522 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ddbcea6e-5fab-4389-9d09-7996cabb8e76 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:32.425715 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ddbcea6e-5fab-4389-9d09-7996cabb8e76 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:32.435084 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ddbcea6e-5fab-4389-9d09-7996cabb8e76 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:32.436613 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ddbcea6e-5fab-4389-9d09-7996cabb8e76 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:32.437771 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ddbcea6e-5fab-4389-9d09-7996cabb8e76 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.162543 May 03 09:12:32.438320 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 721/1262] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:12:32 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:12:33.234508 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-447f154d-b1a1-4230-bce9-10aea75b276c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:33.235441 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-447f154d-b1a1-4230-bce9-10aea75b276c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:33.242180 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-447f154d-b1a1-4230-bce9-10aea75b276c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:33.242761 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-447f154d-b1a1-4230-bce9-10aea75b276c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:33.243398 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-447f154d-b1a1-4230-bce9-10aea75b276c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:33.243862 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-447f154d-b1a1-4230-bce9-10aea75b276c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:33.273672 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-447f154d-b1a1-4230-bce9-10aea75b276c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043216 May 03 09:12:33.274274 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 542/1263] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:33 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:33.460107 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-eb7444dd-7c37-432d-9ed1-4244357a13fa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:33.461103 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-eb7444dd-7c37-432d-9ed1-4244357a13fa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:33.472559 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-eb7444dd-7c37-432d-9ed1-4244357a13fa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:33.473202 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-eb7444dd-7c37-432d-9ed1-4244357a13fa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:33.474469 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-eb7444dd-7c37-432d-9ed1-4244357a13fa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:33.475246 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-eb7444dd-7c37-432d-9ed1-4244357a13fa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:33.609457 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-eb7444dd-7c37-432d-9ed1-4244357a13fa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:33.617778 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-eb7444dd-7c37-432d-9ed1-4244357a13fa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:33.619278 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-eb7444dd-7c37-432d-9ed1-4244357a13fa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:33.620481 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-eb7444dd-7c37-432d-9ed1-4244357a13fa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.166929 May 03 09:12:33.621038 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 722/1264] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:12:33 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:12:34.290040 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-eaa99b25-4fc1-4ab3-9606-e223c7cbce2f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:34.291557 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-eaa99b25-4fc1-4ab3-9606-e223c7cbce2f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:34.299616 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-eaa99b25-4fc1-4ab3-9606-e223c7cbce2f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:34.299616 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-eaa99b25-4fc1-4ab3-9606-e223c7cbce2f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:34.300288 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-eaa99b25-4fc1-4ab3-9606-e223c7cbce2f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:34.300724 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-eaa99b25-4fc1-4ab3-9606-e223c7cbce2f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:34.331121 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-eaa99b25-4fc1-4ab3-9606-e223c7cbce2f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047753 May 03 09:12:34.331684 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 543/1265] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:34 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:34.643066 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ea3da3bd-0511-4ec4-aed3-02e20ffa16fa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:34.644126 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ea3da3bd-0511-4ec4-aed3-02e20ffa16fa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:34.653901 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ea3da3bd-0511-4ec4-aed3-02e20ffa16fa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:34.654353 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ea3da3bd-0511-4ec4-aed3-02e20ffa16fa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:34.655116 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ea3da3bd-0511-4ec4-aed3-02e20ffa16fa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:34.655546 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ea3da3bd-0511-4ec4-aed3-02e20ffa16fa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:34.795274 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ea3da3bd-0511-4ec4-aed3-02e20ffa16fa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:34.804353 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ea3da3bd-0511-4ec4-aed3-02e20ffa16fa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:34.805842 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ea3da3bd-0511-4ec4-aed3-02e20ffa16fa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:34.807001 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ea3da3bd-0511-4ec4-aed3-02e20ffa16fa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.170919 May 03 09:12:34.807545 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 723/1266] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:12:34 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:12:35.344588 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-34cf1926-511a-466b-b0c8-d61cd863221f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:35.345875 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-34cf1926-511a-466b-b0c8-d61cd863221f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:35.352749 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-34cf1926-511a-466b-b0c8-d61cd863221f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:35.353188 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-34cf1926-511a-466b-b0c8-d61cd863221f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:35.353899 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-34cf1926-511a-466b-b0c8-d61cd863221f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:35.354356 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-34cf1926-511a-466b-b0c8-d61cd863221f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:35.383862 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-34cf1926-511a-466b-b0c8-d61cd863221f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043713 May 03 09:12:35.384423 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 544/1267] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:35 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:35.526857 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 09:12:35.527183 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: Tue May 3 09:12:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 03 09:12:35.826384 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-69bd0a57-a0c6-4970-bea2-f4db6148f559 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:35.827179 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-69bd0a57-a0c6-4970-bea2-f4db6148f559 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:35.836761 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-69bd0a57-a0c6-4970-bea2-f4db6148f559 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:35.837393 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-69bd0a57-a0c6-4970-bea2-f4db6148f559 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:35.838495 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-69bd0a57-a0c6-4970-bea2-f4db6148f559 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:35.839123 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-69bd0a57-a0c6-4970-bea2-f4db6148f559 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:35.972308 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-69bd0a57-a0c6-4970-bea2-f4db6148f559 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:35.981132 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-69bd0a57-a0c6-4970-bea2-f4db6148f559 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:35.982637 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-69bd0a57-a0c6-4970-bea2-f4db6148f559 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:35.983792 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-69bd0a57-a0c6-4970-bea2-f4db6148f559 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.162117 May 03 09:12:35.984372 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 724/1268] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:12:35 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:12:36.399895 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-833dbb27-5bfe-466a-9c96-57791f06e6d8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:36.401397 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-833dbb27-5bfe-466a-9c96-57791f06e6d8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:36.408725 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-833dbb27-5bfe-466a-9c96-57791f06e6d8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:36.409174 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-833dbb27-5bfe-466a-9c96-57791f06e6d8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:36.409940 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-833dbb27-5bfe-466a-9c96-57791f06e6d8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:36.410360 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-833dbb27-5bfe-466a-9c96-57791f06e6d8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:36.440362 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-833dbb27-5bfe-466a-9c96-57791f06e6d8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047176 May 03 09:12:36.440964 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 545/1269] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:36 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:37.002530 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-028a0ae8-dc76-4e7b-9747-226b1c5483f8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:37.003114 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-028a0ae8-dc76-4e7b-9747-226b1c5483f8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:37.009586 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-028a0ae8-dc76-4e7b-9747-226b1c5483f8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:37.010022 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-028a0ae8-dc76-4e7b-9747-226b1c5483f8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:37.010779 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-028a0ae8-dc76-4e7b-9747-226b1c5483f8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:37.011206 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-028a0ae8-dc76-4e7b-9747-226b1c5483f8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:37.145822 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-028a0ae8-dc76-4e7b-9747-226b1c5483f8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:37.158622 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-028a0ae8-dc76-4e7b-9747-226b1c5483f8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:37.161040 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-028a0ae8-dc76-4e7b-9747-226b1c5483f8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:37.162758 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-028a0ae8-dc76-4e7b-9747-226b1c5483f8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.164001 May 03 09:12:37.163552 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 725/1270] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:12:36 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:12:37.456627 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-597c855e-925a-4f07-8f79-8e046dad161f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:37.458118 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-597c855e-925a-4f07-8f79-8e046dad161f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:37.468656 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-597c855e-925a-4f07-8f79-8e046dad161f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:37.469109 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-597c855e-925a-4f07-8f79-8e046dad161f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:37.469882 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-597c855e-925a-4f07-8f79-8e046dad161f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:37.470726 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-597c855e-925a-4f07-8f79-8e046dad161f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:37.500403 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-597c855e-925a-4f07-8f79-8e046dad161f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050575 May 03 09:12:37.500961 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 546/1271] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:37 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:38.186330 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-cb352568-2cc3-4993-b072-24ae36ac9334 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:38.187373 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-cb352568-2cc3-4993-b072-24ae36ac9334 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:38.197938 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cb352568-2cc3-4993-b072-24ae36ac9334 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:38.198698 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cb352568-2cc3-4993-b072-24ae36ac9334 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:38.200702 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cb352568-2cc3-4993-b072-24ae36ac9334 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:38.201417 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cb352568-2cc3-4993-b072-24ae36ac9334 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:38.336154 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-cb352568-2cc3-4993-b072-24ae36ac9334 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:38.346250 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-cb352568-2cc3-4993-b072-24ae36ac9334 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:38.347754 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-cb352568-2cc3-4993-b072-24ae36ac9334 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:38.348947 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-cb352568-2cc3-4993-b072-24ae36ac9334 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.169413 May 03 09:12:38.349512 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 726/1272] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:12:38 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:12:38.516916 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-34514b01-7270-4f87-9496-52d86d0412f4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:38.518312 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-34514b01-7270-4f87-9496-52d86d0412f4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:38.528530 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-34514b01-7270-4f87-9496-52d86d0412f4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:38.529122 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-34514b01-7270-4f87-9496-52d86d0412f4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:38.530433 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-34514b01-7270-4f87-9496-52d86d0412f4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:38.530876 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-34514b01-7270-4f87-9496-52d86d0412f4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:38.560053 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-34514b01-7270-4f87-9496-52d86d0412f4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050214 May 03 09:12:38.560810 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 547/1273] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:38 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:39.371695 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-6055cf56-1eee-4b0e-ab55-8274f5ca1411 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:39.372788 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-6055cf56-1eee-4b0e-ab55-8274f5ca1411 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:39.383629 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6055cf56-1eee-4b0e-ab55-8274f5ca1411 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:39.384427 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6055cf56-1eee-4b0e-ab55-8274f5ca1411 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:39.385724 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6055cf56-1eee-4b0e-ab55-8274f5ca1411 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:39.386448 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6055cf56-1eee-4b0e-ab55-8274f5ca1411 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:39.529954 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-6055cf56-1eee-4b0e-ab55-8274f5ca1411 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:39.538374 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-6055cf56-1eee-4b0e-ab55-8274f5ca1411 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:39.539906 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-6055cf56-1eee-4b0e-ab55-8274f5ca1411 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:39.541084 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-6055cf56-1eee-4b0e-ab55-8274f5ca1411 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.176039 May 03 09:12:39.541633 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 727/1274] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:12:39 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:12:39.572207 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0891dcfe-c579-481a-b049-c5ad3038030d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:39.573176 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0891dcfe-c579-481a-b049-c5ad3038030d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:39.580106 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0891dcfe-c579-481a-b049-c5ad3038030d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:39.580607 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0891dcfe-c579-481a-b049-c5ad3038030d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:39.581386 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0891dcfe-c579-481a-b049-c5ad3038030d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:39.581827 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0891dcfe-c579-481a-b049-c5ad3038030d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:39.612084 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0891dcfe-c579-481a-b049-c5ad3038030d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043792 May 03 09:12:39.612643 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 548/1275] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:39 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:40.563749 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-05a8023d-3cf5-41f4-a350-c3e2cdd5099c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:40.564766 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-05a8023d-3cf5-41f4-a350-c3e2cdd5099c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:40.575609 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-05a8023d-3cf5-41f4-a350-c3e2cdd5099c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:40.576310 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-05a8023d-3cf5-41f4-a350-c3e2cdd5099c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:40.577570 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-05a8023d-3cf5-41f4-a350-c3e2cdd5099c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:40.578294 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-05a8023d-3cf5-41f4-a350-c3e2cdd5099c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:40.623240 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e2272fad-6aed-4963-9678-44332c7434b4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:40.624227 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e2272fad-6aed-4963-9678-44332c7434b4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:40.631173 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e2272fad-6aed-4963-9678-44332c7434b4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:40.631391 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e2272fad-6aed-4963-9678-44332c7434b4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:40.632146 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e2272fad-6aed-4963-9678-44332c7434b4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:40.632582 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e2272fad-6aed-4963-9678-44332c7434b4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:40.662917 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e2272fad-6aed-4963-9678-44332c7434b4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043602 May 03 09:12:40.663501 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 549/1276] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:40 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:40.715349 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-05a8023d-3cf5-41f4-a350-c3e2cdd5099c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:40.724388 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-05a8023d-3cf5-41f4-a350-c3e2cdd5099c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:40.725891 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-05a8023d-3cf5-41f4-a350-c3e2cdd5099c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:40.727054 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-05a8023d-3cf5-41f4-a350-c3e2cdd5099c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.170059 May 03 09:12:40.727611 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 728/1277] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:12:40 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:12:41.679253 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-cf099218-91c0-4815-b36f-63a6a76105a1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:41.680792 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-cf099218-91c0-4815-b36f-63a6a76105a1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:41.691273 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cf099218-91c0-4815-b36f-63a6a76105a1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:41.692082 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cf099218-91c0-4815-b36f-63a6a76105a1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:41.693621 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cf099218-91c0-4815-b36f-63a6a76105a1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:41.694053 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cf099218-91c0-4815-b36f-63a6a76105a1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:41.727110 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-cf099218-91c0-4815-b36f-63a6a76105a1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054510 May 03 09:12:41.727639 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 550/1278] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:41 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:41.745508 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-113e1c36-8ea3-46bb-a73e-af93cea09237 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:41.746125 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-113e1c36-8ea3-46bb-a73e-af93cea09237 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:41.752653 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-113e1c36-8ea3-46bb-a73e-af93cea09237 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:41.753110 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-113e1c36-8ea3-46bb-a73e-af93cea09237 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:41.753884 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-113e1c36-8ea3-46bb-a73e-af93cea09237 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:41.754322 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-113e1c36-8ea3-46bb-a73e-af93cea09237 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:41.881541 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-113e1c36-8ea3-46bb-a73e-af93cea09237 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:41.890649 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-113e1c36-8ea3-46bb-a73e-af93cea09237 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:41.892235 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-113e1c36-8ea3-46bb-a73e-af93cea09237 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:41.893405 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-113e1c36-8ea3-46bb-a73e-af93cea09237 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.151808 May 03 09:12:41.893967 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 729/1279] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:12:41 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:12:42.742883 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b22d8363-55a2-4a65-9e5c-ec775692d636 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:42.744459 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b22d8363-55a2-4a65-9e5c-ec775692d636 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:42.753060 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b22d8363-55a2-4a65-9e5c-ec775692d636 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:42.753534 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b22d8363-55a2-4a65-9e5c-ec775692d636 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:42.754362 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b22d8363-55a2-4a65-9e5c-ec775692d636 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:42.754790 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b22d8363-55a2-4a65-9e5c-ec775692d636 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:42.790717 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b22d8363-55a2-4a65-9e5c-ec775692d636 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054467 May 03 09:12:42.791547 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 551/1280] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:42 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:42.915958 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a0baab8c-2e77-4614-b9db-12fd6f560a63 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:42.916976 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a0baab8c-2e77-4614-b9db-12fd6f560a63 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:42.927849 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a0baab8c-2e77-4614-b9db-12fd6f560a63 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:42.928610 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a0baab8c-2e77-4614-b9db-12fd6f560a63 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:42.929911 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a0baab8c-2e77-4614-b9db-12fd6f560a63 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:42.930635 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a0baab8c-2e77-4614-b9db-12fd6f560a63 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:43.071539 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a0baab8c-2e77-4614-b9db-12fd6f560a63 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:43.084801 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a0baab8c-2e77-4614-b9db-12fd6f560a63 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:43.087163 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a0baab8c-2e77-4614-b9db-12fd6f560a63 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:43.089008 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a0baab8c-2e77-4614-b9db-12fd6f560a63 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.179413 May 03 09:12:43.089804 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 730/1281] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:12:42 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:12:43.806378 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-683c5b90-7349-4f47-81c6-f85ff5d68b9e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:43.807965 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-683c5b90-7349-4f47-81c6-f85ff5d68b9e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:43.816054 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-683c5b90-7349-4f47-81c6-f85ff5d68b9e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:43.816690 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-683c5b90-7349-4f47-81c6-f85ff5d68b9e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:43.817484 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-683c5b90-7349-4f47-81c6-f85ff5d68b9e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:43.817913 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-683c5b90-7349-4f47-81c6-f85ff5d68b9e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:43.849848 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-683c5b90-7349-4f47-81c6-f85ff5d68b9e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050128 May 03 09:12:43.852073 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 552/1282] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:43 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:44.112605 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-0b4a83e7-0343-42ee-ad62-60f24037353f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:44.113421 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-0b4a83e7-0343-42ee-ad62-60f24037353f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:44.124281 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0b4a83e7-0343-42ee-ad62-60f24037353f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:44.124989 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0b4a83e7-0343-42ee-ad62-60f24037353f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:44.126279 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0b4a83e7-0343-42ee-ad62-60f24037353f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:44.126993 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0b4a83e7-0343-42ee-ad62-60f24037353f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:44.267540 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-0b4a83e7-0343-42ee-ad62-60f24037353f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:44.275955 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-0b4a83e7-0343-42ee-ad62-60f24037353f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:44.277444 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-0b4a83e7-0343-42ee-ad62-60f24037353f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:44.278649 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-0b4a83e7-0343-42ee-ad62-60f24037353f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.172956 May 03 09:12:44.279203 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 731/1283] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:12:44 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:12:44.869146 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9460deaf-4a75-4318-844a-a4028632ba3e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:44.870665 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9460deaf-4a75-4318-844a-a4028632ba3e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:44.880752 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9460deaf-4a75-4318-844a-a4028632ba3e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:44.881497 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9460deaf-4a75-4318-844a-a4028632ba3e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:44.882856 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9460deaf-4a75-4318-844a-a4028632ba3e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:44.883574 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9460deaf-4a75-4318-844a-a4028632ba3e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:44.915144 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9460deaf-4a75-4318-844a-a4028632ba3e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052825 May 03 09:12:44.915732 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 553/1284] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:44 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:45.297509 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-2654e58f-071e-4f4c-b4c0-07c5f3106a2c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:45.298121 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-2654e58f-071e-4f4c-b4c0-07c5f3106a2c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:45.305122 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2654e58f-071e-4f4c-b4c0-07c5f3106a2c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:45.305600 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2654e58f-071e-4f4c-b4c0-07c5f3106a2c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:45.306411 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2654e58f-071e-4f4c-b4c0-07c5f3106a2c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:45.306877 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2654e58f-071e-4f4c-b4c0-07c5f3106a2c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:45.436788 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-2654e58f-071e-4f4c-b4c0-07c5f3106a2c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:45.445449 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-2654e58f-071e-4f4c-b4c0-07c5f3106a2c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:45.446951 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-2654e58f-071e-4f4c-b4c0-07c5f3106a2c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:45.448162 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-2654e58f-071e-4f4c-b4c0-07c5f3106a2c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.154876 May 03 09:12:45.448738 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 732/1285] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:12:45 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:12:45.932264 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-93496093-bc24-4b4f-abb9-108c4bdef398 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:45.932937 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-93496093-bc24-4b4f-abb9-108c4bdef398 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:45.941113 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-93496093-bc24-4b4f-abb9-108c4bdef398 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:45.941559 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-93496093-bc24-4b4f-abb9-108c4bdef398 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:45.942329 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-93496093-bc24-4b4f-abb9-108c4bdef398 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:45.942771 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-93496093-bc24-4b4f-abb9-108c4bdef398 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:45.972542 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-93496093-bc24-4b4f-abb9-108c4bdef398 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047865 May 03 09:12:45.973139 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 554/1286] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:45 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:46.466675 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-18848887-eb17-4dce-b18a-47c41713035a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:46.467198 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-18848887-eb17-4dce-b18a-47c41713035a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:46.474085 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-18848887-eb17-4dce-b18a-47c41713035a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:46.474984 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-18848887-eb17-4dce-b18a-47c41713035a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:46.475746 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-18848887-eb17-4dce-b18a-47c41713035a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:46.476205 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-18848887-eb17-4dce-b18a-47c41713035a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:46.692727 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-18848887-eb17-4dce-b18a-47c41713035a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:46.701395 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-18848887-eb17-4dce-b18a-47c41713035a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:46.702931 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-18848887-eb17-4dce-b18a-47c41713035a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:46.704128 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-18848887-eb17-4dce-b18a-47c41713035a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.241513 May 03 09:12:46.704691 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 733/1287] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:12:46 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:12:46.984673 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ddee72f7-b2a6-46ac-800d-54c7568c9b09 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:46.985631 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ddee72f7-b2a6-46ac-800d-54c7568c9b09 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:46.991987 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ddee72f7-b2a6-46ac-800d-54c7568c9b09 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:46.992375 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ddee72f7-b2a6-46ac-800d-54c7568c9b09 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:46.993144 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ddee72f7-b2a6-46ac-800d-54c7568c9b09 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:46.993563 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ddee72f7-b2a6-46ac-800d-54c7568c9b09 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:47.182336 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ddee72f7-b2a6-46ac-800d-54c7568c9b09 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.201687 May 03 09:12:47.182847 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 555/1288] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:46 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:47.726912 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-840ba4b1-aae5-4c91-9089-c025c66135d8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:47.727971 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-840ba4b1-aae5-4c91-9089-c025c66135d8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:47.737127 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-840ba4b1-aae5-4c91-9089-c025c66135d8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:47.737582 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-840ba4b1-aae5-4c91-9089-c025c66135d8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:47.738348 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-840ba4b1-aae5-4c91-9089-c025c66135d8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:47.738915 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-840ba4b1-aae5-4c91-9089-c025c66135d8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:47.873934 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-840ba4b1-aae5-4c91-9089-c025c66135d8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:47.882445 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-840ba4b1-aae5-4c91-9089-c025c66135d8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:47.883946 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-840ba4b1-aae5-4c91-9089-c025c66135d8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:47.885139 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-840ba4b1-aae5-4c91-9089-c025c66135d8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.165171 May 03 09:12:47.885687 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 734/1289] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:12:47 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:12:48.200714 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c2cad205-0124-4000-bc35-41cd5643a260 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:48.202317 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c2cad205-0124-4000-bc35-41cd5643a260 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:48.213430 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c2cad205-0124-4000-bc35-41cd5643a260 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:48.214177 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c2cad205-0124-4000-bc35-41cd5643a260 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:48.215444 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c2cad205-0124-4000-bc35-41cd5643a260 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:48.216587 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c2cad205-0124-4000-bc35-41cd5643a260 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:48.247521 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c2cad205-0124-4000-bc35-41cd5643a260 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054354 May 03 09:12:48.248118 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 556/1290] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:48 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:48.907050 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-918375c0-4970-46ea-ba0d-974a019be3d4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:48.907653 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-918375c0-4970-46ea-ba0d-974a019be3d4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:48.914461 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-918375c0-4970-46ea-ba0d-974a019be3d4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:48.914911 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-918375c0-4970-46ea-ba0d-974a019be3d4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:48.915674 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-918375c0-4970-46ea-ba0d-974a019be3d4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:48.916121 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-918375c0-4970-46ea-ba0d-974a019be3d4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:49.076388 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-918375c0-4970-46ea-ba0d-974a019be3d4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:49.086097 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-918375c0-4970-46ea-ba0d-974a019be3d4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:49.087708 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-918375c0-4970-46ea-ba0d-974a019be3d4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:49.088987 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-918375c0-4970-46ea-ba0d-974a019be3d4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.187815 May 03 09:12:49.089555 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 735/1291] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:12:48 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:12:49.259968 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f4acb632-8d94-4ae9-bfe1-f6a84424aa02 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:49.260882 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f4acb632-8d94-4ae9-bfe1-f6a84424aa02 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:49.267759 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f4acb632-8d94-4ae9-bfe1-f6a84424aa02 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:49.268232 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f4acb632-8d94-4ae9-bfe1-f6a84424aa02 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:49.269034 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f4acb632-8d94-4ae9-bfe1-f6a84424aa02 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:49.269475 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f4acb632-8d94-4ae9-bfe1-f6a84424aa02 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:49.299717 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f4acb632-8d94-4ae9-bfe1-f6a84424aa02 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043784 May 03 09:12:49.300314 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 557/1292] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:49 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:50.111823 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e38cda4b-53ab-4cd6-9423-91895a5b17ba tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:50.112833 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e38cda4b-53ab-4cd6-9423-91895a5b17ba tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:50.123631 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e38cda4b-53ab-4cd6-9423-91895a5b17ba tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:50.124428 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e38cda4b-53ab-4cd6-9423-91895a5b17ba tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:50.125685 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e38cda4b-53ab-4cd6-9423-91895a5b17ba tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:50.126406 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e38cda4b-53ab-4cd6-9423-91895a5b17ba tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:50.261669 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e38cda4b-53ab-4cd6-9423-91895a5b17ba tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:50.270163 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e38cda4b-53ab-4cd6-9423-91895a5b17ba tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:50.271700 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e38cda4b-53ab-4cd6-9423-91895a5b17ba tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:50.272908 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e38cda4b-53ab-4cd6-9423-91895a5b17ba tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.167864 May 03 09:12:50.273459 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 736/1293] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:12:50 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:12:50.313105 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7249c640-9751-45ad-b8cc-2814357a332f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:50.314022 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7249c640-9751-45ad-b8cc-2814357a332f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:50.321273 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7249c640-9751-45ad-b8cc-2814357a332f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:50.321725 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7249c640-9751-45ad-b8cc-2814357a332f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:50.325197 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7249c640-9751-45ad-b8cc-2814357a332f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:50.325197 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7249c640-9751-45ad-b8cc-2814357a332f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:50.356517 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7249c640-9751-45ad-b8cc-2814357a332f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049178 May 03 09:12:50.357345 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 558/1294] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:50 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:51.291001 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3172f39a-b399-430e-a323-a5f86fdbaa76 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:51.291601 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-3172f39a-b399-430e-a323-a5f86fdbaa76 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:51.298403 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3172f39a-b399-430e-a323-a5f86fdbaa76 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:51.298849 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3172f39a-b399-430e-a323-a5f86fdbaa76 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:51.299618 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3172f39a-b399-430e-a323-a5f86fdbaa76 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:51.300087 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3172f39a-b399-430e-a323-a5f86fdbaa76 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:51.369080 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-77b31f0d-6bd3-4e6e-b1bd-5f7fee11f826 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:51.370040 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-77b31f0d-6bd3-4e6e-b1bd-5f7fee11f826 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:51.376883 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-77b31f0d-6bd3-4e6e-b1bd-5f7fee11f826 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:51.377327 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-77b31f0d-6bd3-4e6e-b1bd-5f7fee11f826 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:51.378098 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-77b31f0d-6bd3-4e6e-b1bd-5f7fee11f826 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:51.378569 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-77b31f0d-6bd3-4e6e-b1bd-5f7fee11f826 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:51.409704 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-77b31f0d-6bd3-4e6e-b1bd-5f7fee11f826 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044641 May 03 09:12:51.410287 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 559/1295] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:51 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:51.455087 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-3172f39a-b399-430e-a323-a5f86fdbaa76 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:51.463671 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-3172f39a-b399-430e-a323-a5f86fdbaa76 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:51.465265 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-3172f39a-b399-430e-a323-a5f86fdbaa76 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:51.466375 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-3172f39a-b399-430e-a323-a5f86fdbaa76 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.179371 May 03 09:12:51.466935 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 737/1296] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:12:51 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:12:52.425014 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-81314ba6-ca2a-474b-8c84-c8e8ff1c3730 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:52.426276 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-81314ba6-ca2a-474b-8c84-c8e8ff1c3730 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:52.435322 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-81314ba6-ca2a-474b-8c84-c8e8ff1c3730 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:52.435990 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-81314ba6-ca2a-474b-8c84-c8e8ff1c3730 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:52.437048 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-81314ba6-ca2a-474b-8c84-c8e8ff1c3730 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:52.437635 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-81314ba6-ca2a-474b-8c84-c8e8ff1c3730 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:52.471385 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-81314ba6-ca2a-474b-8c84-c8e8ff1c3730 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052337 May 03 09:12:52.471885 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 560/1297] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:52 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:52.486036 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-34be1249-158e-476a-9e1f-4de179f7f3c8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:52.486649 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-34be1249-158e-476a-9e1f-4de179f7f3c8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:52.493295 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-34be1249-158e-476a-9e1f-4de179f7f3c8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:52.493744 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-34be1249-158e-476a-9e1f-4de179f7f3c8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:52.494518 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-34be1249-158e-476a-9e1f-4de179f7f3c8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:52.494954 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-34be1249-158e-476a-9e1f-4de179f7f3c8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:52.632837 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-34be1249-158e-476a-9e1f-4de179f7f3c8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:52.646045 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-34be1249-158e-476a-9e1f-4de179f7f3c8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:52.648354 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-34be1249-158e-476a-9e1f-4de179f7f3c8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:52.650089 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-34be1249-158e-476a-9e1f-4de179f7f3c8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.167725 May 03 09:12:52.650854 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 738/1298] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:12:52 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:12:53.485060 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-896f14dd-a5ff-4f5f-917e-d1bd8f8dd966 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:53.486033 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-896f14dd-a5ff-4f5f-917e-d1bd8f8dd966 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:53.493506 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-896f14dd-a5ff-4f5f-917e-d1bd8f8dd966 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:53.494062 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-896f14dd-a5ff-4f5f-917e-d1bd8f8dd966 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:53.494978 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-896f14dd-a5ff-4f5f-917e-d1bd8f8dd966 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:53.495458 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-896f14dd-a5ff-4f5f-917e-d1bd8f8dd966 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:53.531042 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-896f14dd-a5ff-4f5f-917e-d1bd8f8dd966 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051426 May 03 09:12:53.531607 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 561/1299] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:53 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:53.674019 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-038d05ae-7403-4a9c-a90b-a2c00f5a6618 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:53.674810 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-038d05ae-7403-4a9c-a90b-a2c00f5a6618 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:53.683738 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-038d05ae-7403-4a9c-a90b-a2c00f5a6618 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:53.684385 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-038d05ae-7403-4a9c-a90b-a2c00f5a6618 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:53.685409 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-038d05ae-7403-4a9c-a90b-a2c00f5a6618 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:53.686029 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-038d05ae-7403-4a9c-a90b-a2c00f5a6618 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:53.825532 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-038d05ae-7403-4a9c-a90b-a2c00f5a6618 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:53.834034 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-038d05ae-7403-4a9c-a90b-a2c00f5a6618 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:53.835546 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-038d05ae-7403-4a9c-a90b-a2c00f5a6618 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:53.836743 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-038d05ae-7403-4a9c-a90b-a2c00f5a6618 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.168890 May 03 09:12:53.837314 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 739/1300] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:12:53 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:12:54.547030 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2e160bfc-2a86-40e8-b550-de3de724ec5f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:54.547894 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-2e160bfc-2a86-40e8-b550-de3de724ec5f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:54.554576 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2e160bfc-2a86-40e8-b550-de3de724ec5f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:54.555003 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2e160bfc-2a86-40e8-b550-de3de724ec5f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:54.555802 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2e160bfc-2a86-40e8-b550-de3de724ec5f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:54.556236 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2e160bfc-2a86-40e8-b550-de3de724ec5f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:54.588972 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-2e160bfc-2a86-40e8-b550-de3de724ec5f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048413 May 03 09:12:54.589535 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 562/1301] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:54 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:54.855472 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-7cecb1e8-a070-424a-8565-7460a6af18dd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:54.856151 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-7cecb1e8-a070-424a-8565-7460a6af18dd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:54.862710 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7cecb1e8-a070-424a-8565-7460a6af18dd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:54.863154 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7cecb1e8-a070-424a-8565-7460a6af18dd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:54.863952 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7cecb1e8-a070-424a-8565-7460a6af18dd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:54.864394 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7cecb1e8-a070-424a-8565-7460a6af18dd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:54.997846 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7cecb1e8-a070-424a-8565-7460a6af18dd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:55.009044 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7cecb1e8-a070-424a-8565-7460a6af18dd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:55.011412 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7cecb1e8-a070-424a-8565-7460a6af18dd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:55.013183 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-7cecb1e8-a070-424a-8565-7460a6af18dd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.161399 May 03 09:12:55.013934 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 740/1302] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:12:54 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:12:55.605191 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-939f64ee-f19a-4b46-8ea8-c71dda9797e4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:55.606681 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-939f64ee-f19a-4b46-8ea8-c71dda9797e4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:55.617404 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-939f64ee-f19a-4b46-8ea8-c71dda9797e4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:55.618149 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-939f64ee-f19a-4b46-8ea8-c71dda9797e4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:55.619415 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-939f64ee-f19a-4b46-8ea8-c71dda9797e4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:55.620212 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-939f64ee-f19a-4b46-8ea8-c71dda9797e4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:55.650880 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-939f64ee-f19a-4b46-8ea8-c71dda9797e4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052562 May 03 09:12:55.651428 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 563/1303] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:55 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:56.032773 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5d8c76db-e1e6-4ecb-9059-15d6c6e204ca tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:56.033380 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5d8c76db-e1e6-4ecb-9059-15d6c6e204ca tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:56.040076 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5d8c76db-e1e6-4ecb-9059-15d6c6e204ca tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:56.040522 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5d8c76db-e1e6-4ecb-9059-15d6c6e204ca tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:56.041283 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5d8c76db-e1e6-4ecb-9059-15d6c6e204ca tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:56.041713 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5d8c76db-e1e6-4ecb-9059-15d6c6e204ca tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:56.172660 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5d8c76db-e1e6-4ecb-9059-15d6c6e204ca tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:56.180913 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5d8c76db-e1e6-4ecb-9059-15d6c6e204ca tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:56.182406 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5d8c76db-e1e6-4ecb-9059-15d6c6e204ca tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:56.183559 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5d8c76db-e1e6-4ecb-9059-15d6c6e204ca tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.154937 May 03 09:12:56.184159 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 741/1304] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:12:56 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:12:56.665314 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d0f8f46e-5fc9-43ee-a46c-6c355e5fccca tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:56.666636 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d0f8f46e-5fc9-43ee-a46c-6c355e5fccca tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:56.674921 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d0f8f46e-5fc9-43ee-a46c-6c355e5fccca tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:56.675383 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d0f8f46e-5fc9-43ee-a46c-6c355e5fccca tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:56.676166 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d0f8f46e-5fc9-43ee-a46c-6c355e5fccca tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:56.676606 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d0f8f46e-5fc9-43ee-a46c-6c355e5fccca tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:56.708764 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d0f8f46e-5fc9-43ee-a46c-6c355e5fccca tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049829 May 03 09:12:56.709322 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 564/1305] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:56 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:57.206267 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3e3f0aa5-cbc5-486c-80d7-23a2db3ea663 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:57.207116 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-3e3f0aa5-cbc5-486c-80d7-23a2db3ea663 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:57.217719 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3e3f0aa5-cbc5-486c-80d7-23a2db3ea663 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:57.218386 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3e3f0aa5-cbc5-486c-80d7-23a2db3ea663 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:57.219155 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3e3f0aa5-cbc5-486c-80d7-23a2db3ea663 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:57.219619 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3e3f0aa5-cbc5-486c-80d7-23a2db3ea663 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:57.355833 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-3e3f0aa5-cbc5-486c-80d7-23a2db3ea663 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:57.365187 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-3e3f0aa5-cbc5-486c-80d7-23a2db3ea663 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:57.366672 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-3e3f0aa5-cbc5-486c-80d7-23a2db3ea663 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:57.367912 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-3e3f0aa5-cbc5-486c-80d7-23a2db3ea663 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.168238 May 03 09:12:57.368467 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 742/1306] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:12:57 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:12:57.725431 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0f5c147c-a5de-43b5-a51e-2d5355ab8c76 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:57.726918 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0f5c147c-a5de-43b5-a51e-2d5355ab8c76 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:57.737754 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0f5c147c-a5de-43b5-a51e-2d5355ab8c76 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:57.738516 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0f5c147c-a5de-43b5-a51e-2d5355ab8c76 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:57.739826 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0f5c147c-a5de-43b5-a51e-2d5355ab8c76 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:57.740577 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0f5c147c-a5de-43b5-a51e-2d5355ab8c76 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:57.772942 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0f5c147c-a5de-43b5-a51e-2d5355ab8c76 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054770 May 03 09:12:57.773471 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 565/1307] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:57 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:58.387520 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c5b1e33d-af7a-4270-9ea1-f0ea52c8e3e7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:58.388248 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c5b1e33d-af7a-4270-9ea1-f0ea52c8e3e7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:58.396130 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c5b1e33d-af7a-4270-9ea1-f0ea52c8e3e7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:58.396659 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c5b1e33d-af7a-4270-9ea1-f0ea52c8e3e7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:58.397534 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c5b1e33d-af7a-4270-9ea1-f0ea52c8e3e7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:58.398018 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c5b1e33d-af7a-4270-9ea1-f0ea52c8e3e7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:58.546200 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c5b1e33d-af7a-4270-9ea1-f0ea52c8e3e7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:58.554977 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c5b1e33d-af7a-4270-9ea1-f0ea52c8e3e7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:58.556525 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c5b1e33d-af7a-4270-9ea1-f0ea52c8e3e7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:58.557741 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c5b1e33d-af7a-4270-9ea1-f0ea52c8e3e7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.174717 May 03 09:12:58.558291 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 743/1308] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:12:58 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:12:58.786079 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6de73e52-7cc5-4573-a984-76668e581a38 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:58.787106 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6de73e52-7cc5-4573-a984-76668e581a38 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:58.794687 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6de73e52-7cc5-4573-a984-76668e581a38 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:58.795184 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6de73e52-7cc5-4573-a984-76668e581a38 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:58.796111 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6de73e52-7cc5-4573-a984-76668e581a38 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:58.796597 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6de73e52-7cc5-4573-a984-76668e581a38 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:58.830910 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6de73e52-7cc5-4573-a984-76668e581a38 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049344 May 03 09:12:58.831689 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 566/1309] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:58 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:12:59.580788 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-8e3f3ae4-0daf-480e-9d56-336d68202f2a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:59.581778 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-8e3f3ae4-0daf-480e-9d56-336d68202f2a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:59.592558 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8e3f3ae4-0daf-480e-9d56-336d68202f2a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:59.593296 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8e3f3ae4-0daf-480e-9d56-336d68202f2a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:59.594547 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8e3f3ae4-0daf-480e-9d56-336d68202f2a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:59.595650 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8e3f3ae4-0daf-480e-9d56-336d68202f2a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:59.739014 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-8e3f3ae4-0daf-480e-9d56-336d68202f2a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:59.748007 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-8e3f3ae4-0daf-480e-9d56-336d68202f2a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:59.749584 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-8e3f3ae4-0daf-480e-9d56-336d68202f2a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:12:59.750831 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-8e3f3ae4-0daf-480e-9d56-336d68202f2a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.176680 May 03 09:12:59.751471 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 744/1310] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:12:59 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:12:59.848550 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-16d02722-1f49-4075-8bd2-55a23e2faa14 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:12:59.849592 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-16d02722-1f49-4075-8bd2-55a23e2faa14 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:12:59.857704 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-16d02722-1f49-4075-8bd2-55a23e2faa14 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:59.858252 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-16d02722-1f49-4075-8bd2-55a23e2faa14 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:59.859203 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-16d02722-1f49-4075-8bd2-55a23e2faa14 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:12:59.859732 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-16d02722-1f49-4075-8bd2-55a23e2faa14 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:12:59.891368 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-16d02722-1f49-4075-8bd2-55a23e2faa14 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049554 May 03 09:12:59.892276 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 567/1311] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:12:59 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:00.771885 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-32a7ec5a-12dd-40a9-92e7-26538a97f670 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:00.772582 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-32a7ec5a-12dd-40a9-92e7-26538a97f670 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:00.779979 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-32a7ec5a-12dd-40a9-92e7-26538a97f670 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:00.780474 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-32a7ec5a-12dd-40a9-92e7-26538a97f670 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:00.781330 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-32a7ec5a-12dd-40a9-92e7-26538a97f670 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:00.781804 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-32a7ec5a-12dd-40a9-92e7-26538a97f670 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:00.902927 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-975762cb-3678-4a7f-ae3f-5d2a3fc76224 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:00.903914 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-975762cb-3678-4a7f-ae3f-5d2a3fc76224 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:00.910521 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-975762cb-3678-4a7f-ae3f-5d2a3fc76224 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:00.910971 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-975762cb-3678-4a7f-ae3f-5d2a3fc76224 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:00.911735 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-975762cb-3678-4a7f-ae3f-5d2a3fc76224 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:00.912214 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-975762cb-3678-4a7f-ae3f-5d2a3fc76224 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:00.912329 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-32a7ec5a-12dd-40a9-92e7-26538a97f670 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:00.920620 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-32a7ec5a-12dd-40a9-92e7-26538a97f670 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:00.922094 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-32a7ec5a-12dd-40a9-92e7-26538a97f670 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:00.923260 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-32a7ec5a-12dd-40a9-92e7-26538a97f670 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.156682 May 03 09:13:00.923832 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 745/1312] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:00 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:13:00.941631 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-975762cb-3678-4a7f-ae3f-5d2a3fc76224 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042757 May 03 09:13:00.942156 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 568/1313] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:00 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:01.944240 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-8524ea89-e110-440a-96dc-e1677ab2e2d6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:01.944884 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-8524ea89-e110-440a-96dc-e1677ab2e2d6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:01.952640 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8524ea89-e110-440a-96dc-e1677ab2e2d6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:01.953158 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8524ea89-e110-440a-96dc-e1677ab2e2d6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:01.953977 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8524ea89-e110-440a-96dc-e1677ab2e2d6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:01.954137 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-126a2855-841c-4833-a859-5191a32bc51f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:01.954605 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8524ea89-e110-440a-96dc-e1677ab2e2d6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:01.955005 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-126a2855-841c-4833-a859-5191a32bc51f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:01.962478 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-126a2855-841c-4833-a859-5191a32bc51f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:01.962971 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-126a2855-841c-4833-a859-5191a32bc51f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:01.963826 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-126a2855-841c-4833-a859-5191a32bc51f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:01.964321 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-126a2855-841c-4833-a859-5191a32bc51f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:01.996157 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-126a2855-841c-4833-a859-5191a32bc51f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046443 May 03 09:13:01.997099 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 569/1314] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:01 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:02.086094 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-8524ea89-e110-440a-96dc-e1677ab2e2d6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:02.094878 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-8524ea89-e110-440a-96dc-e1677ab2e2d6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:02.096913 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-8524ea89-e110-440a-96dc-e1677ab2e2d6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:02.098071 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-8524ea89-e110-440a-96dc-e1677ab2e2d6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.159091 May 03 09:13:02.098607 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 746/1315] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:01 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:13:03.012324 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-50cc4828-ca89-4052-b76c-86a603ffa331 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:03.013866 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-50cc4828-ca89-4052-b76c-86a603ffa331 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:03.022376 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-50cc4828-ca89-4052-b76c-86a603ffa331 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:03.022829 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-50cc4828-ca89-4052-b76c-86a603ffa331 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:03.023598 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-50cc4828-ca89-4052-b76c-86a603ffa331 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:03.024069 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-50cc4828-ca89-4052-b76c-86a603ffa331 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:03.052867 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-50cc4828-ca89-4052-b76c-86a603ffa331 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047323 May 03 09:13:03.053407 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 570/1316] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:03 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:03.118104 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-6f6fdf21-ea3a-4a8f-b120-091912e605d1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:03.119061 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-6f6fdf21-ea3a-4a8f-b120-091912e605d1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:03.129703 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6f6fdf21-ea3a-4a8f-b120-091912e605d1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:03.130452 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6f6fdf21-ea3a-4a8f-b120-091912e605d1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:03.131696 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6f6fdf21-ea3a-4a8f-b120-091912e605d1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:03.132575 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6f6fdf21-ea3a-4a8f-b120-091912e605d1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:03.278611 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-6f6fdf21-ea3a-4a8f-b120-091912e605d1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:03.287551 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-6f6fdf21-ea3a-4a8f-b120-091912e605d1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:03.289075 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-6f6fdf21-ea3a-4a8f-b120-091912e605d1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:03.290266 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-6f6fdf21-ea3a-4a8f-b120-091912e605d1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.178321 May 03 09:13:03.291074 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 747/1317] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:03 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:13:04.070404 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7c08cf82-870d-4a5b-abba-a3efdb5996a2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:04.071810 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7c08cf82-870d-4a5b-abba-a3efdb5996a2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:04.082508 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7c08cf82-870d-4a5b-abba-a3efdb5996a2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:04.083258 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7c08cf82-870d-4a5b-abba-a3efdb5996a2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:04.084581 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7c08cf82-870d-4a5b-abba-a3efdb5996a2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:04.085310 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7c08cf82-870d-4a5b-abba-a3efdb5996a2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:04.119015 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7c08cf82-870d-4a5b-abba-a3efdb5996a2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055733 May 03 09:13:04.119555 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 571/1318] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:04 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:04.312345 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-041a993f-0326-4f01-9ac2-fc43be4ba406 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:04.313340 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-041a993f-0326-4f01-9ac2-fc43be4ba406 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:04.321316 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-041a993f-0326-4f01-9ac2-fc43be4ba406 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:04.321696 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-041a993f-0326-4f01-9ac2-fc43be4ba406 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:04.322465 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-041a993f-0326-4f01-9ac2-fc43be4ba406 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:04.324183 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-041a993f-0326-4f01-9ac2-fc43be4ba406 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:04.449578 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-041a993f-0326-4f01-9ac2-fc43be4ba406 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:04.458524 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-041a993f-0326-4f01-9ac2-fc43be4ba406 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:04.460043 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-041a993f-0326-4f01-9ac2-fc43be4ba406 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:04.461199 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-041a993f-0326-4f01-9ac2-fc43be4ba406 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.155521 May 03 09:13:04.461752 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 748/1319] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:04 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:13:05.134791 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e2873988-5bac-4a00-841f-d8b6ef322a55 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:05.136324 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e2873988-5bac-4a00-841f-d8b6ef322a55 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:05.145883 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e2873988-5bac-4a00-841f-d8b6ef322a55 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:05.146335 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e2873988-5bac-4a00-841f-d8b6ef322a55 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:05.147099 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e2873988-5bac-4a00-841f-d8b6ef322a55 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:05.147531 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e2873988-5bac-4a00-841f-d8b6ef322a55 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:05.176533 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e2873988-5bac-4a00-841f-d8b6ef322a55 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048473 May 03 09:13:05.177085 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 572/1320] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:05 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:05.481272 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-7e871632-6882-483f-a0ce-35d7da32a93e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:05.481936 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-7e871632-6882-483f-a0ce-35d7da32a93e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:05.489726 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7e871632-6882-483f-a0ce-35d7da32a93e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:05.490171 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7e871632-6882-483f-a0ce-35d7da32a93e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:05.490944 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7e871632-6882-483f-a0ce-35d7da32a93e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:05.491364 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7e871632-6882-483f-a0ce-35d7da32a93e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:05.626480 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7e871632-6882-483f-a0ce-35d7da32a93e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:05.634779 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7e871632-6882-483f-a0ce-35d7da32a93e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:05.636301 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7e871632-6882-483f-a0ce-35d7da32a93e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:05.637458 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-7e871632-6882-483f-a0ce-35d7da32a93e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.161298 May 03 09:13:05.638007 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 749/1321] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:05 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:13:06.192265 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-132ca44b-b312-426d-b20c-f27933e6f667 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:06.193753 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-132ca44b-b312-426d-b20c-f27933e6f667 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:06.204463 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-132ca44b-b312-426d-b20c-f27933e6f667 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:06.205202 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-132ca44b-b312-426d-b20c-f27933e6f667 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:06.206435 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-132ca44b-b312-426d-b20c-f27933e6f667 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:06.206870 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-132ca44b-b312-426d-b20c-f27933e6f667 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:06.236930 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-132ca44b-b312-426d-b20c-f27933e6f667 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051272 May 03 09:13:06.237552 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 573/1322] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:06 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:06.655697 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a75cdd0c-4f59-4f59-966c-2042c83b7806 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:06.656364 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a75cdd0c-4f59-4f59-966c-2042c83b7806 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:06.665653 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a75cdd0c-4f59-4f59-966c-2042c83b7806 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:06.666247 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a75cdd0c-4f59-4f59-966c-2042c83b7806 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:06.667264 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a75cdd0c-4f59-4f59-966c-2042c83b7806 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:06.667875 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a75cdd0c-4f59-4f59-966c-2042c83b7806 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:06.808900 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a75cdd0c-4f59-4f59-966c-2042c83b7806 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:06.821739 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a75cdd0c-4f59-4f59-966c-2042c83b7806 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:06.823999 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a75cdd0c-4f59-4f59-966c-2042c83b7806 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:06.825783 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a75cdd0c-4f59-4f59-966c-2042c83b7806 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.174263 May 03 09:13:06.826540 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 750/1323] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:06 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:13:07.252229 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d5639042-35e5-4390-ab42-c5d00ce0e3a2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:07.253664 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d5639042-35e5-4390-ab42-c5d00ce0e3a2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:07.260482 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d5639042-35e5-4390-ab42-c5d00ce0e3a2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:07.260959 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d5639042-35e5-4390-ab42-c5d00ce0e3a2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:07.261735 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d5639042-35e5-4390-ab42-c5d00ce0e3a2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:07.262174 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d5639042-35e5-4390-ab42-c5d00ce0e3a2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:07.291673 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d5639042-35e5-4390-ab42-c5d00ce0e3a2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045320 May 03 09:13:07.292278 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 574/1324] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:07 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:07.849411 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a5096805-8f83-421b-80f2-aaa0b25cb268 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:07.849996 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a5096805-8f83-421b-80f2-aaa0b25cb268 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:07.857494 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a5096805-8f83-421b-80f2-aaa0b25cb268 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:07.857988 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a5096805-8f83-421b-80f2-aaa0b25cb268 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:07.858827 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a5096805-8f83-421b-80f2-aaa0b25cb268 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:07.859300 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a5096805-8f83-421b-80f2-aaa0b25cb268 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:07.995491 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a5096805-8f83-421b-80f2-aaa0b25cb268 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:08.003826 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a5096805-8f83-421b-80f2-aaa0b25cb268 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:08.005464 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a5096805-8f83-421b-80f2-aaa0b25cb268 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:08.006612 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a5096805-8f83-421b-80f2-aaa0b25cb268 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.164508 May 03 09:13:08.007168 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 751/1325] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:07 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:13:08.302861 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d55ca4e9-33c8-47d2-92e4-4c94d6ae7201 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:08.303863 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d55ca4e9-33c8-47d2-92e4-4c94d6ae7201 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:08.310902 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d55ca4e9-33c8-47d2-92e4-4c94d6ae7201 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:08.311349 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d55ca4e9-33c8-47d2-92e4-4c94d6ae7201 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:08.312165 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d55ca4e9-33c8-47d2-92e4-4c94d6ae7201 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:08.312622 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d55ca4e9-33c8-47d2-92e4-4c94d6ae7201 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:08.342933 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d55ca4e9-33c8-47d2-92e4-4c94d6ae7201 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044138 May 03 09:13:08.343468 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 575/1326] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:08 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:09.026579 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-519e0a39-87ed-4ead-8069-dcfe98d1c26a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:09.027206 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-519e0a39-87ed-4ead-8069-dcfe98d1c26a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:09.034933 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-519e0a39-87ed-4ead-8069-dcfe98d1c26a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:09.035471 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-519e0a39-87ed-4ead-8069-dcfe98d1c26a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:09.036392 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-519e0a39-87ed-4ead-8069-dcfe98d1c26a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:09.036878 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-519e0a39-87ed-4ead-8069-dcfe98d1c26a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:09.172637 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-519e0a39-87ed-4ead-8069-dcfe98d1c26a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:09.183149 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-519e0a39-87ed-4ead-8069-dcfe98d1c26a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:09.184682 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-519e0a39-87ed-4ead-8069-dcfe98d1c26a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:09.185818 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-519e0a39-87ed-4ead-8069-dcfe98d1c26a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.164144 May 03 09:13:09.186373 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 752/1327] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:09 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:13:09.357870 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0e6015f7-627e-4c19-b684-d74ae4bac3d1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:09.359342 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0e6015f7-627e-4c19-b684-d74ae4bac3d1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:09.369862 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0e6015f7-627e-4c19-b684-d74ae4bac3d1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:09.370592 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0e6015f7-627e-4c19-b684-d74ae4bac3d1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:09.371862 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0e6015f7-627e-4c19-b684-d74ae4bac3d1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:09.372635 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0e6015f7-627e-4c19-b684-d74ae4bac3d1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:09.405555 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0e6015f7-627e-4c19-b684-d74ae4bac3d1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054372 May 03 09:13:09.406093 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 576/1328] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:09 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:10.209202 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-0c736078-6b70-4773-98e4-5b5fb8b59ca9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:10.210164 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-0c736078-6b70-4773-98e4-5b5fb8b59ca9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:10.221449 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0c736078-6b70-4773-98e4-5b5fb8b59ca9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:10.222187 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0c736078-6b70-4773-98e4-5b5fb8b59ca9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:10.223445 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0c736078-6b70-4773-98e4-5b5fb8b59ca9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:10.224206 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0c736078-6b70-4773-98e4-5b5fb8b59ca9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:10.352060 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-0c736078-6b70-4773-98e4-5b5fb8b59ca9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:10.360599 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-0c736078-6b70-4773-98e4-5b5fb8b59ca9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:10.362153 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-0c736078-6b70-4773-98e4-5b5fb8b59ca9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:10.363323 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-0c736078-6b70-4773-98e4-5b5fb8b59ca9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.161571 May 03 09:13:10.363903 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 753/1329] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:10 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:13:10.417339 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-385a0345-d2cc-4454-b331-2a94fb2f4c9c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:10.418271 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-385a0345-d2cc-4454-b331-2a94fb2f4c9c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:10.424596 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-385a0345-d2cc-4454-b331-2a94fb2f4c9c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:10.425009 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-385a0345-d2cc-4454-b331-2a94fb2f4c9c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:10.425820 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-385a0345-d2cc-4454-b331-2a94fb2f4c9c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:10.426265 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-385a0345-d2cc-4454-b331-2a94fb2f4c9c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:10.457345 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-385a0345-d2cc-4454-b331-2a94fb2f4c9c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043970 May 03 09:13:10.457893 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 577/1330] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:10 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:11.386185 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5f16266a-6979-4638-b9b7-1227a6a88a86 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:11.387216 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5f16266a-6979-4638-b9b7-1227a6a88a86 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:11.397815 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5f16266a-6979-4638-b9b7-1227a6a88a86 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:11.398293 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5f16266a-6979-4638-b9b7-1227a6a88a86 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:11.399041 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5f16266a-6979-4638-b9b7-1227a6a88a86 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:11.399507 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5f16266a-6979-4638-b9b7-1227a6a88a86 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:11.468571 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2f4844f3-871d-4f9f-b077-8f0d5438abfc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:11.469411 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-2f4844f3-871d-4f9f-b077-8f0d5438abfc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:11.476189 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2f4844f3-871d-4f9f-b077-8f0d5438abfc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:11.476642 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2f4844f3-871d-4f9f-b077-8f0d5438abfc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:11.477413 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2f4844f3-871d-4f9f-b077-8f0d5438abfc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:11.477851 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2f4844f3-871d-4f9f-b077-8f0d5438abfc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:11.506274 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-2f4844f3-871d-4f9f-b077-8f0d5438abfc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041725 May 03 09:13:11.507069 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 578/1331] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:11 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 09:13:11.530620 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5f16266a-6979-4638-b9b7-1227a6a88a86 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:11.539151 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5f16266a-6979-4638-b9b7-1227a6a88a86 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:11.540693 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5f16266a-6979-4638-b9b7-1227a6a88a86 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:11.541824 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5f16266a-6979-4638-b9b7-1227a6a88a86 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.162293 May 03 09:13:11.542415 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 754/1332] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:11 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:13:12.517937 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-af763548-f957-4505-8e8a-5f4836752748 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:12.518874 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-af763548-f957-4505-8e8a-5f4836752748 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:12.525698 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-af763548-f957-4505-8e8a-5f4836752748 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:12.526151 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-af763548-f957-4505-8e8a-5f4836752748 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:12.526918 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-af763548-f957-4505-8e8a-5f4836752748 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:12.527348 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-af763548-f957-4505-8e8a-5f4836752748 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:12.556621 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-af763548-f957-4505-8e8a-5f4836752748 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042647 May 03 09:13:12.557173 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 579/1333] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:12 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:12.560295 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b0239900-d213-48e0-94b3-ea529e1dfcc4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:12.560944 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b0239900-d213-48e0-94b3-ea529e1dfcc4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:12.570175 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b0239900-d213-48e0-94b3-ea529e1dfcc4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:12.570780 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b0239900-d213-48e0-94b3-ea529e1dfcc4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:12.571976 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b0239900-d213-48e0-94b3-ea529e1dfcc4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:12.572594 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b0239900-d213-48e0-94b3-ea529e1dfcc4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:12.708481 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b0239900-d213-48e0-94b3-ea529e1dfcc4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:12.717008 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b0239900-d213-48e0-94b3-ea529e1dfcc4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:12.718423 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b0239900-d213-48e0-94b3-ea529e1dfcc4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:12.719583 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b0239900-d213-48e0-94b3-ea529e1dfcc4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.163279 May 03 09:13:12.720502 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 755/1334] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:12 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:13:13.572027 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-cb3dcafc-14c4-41b9-80dd-5877894f0d58 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:13.573235 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-cb3dcafc-14c4-41b9-80dd-5877894f0d58 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:13.582878 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cb3dcafc-14c4-41b9-80dd-5877894f0d58 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:13.583466 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cb3dcafc-14c4-41b9-80dd-5877894f0d58 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:13.584683 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cb3dcafc-14c4-41b9-80dd-5877894f0d58 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:13.585419 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cb3dcafc-14c4-41b9-80dd-5877894f0d58 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:13.613873 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-cb3dcafc-14c4-41b9-80dd-5877894f0d58 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048374 May 03 09:13:13.614416 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 580/1335] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:13 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:13.742864 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-82c80e77-a085-4c03-bc7c-444a9fa4a68e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:13.743869 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-82c80e77-a085-4c03-bc7c-444a9fa4a68e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:13.754546 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-82c80e77-a085-4c03-bc7c-444a9fa4a68e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:13.755213 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-82c80e77-a085-4c03-bc7c-444a9fa4a68e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:13.756529 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-82c80e77-a085-4c03-bc7c-444a9fa4a68e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:13.757369 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-82c80e77-a085-4c03-bc7c-444a9fa4a68e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:13.893282 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-82c80e77-a085-4c03-bc7c-444a9fa4a68e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:13.902219 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-82c80e77-a085-4c03-bc7c-444a9fa4a68e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:13.903751 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-82c80e77-a085-4c03-bc7c-444a9fa4a68e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:13.904981 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-82c80e77-a085-4c03-bc7c-444a9fa4a68e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.168603 May 03 09:13:13.905552 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 756/1336] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:13 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:13:14.625762 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-1fd039bb-d316-4427-b97d-83f26e7fde6a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:14.626686 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-1fd039bb-d316-4427-b97d-83f26e7fde6a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:14.633450 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1fd039bb-d316-4427-b97d-83f26e7fde6a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:14.633895 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1fd039bb-d316-4427-b97d-83f26e7fde6a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:14.634667 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1fd039bb-d316-4427-b97d-83f26e7fde6a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:14.635101 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1fd039bb-d316-4427-b97d-83f26e7fde6a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:14.664416 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-1fd039bb-d316-4427-b97d-83f26e7fde6a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042628 May 03 09:13:14.664998 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 581/1337] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:14 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:14.926353 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-eae79578-79c3-4e32-bd74-5772766d82e3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:14.927359 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-eae79578-79c3-4e32-bd74-5772766d82e3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:14.934798 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-eae79578-79c3-4e32-bd74-5772766d82e3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:14.935258 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-eae79578-79c3-4e32-bd74-5772766d82e3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:14.936138 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-eae79578-79c3-4e32-bd74-5772766d82e3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:14.936570 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-eae79578-79c3-4e32-bd74-5772766d82e3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:15.065651 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-eae79578-79c3-4e32-bd74-5772766d82e3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:15.078335 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-eae79578-79c3-4e32-bd74-5772766d82e3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:15.079831 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-eae79578-79c3-4e32-bd74-5772766d82e3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:15.081035 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-eae79578-79c3-4e32-bd74-5772766d82e3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.161191 May 03 09:13:15.081586 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 757/1338] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:14 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:13:15.676337 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-bb06cc78-7c59-4b14-8610-f69ff17d87d0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:15.677358 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-bb06cc78-7c59-4b14-8610-f69ff17d87d0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:15.684419 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bb06cc78-7c59-4b14-8610-f69ff17d87d0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:15.684868 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bb06cc78-7c59-4b14-8610-f69ff17d87d0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:15.685629 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bb06cc78-7c59-4b14-8610-f69ff17d87d0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:15.686060 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bb06cc78-7c59-4b14-8610-f69ff17d87d0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:15.715282 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-bb06cc78-7c59-4b14-8610-f69ff17d87d0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042872 May 03 09:13:15.715823 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 582/1339] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:15 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:16.102825 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-28f19336-a352-4888-8299-a14302e4aae7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:16.103582 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-28f19336-a352-4888-8299-a14302e4aae7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:16.111807 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-28f19336-a352-4888-8299-a14302e4aae7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:16.112412 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-28f19336-a352-4888-8299-a14302e4aae7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:16.113368 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-28f19336-a352-4888-8299-a14302e4aae7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:16.113912 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-28f19336-a352-4888-8299-a14302e4aae7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:16.249787 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-28f19336-a352-4888-8299-a14302e4aae7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:16.258319 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-28f19336-a352-4888-8299-a14302e4aae7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:16.259898 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-28f19336-a352-4888-8299-a14302e4aae7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:16.261089 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-28f19336-a352-4888-8299-a14302e4aae7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.164806 May 03 09:13:16.261635 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 758/1340] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:16 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:13:16.727210 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e84deae4-fefa-4fb4-a84c-a4308380e2bc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:16.728162 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e84deae4-fefa-4fb4-a84c-a4308380e2bc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:16.734530 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e84deae4-fefa-4fb4-a84c-a4308380e2bc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:16.734954 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e84deae4-fefa-4fb4-a84c-a4308380e2bc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:16.735757 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e84deae4-fefa-4fb4-a84c-a4308380e2bc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:16.736227 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e84deae4-fefa-4fb4-a84c-a4308380e2bc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:16.767592 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e84deae4-fefa-4fb4-a84c-a4308380e2bc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044110 May 03 09:13:16.768416 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 583/1341] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:16 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:17.280102 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-7a6fc828-6037-472f-9f7a-55e12c15b6f8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:17.280755 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-7a6fc828-6037-472f-9f7a-55e12c15b6f8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:17.288274 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7a6fc828-6037-472f-9f7a-55e12c15b6f8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:17.288706 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7a6fc828-6037-472f-9f7a-55e12c15b6f8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:17.289566 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7a6fc828-6037-472f-9f7a-55e12c15b6f8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:17.290022 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7a6fc828-6037-472f-9f7a-55e12c15b6f8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:17.428402 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7a6fc828-6037-472f-9f7a-55e12c15b6f8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:17.441761 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7a6fc828-6037-472f-9f7a-55e12c15b6f8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:17.444214 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7a6fc828-6037-472f-9f7a-55e12c15b6f8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:17.446044 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-7a6fc828-6037-472f-9f7a-55e12c15b6f8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.170071 May 03 09:13:17.446601 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 759/1342] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:17 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:13:17.781224 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-1401ae5c-c139-4cc1-a988-3b419c8084d3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:17.782141 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-1401ae5c-c139-4cc1-a988-3b419c8084d3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:17.788520 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1401ae5c-c139-4cc1-a988-3b419c8084d3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:17.788965 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1401ae5c-c139-4cc1-a988-3b419c8084d3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:17.789779 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1401ae5c-c139-4cc1-a988-3b419c8084d3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:17.790209 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1401ae5c-c139-4cc1-a988-3b419c8084d3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:17.820617 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-1401ae5c-c139-4cc1-a988-3b419c8084d3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043329 May 03 09:13:17.821166 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 584/1343] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:17 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:18.468447 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-0db4848d-ba40-4742-baad-9412e20c11e8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:18.469453 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-0db4848d-ba40-4742-baad-9412e20c11e8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:18.479411 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0db4848d-ba40-4742-baad-9412e20c11e8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:18.479924 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0db4848d-ba40-4742-baad-9412e20c11e8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:18.480696 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0db4848d-ba40-4742-baad-9412e20c11e8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:18.481136 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0db4848d-ba40-4742-baad-9412e20c11e8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:18.634054 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-0db4848d-ba40-4742-baad-9412e20c11e8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:18.646923 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-0db4848d-ba40-4742-baad-9412e20c11e8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:18.649235 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-0db4848d-ba40-4742-baad-9412e20c11e8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:18.650408 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-0db4848d-ba40-4742-baad-9412e20c11e8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.188532 May 03 09:13:18.650938 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 760/1344] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:18 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:13:18.832504 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-74ea3559-d377-46f4-90e4-8ecaa129306e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:18.833450 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-74ea3559-d377-46f4-90e4-8ecaa129306e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:18.840329 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-74ea3559-d377-46f4-90e4-8ecaa129306e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:18.840777 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-74ea3559-d377-46f4-90e4-8ecaa129306e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:18.841530 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-74ea3559-d377-46f4-90e4-8ecaa129306e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:18.841965 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-74ea3559-d377-46f4-90e4-8ecaa129306e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:18.871557 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-74ea3559-d377-46f4-90e4-8ecaa129306e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042957 May 03 09:13:18.872145 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 585/1345] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:18 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:19.672238 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a38a9152-cd90-4b9c-86a5-d8f54c850d6d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:19.673246 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a38a9152-cd90-4b9c-86a5-d8f54c850d6d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:19.683852 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a38a9152-cd90-4b9c-86a5-d8f54c850d6d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:19.684601 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a38a9152-cd90-4b9c-86a5-d8f54c850d6d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:19.685852 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a38a9152-cd90-4b9c-86a5-d8f54c850d6d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:19.686564 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a38a9152-cd90-4b9c-86a5-d8f54c850d6d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:19.824313 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a38a9152-cd90-4b9c-86a5-d8f54c850d6d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:19.832604 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a38a9152-cd90-4b9c-86a5-d8f54c850d6d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:19.834092 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a38a9152-cd90-4b9c-86a5-d8f54c850d6d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:19.835249 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a38a9152-cd90-4b9c-86a5-d8f54c850d6d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.169585 May 03 09:13:19.835815 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 761/1346] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:19 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:13:19.883305 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-1cd32ab6-a96c-464a-9024-8875c334be4b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:19.884305 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-1cd32ab6-a96c-464a-9024-8875c334be4b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:19.890875 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1cd32ab6-a96c-464a-9024-8875c334be4b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:19.891345 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1cd32ab6-a96c-464a-9024-8875c334be4b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:19.892200 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1cd32ab6-a96c-464a-9024-8875c334be4b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:19.892582 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1cd32ab6-a96c-464a-9024-8875c334be4b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:19.922343 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-1cd32ab6-a96c-464a-9024-8875c334be4b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042975 May 03 09:13:19.922826 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 586/1347] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:19 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:20.861656 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-6ebc6b5f-dcac-4dc0-a1e8-94aa907e01a0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:20.862417 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-6ebc6b5f-dcac-4dc0-a1e8-94aa907e01a0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:20.870185 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6ebc6b5f-dcac-4dc0-a1e8-94aa907e01a0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:20.870637 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6ebc6b5f-dcac-4dc0-a1e8-94aa907e01a0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:20.871406 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6ebc6b5f-dcac-4dc0-a1e8-94aa907e01a0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:20.871864 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6ebc6b5f-dcac-4dc0-a1e8-94aa907e01a0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:20.934185 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-89a71879-8440-45ef-bd2f-307ad3736e63 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:20.935139 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-89a71879-8440-45ef-bd2f-307ad3736e63 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:20.941725 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-89a71879-8440-45ef-bd2f-307ad3736e63 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:20.942170 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-89a71879-8440-45ef-bd2f-307ad3736e63 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:20.942953 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-89a71879-8440-45ef-bd2f-307ad3736e63 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:20.943355 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-89a71879-8440-45ef-bd2f-307ad3736e63 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:20.987493 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-89a71879-8440-45ef-bd2f-307ad3736e63 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057238 May 03 09:13:20.991365 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 587/1348] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:20 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:21.007628 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-6ebc6b5f-dcac-4dc0-a1e8-94aa907e01a0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:21.018151 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-6ebc6b5f-dcac-4dc0-a1e8-94aa907e01a0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:21.020495 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-6ebc6b5f-dcac-4dc0-a1e8-94aa907e01a0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:21.022267 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-6ebc6b5f-dcac-4dc0-a1e8-94aa907e01a0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.165300 May 03 09:13:21.022835 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 762/1349] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:20 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:13:21.999068 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d279ce7e-50c9-41f9-9732-ecd014066eb2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:22.000069 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d279ce7e-50c9-41f9-9732-ecd014066eb2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:22.006808 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d279ce7e-50c9-41f9-9732-ecd014066eb2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:22.007268 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d279ce7e-50c9-41f9-9732-ecd014066eb2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:22.008244 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d279ce7e-50c9-41f9-9732-ecd014066eb2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:22.008678 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d279ce7e-50c9-41f9-9732-ecd014066eb2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:22.037998 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d279ce7e-50c9-41f9-9732-ecd014066eb2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042972 May 03 09:13:22.038549 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 588/1350] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:21 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:22.040882 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-7ea967d9-1a7d-4462-b578-9490b5a41f92 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:22.041500 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-7ea967d9-1a7d-4462-b578-9490b5a41f92 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:22.048266 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7ea967d9-1a7d-4462-b578-9490b5a41f92 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:22.048713 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7ea967d9-1a7d-4462-b578-9490b5a41f92 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:22.049497 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7ea967d9-1a7d-4462-b578-9490b5a41f92 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:22.049958 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7ea967d9-1a7d-4462-b578-9490b5a41f92 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:22.190838 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7ea967d9-1a7d-4462-b578-9490b5a41f92 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:22.199353 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7ea967d9-1a7d-4462-b578-9490b5a41f92 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:22.200934 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7ea967d9-1a7d-4462-b578-9490b5a41f92 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:22.202119 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-7ea967d9-1a7d-4462-b578-9490b5a41f92 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.165259 May 03 09:13:22.202655 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 763/1351] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:22 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:13:23.053798 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5a7f2e68-6d67-4070-abdb-ae5a11d09afa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:23.055296 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5a7f2e68-6d67-4070-abdb-ae5a11d09afa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:23.062217 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5a7f2e68-6d67-4070-abdb-ae5a11d09afa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:23.062547 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5a7f2e68-6d67-4070-abdb-ae5a11d09afa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:23.063308 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5a7f2e68-6d67-4070-abdb-ae5a11d09afa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:23.063749 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5a7f2e68-6d67-4070-abdb-ae5a11d09afa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:23.093498 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5a7f2e68-6d67-4070-abdb-ae5a11d09afa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046372 May 03 09:13:23.094119 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 589/1352] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:23 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:23.222628 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-297eeb43-d429-4927-864b-b5be6700cbbd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:23.223236 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-297eeb43-d429-4927-864b-b5be6700cbbd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:23.230014 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-297eeb43-d429-4927-864b-b5be6700cbbd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:23.230461 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-297eeb43-d429-4927-864b-b5be6700cbbd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:23.231220 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-297eeb43-d429-4927-864b-b5be6700cbbd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:23.231646 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-297eeb43-d429-4927-864b-b5be6700cbbd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:23.366414 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-297eeb43-d429-4927-864b-b5be6700cbbd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:23.374887 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-297eeb43-d429-4927-864b-b5be6700cbbd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:23.376433 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-297eeb43-d429-4927-864b-b5be6700cbbd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:23.377607 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-297eeb43-d429-4927-864b-b5be6700cbbd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.159340 May 03 09:13:23.378172 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 764/1353] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:23 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:13:24.107389 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e76ec37d-8781-431f-986b-f9b4e5c00720 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:24.108364 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e76ec37d-8781-431f-986b-f9b4e5c00720 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:24.114637 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e76ec37d-8781-431f-986b-f9b4e5c00720 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:24.115078 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e76ec37d-8781-431f-986b-f9b4e5c00720 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:24.115866 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e76ec37d-8781-431f-986b-f9b4e5c00720 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:24.116298 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e76ec37d-8781-431f-986b-f9b4e5c00720 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:24.145637 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e76ec37d-8781-431f-986b-f9b4e5c00720 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042975 May 03 09:13:24.146270 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 590/1354] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:24 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:24.400574 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-7509ab30-f03d-4a31-8113-020759b86e13 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:24.401638 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-7509ab30-f03d-4a31-8113-020759b86e13 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:24.412791 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7509ab30-f03d-4a31-8113-020759b86e13 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:24.413541 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7509ab30-f03d-4a31-8113-020759b86e13 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:24.414836 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7509ab30-f03d-4a31-8113-020759b86e13 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:24.415565 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7509ab30-f03d-4a31-8113-020759b86e13 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:24.554086 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7509ab30-f03d-4a31-8113-020759b86e13 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:24.562695 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7509ab30-f03d-4a31-8113-020759b86e13 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:24.564240 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7509ab30-f03d-4a31-8113-020759b86e13 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:24.565406 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-7509ab30-f03d-4a31-8113-020759b86e13 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.171591 May 03 09:13:24.565969 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 765/1355] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:24 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:13:25.161527 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4445a56f-9d4d-445e-adb4-08a599626fb8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:25.163090 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4445a56f-9d4d-445e-adb4-08a599626fb8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:25.171492 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4445a56f-9d4d-445e-adb4-08a599626fb8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:25.171971 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4445a56f-9d4d-445e-adb4-08a599626fb8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:25.172747 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4445a56f-9d4d-445e-adb4-08a599626fb8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:25.173173 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4445a56f-9d4d-445e-adb4-08a599626fb8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:25.206347 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-4445a56f-9d4d-445e-adb4-08a599626fb8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051464 May 03 09:13:25.206914 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 591/1356] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:25 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:25.586602 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9e909cfa-d507-4634-aaf3-d5333034985c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:25.587196 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9e909cfa-d507-4634-aaf3-d5333034985c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:25.595596 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9e909cfa-d507-4634-aaf3-d5333034985c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:25.596080 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9e909cfa-d507-4634-aaf3-d5333034985c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:25.596846 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9e909cfa-d507-4634-aaf3-d5333034985c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:25.597285 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9e909cfa-d507-4634-aaf3-d5333034985c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:25.727302 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9e909cfa-d507-4634-aaf3-d5333034985c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:25.735928 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9e909cfa-d507-4634-aaf3-d5333034985c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:25.737424 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9e909cfa-d507-4634-aaf3-d5333034985c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:25.738588 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9e909cfa-d507-4634-aaf3-d5333034985c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.158287 May 03 09:13:25.739129 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 766/1357] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:25 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:13:26.218883 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5b8160b0-7a1f-4acc-90fd-00e07e433643 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:26.219824 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5b8160b0-7a1f-4acc-90fd-00e07e433643 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:26.229944 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5b8160b0-7a1f-4acc-90fd-00e07e433643 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:26.230394 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5b8160b0-7a1f-4acc-90fd-00e07e433643 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:26.231272 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5b8160b0-7a1f-4acc-90fd-00e07e433643 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:26.231785 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5b8160b0-7a1f-4acc-90fd-00e07e433643 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:26.261592 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5b8160b0-7a1f-4acc-90fd-00e07e433643 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046686 May 03 09:13:26.262138 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 592/1358] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:26 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:26.757002 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-05341afc-2a63-4798-b5f2-eba9bc9452df tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:26.757615 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-05341afc-2a63-4798-b5f2-eba9bc9452df tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:26.764302 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-05341afc-2a63-4798-b5f2-eba9bc9452df tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:26.764754 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-05341afc-2a63-4798-b5f2-eba9bc9452df tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:26.765511 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-05341afc-2a63-4798-b5f2-eba9bc9452df tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:26.765948 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-05341afc-2a63-4798-b5f2-eba9bc9452df tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:26.905308 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-05341afc-2a63-4798-b5f2-eba9bc9452df tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:26.918746 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-05341afc-2a63-4798-b5f2-eba9bc9452df tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:26.921292 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-05341afc-2a63-4798-b5f2-eba9bc9452df tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:26.923276 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-05341afc-2a63-4798-b5f2-eba9bc9452df tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.170018 May 03 09:13:26.924203 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 767/1359] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:26 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:13:27.276893 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6cea5df1-720a-487c-aa72-1b0caca0747b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:27.278370 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6cea5df1-720a-487c-aa72-1b0caca0747b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:27.289281 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6cea5df1-720a-487c-aa72-1b0caca0747b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:27.290019 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6cea5df1-720a-487c-aa72-1b0caca0747b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:27.291272 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6cea5df1-720a-487c-aa72-1b0caca0747b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:27.292455 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6cea5df1-720a-487c-aa72-1b0caca0747b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:27.325915 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6cea5df1-720a-487c-aa72-1b0caca0747b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055755 May 03 09:13:27.326477 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 593/1360] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:27 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:27.949370 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-23cc2f1d-73a0-4b91-b1b2-a1f607905bfa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:27.950017 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-23cc2f1d-73a0-4b91-b1b2-a1f607905bfa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:27.956854 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-23cc2f1d-73a0-4b91-b1b2-a1f607905bfa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:27.957306 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-23cc2f1d-73a0-4b91-b1b2-a1f607905bfa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:27.958084 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-23cc2f1d-73a0-4b91-b1b2-a1f607905bfa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:27.958497 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-23cc2f1d-73a0-4b91-b1b2-a1f607905bfa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:28.093297 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-23cc2f1d-73a0-4b91-b1b2-a1f607905bfa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:28.102341 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-23cc2f1d-73a0-4b91-b1b2-a1f607905bfa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:28.103886 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-23cc2f1d-73a0-4b91-b1b2-a1f607905bfa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:28.105181 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-23cc2f1d-73a0-4b91-b1b2-a1f607905bfa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.162202 May 03 09:13:28.105779 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 768/1361] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:27 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:13:28.340409 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d57b2e51-daab-44f0-9e24-9b17b86e1586 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:28.341347 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d57b2e51-daab-44f0-9e24-9b17b86e1586 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:28.348511 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d57b2e51-daab-44f0-9e24-9b17b86e1586 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:28.348976 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d57b2e51-daab-44f0-9e24-9b17b86e1586 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:28.349752 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d57b2e51-daab-44f0-9e24-9b17b86e1586 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:28.350191 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d57b2e51-daab-44f0-9e24-9b17b86e1586 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:28.380042 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d57b2e51-daab-44f0-9e24-9b17b86e1586 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045676 May 03 09:13:28.380635 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 594/1362] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:28 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:29.126017 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-7d4b09b4-0005-44b1-a739-57be33dae8fa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:29.126674 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-7d4b09b4-0005-44b1-a739-57be33dae8fa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:29.134317 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7d4b09b4-0005-44b1-a739-57be33dae8fa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:29.134836 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7d4b09b4-0005-44b1-a739-57be33dae8fa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:29.135748 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7d4b09b4-0005-44b1-a739-57be33dae8fa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:29.136283 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7d4b09b4-0005-44b1-a739-57be33dae8fa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:29.268984 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7d4b09b4-0005-44b1-a739-57be33dae8fa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:29.278347 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7d4b09b4-0005-44b1-a739-57be33dae8fa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:29.279861 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7d4b09b4-0005-44b1-a739-57be33dae8fa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:29.281047 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-7d4b09b4-0005-44b1-a739-57be33dae8fa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.159978 May 03 09:13:29.281601 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 769/1363] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:29 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:13:29.395708 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-58d0c9dc-64ba-494b-848f-9e455e7e6c6e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:29.396707 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-58d0c9dc-64ba-494b-848f-9e455e7e6c6e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:29.403545 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-58d0c9dc-64ba-494b-848f-9e455e7e6c6e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:29.404070 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-58d0c9dc-64ba-494b-848f-9e455e7e6c6e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:29.404899 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-58d0c9dc-64ba-494b-848f-9e455e7e6c6e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:29.405342 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-58d0c9dc-64ba-494b-848f-9e455e7e6c6e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:29.434569 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-58d0c9dc-64ba-494b-848f-9e455e7e6c6e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044662 May 03 09:13:29.435147 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 595/1364] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:29 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:30.303434 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-04a72d86-1bdd-4ede-a448-06d995a9face tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:30.304607 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-04a72d86-1bdd-4ede-a448-06d995a9face tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:30.315358 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-04a72d86-1bdd-4ede-a448-06d995a9face tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:30.316184 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-04a72d86-1bdd-4ede-a448-06d995a9face tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:30.317441 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-04a72d86-1bdd-4ede-a448-06d995a9face tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:30.318152 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-04a72d86-1bdd-4ede-a448-06d995a9face tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:30.446715 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f13a9d45-3aa1-4e05-9583-09101b4e2d82 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:30.447679 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f13a9d45-3aa1-4e05-9583-09101b4e2d82 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:30.453391 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-04a72d86-1bdd-4ede-a448-06d995a9face tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:30.454624 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f13a9d45-3aa1-4e05-9583-09101b4e2d82 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:30.455294 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f13a9d45-3aa1-4e05-9583-09101b4e2d82 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:30.456481 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f13a9d45-3aa1-4e05-9583-09101b4e2d82 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:30.457375 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f13a9d45-3aa1-4e05-9583-09101b4e2d82 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:30.462174 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-04a72d86-1bdd-4ede-a448-06d995a9face tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:30.463702 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-04a72d86-1bdd-4ede-a448-06d995a9face tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:30.465035 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-04a72d86-1bdd-4ede-a448-06d995a9face tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.168118 May 03 09:13:30.465900 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 770/1365] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:30 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:13:30.487922 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f13a9d45-3aa1-4e05-9583-09101b4e2d82 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045168 May 03 09:13:30.488490 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 596/1366] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:30 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:31.488961 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-64325663-2502-41b9-a964-d9f1d8936868 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:31.489947 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-64325663-2502-41b9-a964-d9f1d8936868 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:31.498895 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-64325663-2502-41b9-a964-d9f1d8936868 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:31.499350 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-64325663-2502-41b9-a964-d9f1d8936868 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:31.500014 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-3d098ab2-2a59-4362-a4a3-a9390afd997e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:31.500485 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-64325663-2502-41b9-a964-d9f1d8936868 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:31.500589 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-64325663-2502-41b9-a964-d9f1d8936868 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:31.500969 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-3d098ab2-2a59-4362-a4a3-a9390afd997e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:31.507560 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3d098ab2-2a59-4362-a4a3-a9390afd997e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:31.508047 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3d098ab2-2a59-4362-a4a3-a9390afd997e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:31.508818 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3d098ab2-2a59-4362-a4a3-a9390afd997e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:31.509256 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3d098ab2-2a59-4362-a4a3-a9390afd997e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:31.540080 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-3d098ab2-2a59-4362-a4a3-a9390afd997e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044011 May 03 09:13:31.540747 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 597/1367] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:31 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:31.651541 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-64325663-2502-41b9-a964-d9f1d8936868 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:31.659952 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-64325663-2502-41b9-a964-d9f1d8936868 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:31.661444 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-64325663-2502-41b9-a964-d9f1d8936868 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:31.662610 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-64325663-2502-41b9-a964-d9f1d8936868 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.180389 May 03 09:13:31.663136 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 771/1368] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:31 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:13:32.556355 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ed321a09-889d-4e2e-8652-03b03643a633 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:32.557728 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ed321a09-889d-4e2e-8652-03b03643a633 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:32.568490 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ed321a09-889d-4e2e-8652-03b03643a633 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:32.569237 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ed321a09-889d-4e2e-8652-03b03643a633 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:32.570537 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ed321a09-889d-4e2e-8652-03b03643a633 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:32.571941 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ed321a09-889d-4e2e-8652-03b03643a633 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:32.602614 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ed321a09-889d-4e2e-8652-03b03643a633 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053015 May 03 09:13:32.603328 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 598/1369] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:32 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:32.684889 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-8a7e7b95-c1e6-4ebd-82ea-dc9350191095 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:32.685450 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-8a7e7b95-c1e6-4ebd-82ea-dc9350191095 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:32.692211 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8a7e7b95-c1e6-4ebd-82ea-dc9350191095 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:32.692661 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8a7e7b95-c1e6-4ebd-82ea-dc9350191095 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:32.693438 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8a7e7b95-c1e6-4ebd-82ea-dc9350191095 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:32.693866 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8a7e7b95-c1e6-4ebd-82ea-dc9350191095 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:32.821302 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-8a7e7b95-c1e6-4ebd-82ea-dc9350191095 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:32.829957 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-8a7e7b95-c1e6-4ebd-82ea-dc9350191095 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:32.831446 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-8a7e7b95-c1e6-4ebd-82ea-dc9350191095 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:32.832658 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-8a7e7b95-c1e6-4ebd-82ea-dc9350191095 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.153742 May 03 09:13:32.833207 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 772/1370] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:32 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:13:33.618957 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d75e3cbd-5c50-4845-848f-9b4f1e90527d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:33.620500 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d75e3cbd-5c50-4845-848f-9b4f1e90527d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:33.628092 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d75e3cbd-5c50-4845-848f-9b4f1e90527d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:33.628565 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d75e3cbd-5c50-4845-848f-9b4f1e90527d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:33.629379 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d75e3cbd-5c50-4845-848f-9b4f1e90527d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:33.629836 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d75e3cbd-5c50-4845-848f-9b4f1e90527d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:33.661060 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d75e3cbd-5c50-4845-848f-9b4f1e90527d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048849 May 03 09:13:33.661625 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 599/1371] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:33 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:33.851900 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b45f1dfb-6a4f-4fbd-8866-31ccfe0d4970 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:33.852495 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b45f1dfb-6a4f-4fbd-8866-31ccfe0d4970 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:33.859692 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b45f1dfb-6a4f-4fbd-8866-31ccfe0d4970 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:33.860162 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b45f1dfb-6a4f-4fbd-8866-31ccfe0d4970 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:33.860928 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b45f1dfb-6a4f-4fbd-8866-31ccfe0d4970 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:33.861357 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b45f1dfb-6a4f-4fbd-8866-31ccfe0d4970 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:34.009667 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b45f1dfb-6a4f-4fbd-8866-31ccfe0d4970 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:34.018551 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b45f1dfb-6a4f-4fbd-8866-31ccfe0d4970 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:34.020049 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b45f1dfb-6a4f-4fbd-8866-31ccfe0d4970 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:34.021261 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b45f1dfb-6a4f-4fbd-8866-31ccfe0d4970 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.173362 May 03 09:13:34.021811 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 773/1372] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:33 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:13:34.679755 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-26ccd79d-3a16-4c49-8b08-8d20bbbd15d5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:34.679755 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-26ccd79d-3a16-4c49-8b08-8d20bbbd15d5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:34.690600 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-26ccd79d-3a16-4c49-8b08-8d20bbbd15d5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:34.691285 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-26ccd79d-3a16-4c49-8b08-8d20bbbd15d5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:34.692669 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-26ccd79d-3a16-4c49-8b08-8d20bbbd15d5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:34.693399 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-26ccd79d-3a16-4c49-8b08-8d20bbbd15d5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:34.726597 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-26ccd79d-3a16-4c49-8b08-8d20bbbd15d5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056045 May 03 09:13:34.727149 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 600/1373] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:34 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:35.043842 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-93ecbed5-1f40-4a12-b019-ff816cceb8ef tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:35.044691 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-93ecbed5-1f40-4a12-b019-ff816cceb8ef tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:35.055483 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-93ecbed5-1f40-4a12-b019-ff816cceb8ef tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:35.056252 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-93ecbed5-1f40-4a12-b019-ff816cceb8ef tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:35.057503 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-93ecbed5-1f40-4a12-b019-ff816cceb8ef tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:35.058238 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-93ecbed5-1f40-4a12-b019-ff816cceb8ef tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:35.197331 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-93ecbed5-1f40-4a12-b019-ff816cceb8ef tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:35.209111 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-93ecbed5-1f40-4a12-b019-ff816cceb8ef tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:35.210612 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-93ecbed5-1f40-4a12-b019-ff816cceb8ef tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:35.211853 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-93ecbed5-1f40-4a12-b019-ff816cceb8ef tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.174816 May 03 09:13:35.212737 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 774/1374] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:35 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:13:35.742818 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e30de896-0bea-47eb-aefd-5e51e75ab68f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:35.744559 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e30de896-0bea-47eb-aefd-5e51e75ab68f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:35.751985 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e30de896-0bea-47eb-aefd-5e51e75ab68f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:35.752453 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e30de896-0bea-47eb-aefd-5e51e75ab68f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:35.753226 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e30de896-0bea-47eb-aefd-5e51e75ab68f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:35.753668 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e30de896-0bea-47eb-aefd-5e51e75ab68f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:35.783278 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e30de896-0bea-47eb-aefd-5e51e75ab68f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047352 May 03 09:13:35.783840 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 601/1375] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:35 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:36.230849 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e4b054ac-ca83-46d8-a927-e9c63ead97e0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:36.231466 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e4b054ac-ca83-46d8-a927-e9c63ead97e0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:36.238414 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e4b054ac-ca83-46d8-a927-e9c63ead97e0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:36.238904 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e4b054ac-ca83-46d8-a927-e9c63ead97e0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:36.239717 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e4b054ac-ca83-46d8-a927-e9c63ead97e0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:36.240200 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e4b054ac-ca83-46d8-a927-e9c63ead97e0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:36.369583 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e4b054ac-ca83-46d8-a927-e9c63ead97e0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:36.378471 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e4b054ac-ca83-46d8-a927-e9c63ead97e0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:36.379931 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e4b054ac-ca83-46d8-a927-e9c63ead97e0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:36.381133 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e4b054ac-ca83-46d8-a927-e9c63ead97e0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.154248 May 03 09:13:36.381686 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 775/1376] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:36 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:13:36.799231 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-07d85c04-2666-44f2-83ff-6f845592d36e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:36.800825 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-07d85c04-2666-44f2-83ff-6f845592d36e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:36.811366 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-07d85c04-2666-44f2-83ff-6f845592d36e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:36.812164 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-07d85c04-2666-44f2-83ff-6f845592d36e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:36.813412 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-07d85c04-2666-44f2-83ff-6f845592d36e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:36.814146 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-07d85c04-2666-44f2-83ff-6f845592d36e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:36.847738 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-07d85c04-2666-44f2-83ff-6f845592d36e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055398 May 03 09:13:36.848372 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 602/1377] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:36 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:37.399996 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-bfe8936b-df92-4229-8db6-2382328929c3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:37.400659 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-bfe8936b-df92-4229-8db6-2382328929c3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:37.407573 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bfe8936b-df92-4229-8db6-2382328929c3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:37.408050 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bfe8936b-df92-4229-8db6-2382328929c3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:37.408848 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bfe8936b-df92-4229-8db6-2382328929c3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:37.409282 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bfe8936b-df92-4229-8db6-2382328929c3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:37.556271 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-bfe8936b-df92-4229-8db6-2382328929c3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:37.569654 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-bfe8936b-df92-4229-8db6-2382328929c3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:37.572151 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-bfe8936b-df92-4229-8db6-2382328929c3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:37.573971 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-bfe8936b-df92-4229-8db6-2382328929c3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.177823 May 03 09:13:37.574824 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 776/1378] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:37 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:13:37.863353 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a811d857-6be9-41d8-a004-c7c3b17194f5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:37.864793 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a811d857-6be9-41d8-a004-c7c3b17194f5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:37.874657 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a811d857-6be9-41d8-a004-c7c3b17194f5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:37.875181 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a811d857-6be9-41d8-a004-c7c3b17194f5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:37.875910 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a811d857-6be9-41d8-a004-c7c3b17194f5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:37.876352 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a811d857-6be9-41d8-a004-c7c3b17194f5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:37.905344 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a811d857-6be9-41d8-a004-c7c3b17194f5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049143 May 03 09:13:37.905922 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 603/1379] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:37 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:38.602674 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-860b0ede-7b20-44cb-9549-7c0596f2e48e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:38.603507 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-860b0ede-7b20-44cb-9549-7c0596f2e48e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:38.611866 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-860b0ede-7b20-44cb-9549-7c0596f2e48e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:38.612313 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-860b0ede-7b20-44cb-9549-7c0596f2e48e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:38.613074 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-860b0ede-7b20-44cb-9549-7c0596f2e48e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:38.613502 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-860b0ede-7b20-44cb-9549-7c0596f2e48e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:38.741872 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-860b0ede-7b20-44cb-9549-7c0596f2e48e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:38.750390 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-860b0ede-7b20-44cb-9549-7c0596f2e48e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:38.751904 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-860b0ede-7b20-44cb-9549-7c0596f2e48e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:38.753068 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-860b0ede-7b20-44cb-9549-7c0596f2e48e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.157202 May 03 09:13:38.753617 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 777/1380] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:38 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:13:38.921294 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c1146542-3f7d-4273-be1f-3581afaf4f5a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:38.922872 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c1146542-3f7d-4273-be1f-3581afaf4f5a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:38.934676 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c1146542-3f7d-4273-be1f-3581afaf4f5a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:38.935724 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c1146542-3f7d-4273-be1f-3581afaf4f5a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:38.936531 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c1146542-3f7d-4273-be1f-3581afaf4f5a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:38.936961 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c1146542-3f7d-4273-be1f-3581afaf4f5a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:38.967087 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c1146542-3f7d-4273-be1f-3581afaf4f5a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052529 May 03 09:13:38.967664 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 604/1381] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:38 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:39.781778 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5aa13415-81df-4f34-91bb-8cf76f37c7d4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:39.782627 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5aa13415-81df-4f34-91bb-8cf76f37c7d4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:39.793332 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5aa13415-81df-4f34-91bb-8cf76f37c7d4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:39.794074 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5aa13415-81df-4f34-91bb-8cf76f37c7d4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:39.795341 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5aa13415-81df-4f34-91bb-8cf76f37c7d4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:39.796121 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5aa13415-81df-4f34-91bb-8cf76f37c7d4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:39.928807 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5aa13415-81df-4f34-91bb-8cf76f37c7d4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:39.941091 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5aa13415-81df-4f34-91bb-8cf76f37c7d4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:39.943514 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5aa13415-81df-4f34-91bb-8cf76f37c7d4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:39.945392 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5aa13415-81df-4f34-91bb-8cf76f37c7d4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.170073 May 03 09:13:39.946264 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 778/1382] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:39 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:13:39.979462 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-cde5686c-a0d6-414f-ac7a-8f768ee521cb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:39.980449 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-cde5686c-a0d6-414f-ac7a-8f768ee521cb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:39.987494 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cde5686c-a0d6-414f-ac7a-8f768ee521cb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:39.987886 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cde5686c-a0d6-414f-ac7a-8f768ee521cb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:39.988674 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cde5686c-a0d6-414f-ac7a-8f768ee521cb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:39.989074 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cde5686c-a0d6-414f-ac7a-8f768ee521cb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:40.018990 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-cde5686c-a0d6-414f-ac7a-8f768ee521cb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043526 May 03 09:13:40.019591 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 605/1383] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:39 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:40.970879 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5419178f-3d57-4ebc-ad03-953bc94bc8b9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:40.971618 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5419178f-3d57-4ebc-ad03-953bc94bc8b9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:40.980408 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5419178f-3d57-4ebc-ad03-953bc94bc8b9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:40.980991 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5419178f-3d57-4ebc-ad03-953bc94bc8b9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:40.982004 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5419178f-3d57-4ebc-ad03-953bc94bc8b9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:40.982565 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5419178f-3d57-4ebc-ad03-953bc94bc8b9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:41.031788 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-09622508-c940-406a-8c6d-f927bf08effb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:41.032830 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-09622508-c940-406a-8c6d-f927bf08effb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:41.040008 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-09622508-c940-406a-8c6d-f927bf08effb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:41.040489 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-09622508-c940-406a-8c6d-f927bf08effb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:41.041258 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-09622508-c940-406a-8c6d-f927bf08effb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:41.041699 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-09622508-c940-406a-8c6d-f927bf08effb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:41.073716 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-09622508-c940-406a-8c6d-f927bf08effb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046885 May 03 09:13:41.074504 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 606/1384] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:41 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:41.120168 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5419178f-3d57-4ebc-ad03-953bc94bc8b9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:41.128943 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5419178f-3d57-4ebc-ad03-953bc94bc8b9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:41.130417 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5419178f-3d57-4ebc-ad03-953bc94bc8b9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:41.131576 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5419178f-3d57-4ebc-ad03-953bc94bc8b9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.167221 May 03 09:13:41.132163 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 779/1385] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:40 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:13:42.089327 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-3bcb04c0-9ca8-45c8-97d6-3dd940aa3e05 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:42.090945 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-3bcb04c0-9ca8-45c8-97d6-3dd940aa3e05 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:42.102021 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3bcb04c0-9ca8-45c8-97d6-3dd940aa3e05 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:42.102780 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3bcb04c0-9ca8-45c8-97d6-3dd940aa3e05 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:42.104261 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3bcb04c0-9ca8-45c8-97d6-3dd940aa3e05 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:42.104997 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3bcb04c0-9ca8-45c8-97d6-3dd940aa3e05 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:42.135749 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-3bcb04c0-9ca8-45c8-97d6-3dd940aa3e05 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053183 May 03 09:13:42.136346 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 607/1386] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:42 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:42.157046 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c8cb50b1-085b-4315-bc6a-37994e640b2b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:42.157694 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c8cb50b1-085b-4315-bc6a-37994e640b2b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:42.165584 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c8cb50b1-085b-4315-bc6a-37994e640b2b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:42.166034 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c8cb50b1-085b-4315-bc6a-37994e640b2b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:42.166807 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c8cb50b1-085b-4315-bc6a-37994e640b2b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:42.167239 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c8cb50b1-085b-4315-bc6a-37994e640b2b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:42.303974 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c8cb50b1-085b-4315-bc6a-37994e640b2b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:42.312732 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c8cb50b1-085b-4315-bc6a-37994e640b2b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:42.314234 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c8cb50b1-085b-4315-bc6a-37994e640b2b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:42.315431 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c8cb50b1-085b-4315-bc6a-37994e640b2b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.163496 May 03 09:13:42.316024 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 780/1387] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:42 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:13:43.149018 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a2fa966e-a74b-4bd8-81ec-596538799ad1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:43.150190 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a2fa966e-a74b-4bd8-81ec-596538799ad1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:43.158403 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a2fa966e-a74b-4bd8-81ec-596538799ad1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:43.158696 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a2fa966e-a74b-4bd8-81ec-596538799ad1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:43.159488 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a2fa966e-a74b-4bd8-81ec-596538799ad1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:43.159936 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a2fa966e-a74b-4bd8-81ec-596538799ad1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:43.189868 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a2fa966e-a74b-4bd8-81ec-596538799ad1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045970 May 03 09:13:43.190442 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 608/1388] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:43 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:43.338236 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ccdf93f3-6adf-4da5-a92f-c1f1290384d0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:43.339225 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ccdf93f3-6adf-4da5-a92f-c1f1290384d0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:43.348117 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ccdf93f3-6adf-4da5-a92f-c1f1290384d0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:43.348563 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ccdf93f3-6adf-4da5-a92f-c1f1290384d0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:43.349326 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ccdf93f3-6adf-4da5-a92f-c1f1290384d0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:43.349743 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ccdf93f3-6adf-4da5-a92f-c1f1290384d0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:43.476786 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ccdf93f3-6adf-4da5-a92f-c1f1290384d0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:43.485135 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ccdf93f3-6adf-4da5-a92f-c1f1290384d0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:43.486621 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ccdf93f3-6adf-4da5-a92f-c1f1290384d0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:43.487799 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ccdf93f3-6adf-4da5-a92f-c1f1290384d0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.156285 May 03 09:13:43.488387 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 781/1389] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:43 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:13:44.205201 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2eb7feb9-b7e8-43ca-85c0-d095d27b367a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:44.206267 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-2eb7feb9-b7e8-43ca-85c0-d095d27b367a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:44.213951 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2eb7feb9-b7e8-43ca-85c0-d095d27b367a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:44.214491 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2eb7feb9-b7e8-43ca-85c0-d095d27b367a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:44.215396 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2eb7feb9-b7e8-43ca-85c0-d095d27b367a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:44.215924 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2eb7feb9-b7e8-43ca-85c0-d095d27b367a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:44.247631 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-2eb7feb9-b7e8-43ca-85c0-d095d27b367a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048379 May 03 09:13:44.248431 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 609/1390] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:44 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:44.510057 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-69b3d1ef-f5a4-45a8-b131-99616d8c0e16 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:44.510949 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-69b3d1ef-f5a4-45a8-b131-99616d8c0e16 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:44.521554 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-69b3d1ef-f5a4-45a8-b131-99616d8c0e16 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:44.522301 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-69b3d1ef-f5a4-45a8-b131-99616d8c0e16 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:44.523547 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-69b3d1ef-f5a4-45a8-b131-99616d8c0e16 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:44.524305 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-69b3d1ef-f5a4-45a8-b131-99616d8c0e16 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:44.675068 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-69b3d1ef-f5a4-45a8-b131-99616d8c0e16 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:44.683896 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-69b3d1ef-f5a4-45a8-b131-99616d8c0e16 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:44.685373 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-69b3d1ef-f5a4-45a8-b131-99616d8c0e16 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:44.686526 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-69b3d1ef-f5a4-45a8-b131-99616d8c0e16 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.183243 May 03 09:13:44.687074 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 782/1391] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:44 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:13:45.264749 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-246dcc64-d468-4b51-b45e-ae4bfb775b3d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:45.266230 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-246dcc64-d468-4b51-b45e-ae4bfb775b3d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:45.276731 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-246dcc64-d468-4b51-b45e-ae4bfb775b3d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:45.277511 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-246dcc64-d468-4b51-b45e-ae4bfb775b3d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:45.278974 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-246dcc64-d468-4b51-b45e-ae4bfb775b3d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:45.279693 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-246dcc64-d468-4b51-b45e-ae4bfb775b3d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:45.309526 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-246dcc64-d468-4b51-b45e-ae4bfb775b3d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051321 May 03 09:13:45.310299 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 610/1392] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:45 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:45.706322 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f7a9df6e-2c80-41f0-9437-2558298ec50a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:45.707007 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f7a9df6e-2c80-41f0-9437-2558298ec50a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:45.713998 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f7a9df6e-2c80-41f0-9437-2558298ec50a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:45.714437 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f7a9df6e-2c80-41f0-9437-2558298ec50a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:45.715333 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f7a9df6e-2c80-41f0-9437-2558298ec50a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:45.715989 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f7a9df6e-2c80-41f0-9437-2558298ec50a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:45.851363 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f7a9df6e-2c80-41f0-9437-2558298ec50a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:45.860306 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f7a9df6e-2c80-41f0-9437-2558298ec50a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:45.861783 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f7a9df6e-2c80-41f0-9437-2558298ec50a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:45.862949 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f7a9df6e-2c80-41f0-9437-2558298ec50a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.161306 May 03 09:13:45.863489 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 783/1393] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:45 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:13:46.326548 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-28d4d9ed-c640-455d-8b58-538d3993b5a0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:46.328153 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-28d4d9ed-c640-455d-8b58-538d3993b5a0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:46.334714 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-28d4d9ed-c640-455d-8b58-538d3993b5a0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:46.335164 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-28d4d9ed-c640-455d-8b58-538d3993b5a0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:46.335990 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-28d4d9ed-c640-455d-8b58-538d3993b5a0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:46.336553 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-28d4d9ed-c640-455d-8b58-538d3993b5a0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:46.366776 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-28d4d9ed-c640-455d-8b58-538d3993b5a0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047054 May 03 09:13:46.367571 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 611/1394] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:46 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:46.885175 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-27caa5c6-7d9f-4b66-96d0-94110e6daa24 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:46.886190 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-27caa5c6-7d9f-4b66-96d0-94110e6daa24 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:46.894575 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-27caa5c6-7d9f-4b66-96d0-94110e6daa24 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:46.895015 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-27caa5c6-7d9f-4b66-96d0-94110e6daa24 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:46.895797 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-27caa5c6-7d9f-4b66-96d0-94110e6daa24 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:46.896246 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-27caa5c6-7d9f-4b66-96d0-94110e6daa24 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:47.027639 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-27caa5c6-7d9f-4b66-96d0-94110e6daa24 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:47.040420 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-27caa5c6-7d9f-4b66-96d0-94110e6daa24 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:47.042545 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-27caa5c6-7d9f-4b66-96d0-94110e6daa24 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:47.043959 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-27caa5c6-7d9f-4b66-96d0-94110e6daa24 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.165239 May 03 09:13:47.044734 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 784/1395] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:46 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:13:47.380101 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-317a72b6-cbd1-436b-816b-781aaed99901 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:47.382652 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-317a72b6-cbd1-436b-816b-781aaed99901 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:47.389179 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-317a72b6-cbd1-436b-816b-781aaed99901 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:47.389629 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-317a72b6-cbd1-436b-816b-781aaed99901 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:47.390402 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-317a72b6-cbd1-436b-816b-781aaed99901 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:47.390839 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-317a72b6-cbd1-436b-816b-781aaed99901 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:47.420917 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-317a72b6-cbd1-436b-816b-781aaed99901 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046004 May 03 09:13:47.424934 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 612/1396] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:47 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:48.062819 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-fb6f3d43-dfcb-4a55-8c8b-c1daa6cdc622 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:48.063389 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-fb6f3d43-dfcb-4a55-8c8b-c1daa6cdc622 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:48.070567 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fb6f3d43-dfcb-4a55-8c8b-c1daa6cdc622 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:48.071024 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fb6f3d43-dfcb-4a55-8c8b-c1daa6cdc622 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:48.071822 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fb6f3d43-dfcb-4a55-8c8b-c1daa6cdc622 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:48.072255 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fb6f3d43-dfcb-4a55-8c8b-c1daa6cdc622 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:48.207880 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-fb6f3d43-dfcb-4a55-8c8b-c1daa6cdc622 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:48.216343 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-fb6f3d43-dfcb-4a55-8c8b-c1daa6cdc622 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:48.217841 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-fb6f3d43-dfcb-4a55-8c8b-c1daa6cdc622 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:48.219063 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-fb6f3d43-dfcb-4a55-8c8b-c1daa6cdc622 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.160323 May 03 09:13:48.219616 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 785/1397] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:48 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:13:48.436788 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b5271d34-5bc1-4144-92d6-97c7fe3c7501 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:48.438390 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b5271d34-5bc1-4144-92d6-97c7fe3c7501 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:48.448948 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b5271d34-5bc1-4144-92d6-97c7fe3c7501 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:48.450429 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b5271d34-5bc1-4144-92d6-97c7fe3c7501 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:48.450934 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b5271d34-5bc1-4144-92d6-97c7fe3c7501 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:48.451679 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b5271d34-5bc1-4144-92d6-97c7fe3c7501 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:48.482127 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b5271d34-5bc1-4144-92d6-97c7fe3c7501 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052140 May 03 09:13:48.482700 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 613/1398] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:48 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:49.238956 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b8a89d25-eeff-41ea-97e0-5c9e0e0ae7c6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:49.239568 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b8a89d25-eeff-41ea-97e0-5c9e0e0ae7c6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:49.246483 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b8a89d25-eeff-41ea-97e0-5c9e0e0ae7c6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:49.246937 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b8a89d25-eeff-41ea-97e0-5c9e0e0ae7c6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:49.247670 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b8a89d25-eeff-41ea-97e0-5c9e0e0ae7c6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:49.248164 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b8a89d25-eeff-41ea-97e0-5c9e0e0ae7c6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:49.380912 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b8a89d25-eeff-41ea-97e0-5c9e0e0ae7c6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:49.393430 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b8a89d25-eeff-41ea-97e0-5c9e0e0ae7c6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:49.395024 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b8a89d25-eeff-41ea-97e0-5c9e0e0ae7c6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:49.397362 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b8a89d25-eeff-41ea-97e0-5c9e0e0ae7c6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.161459 May 03 09:13:49.397362 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 786/1399] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:49 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:13:49.494620 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b04c9398-a415-4b23-a78d-8f3145554312 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:49.495616 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b04c9398-a415-4b23-a78d-8f3145554312 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:49.502748 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b04c9398-a415-4b23-a78d-8f3145554312 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:49.503218 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b04c9398-a415-4b23-a78d-8f3145554312 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:49.504583 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b04c9398-a415-4b23-a78d-8f3145554312 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:49.504583 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b04c9398-a415-4b23-a78d-8f3145554312 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:49.534983 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b04c9398-a415-4b23-a78d-8f3145554312 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044562 May 03 09:13:49.535601 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 614/1400] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:49 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:50.417116 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3cfdd754-67c1-4fd7-8061-6874b0604738 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:50.417700 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-3cfdd754-67c1-4fd7-8061-6874b0604738 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:50.424868 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3cfdd754-67c1-4fd7-8061-6874b0604738 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:50.425319 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3cfdd754-67c1-4fd7-8061-6874b0604738 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:50.426093 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3cfdd754-67c1-4fd7-8061-6874b0604738 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:50.426537 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3cfdd754-67c1-4fd7-8061-6874b0604738 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:50.547115 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ce8073cb-4968-4c33-8916-513123cd4422 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:50.548147 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ce8073cb-4968-4c33-8916-513123cd4422 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:50.554995 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ce8073cb-4968-4c33-8916-513123cd4422 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:50.555443 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ce8073cb-4968-4c33-8916-513123cd4422 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:50.556255 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ce8073cb-4968-4c33-8916-513123cd4422 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:50.556672 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ce8073cb-4968-4c33-8916-513123cd4422 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:50.564349 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-3cfdd754-67c1-4fd7-8061-6874b0604738 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:50.572919 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-3cfdd754-67c1-4fd7-8061-6874b0604738 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:50.574482 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-3cfdd754-67c1-4fd7-8061-6874b0604738 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:50.575681 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-3cfdd754-67c1-4fd7-8061-6874b0604738 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.162634 May 03 09:13:50.576252 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 787/1401] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:50 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:13:50.591656 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ce8073cb-4968-4c33-8916-513123cd4422 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048623 May 03 09:13:50.592296 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 615/1402] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:50 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:51.599313 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-7554ea81-17c6-47bc-970f-1fb3e5df9e77 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:51.600430 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-7554ea81-17c6-47bc-970f-1fb3e5df9e77 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:51.607798 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-dda5423c-5845-4fd1-8abe-c86266eb6ce2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:51.609341 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-dda5423c-5845-4fd1-8abe-c86266eb6ce2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:51.610984 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7554ea81-17c6-47bc-970f-1fb3e5df9e77 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:51.611439 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7554ea81-17c6-47bc-970f-1fb3e5df9e77 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:51.612248 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7554ea81-17c6-47bc-970f-1fb3e5df9e77 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:51.612689 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7554ea81-17c6-47bc-970f-1fb3e5df9e77 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:51.615983 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dda5423c-5845-4fd1-8abe-c86266eb6ce2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:51.616427 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dda5423c-5845-4fd1-8abe-c86266eb6ce2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:51.617563 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dda5423c-5845-4fd1-8abe-c86266eb6ce2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:51.617982 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dda5423c-5845-4fd1-8abe-c86266eb6ce2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:51.646957 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-dda5423c-5845-4fd1-8abe-c86266eb6ce2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045561 May 03 09:13:51.650782 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 616/1403] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:51 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:51.738778 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7554ea81-17c6-47bc-970f-1fb3e5df9e77 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:51.747856 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7554ea81-17c6-47bc-970f-1fb3e5df9e77 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:51.749368 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7554ea81-17c6-47bc-970f-1fb3e5df9e77 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:51.750575 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-7554ea81-17c6-47bc-970f-1fb3e5df9e77 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.158298 May 03 09:13:51.751235 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 788/1404] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:51 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:13:52.662918 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e58ec08e-a405-4c8c-b941-961fc16f7346 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:52.664409 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e58ec08e-a405-4c8c-b941-961fc16f7346 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:52.674992 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e58ec08e-a405-4c8c-b941-961fc16f7346 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:52.675723 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e58ec08e-a405-4c8c-b941-961fc16f7346 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:52.677047 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e58ec08e-a405-4c8c-b941-961fc16f7346 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:52.677759 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e58ec08e-a405-4c8c-b941-961fc16f7346 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:52.711329 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e58ec08e-a405-4c8c-b941-961fc16f7346 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055115 May 03 09:13:52.711883 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 617/1405] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:52 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:52.772831 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-fa031145-0d53-4663-aa46-b42878dcfc2f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:52.773793 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-fa031145-0d53-4663-aa46-b42878dcfc2f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:52.783232 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fa031145-0d53-4663-aa46-b42878dcfc2f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:52.783680 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fa031145-0d53-4663-aa46-b42878dcfc2f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:52.784484 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fa031145-0d53-4663-aa46-b42878dcfc2f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:52.784915 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fa031145-0d53-4663-aa46-b42878dcfc2f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:52.922120 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-fa031145-0d53-4663-aa46-b42878dcfc2f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:52.930686 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-fa031145-0d53-4663-aa46-b42878dcfc2f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:52.932207 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-fa031145-0d53-4663-aa46-b42878dcfc2f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:52.933376 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-fa031145-0d53-4663-aa46-b42878dcfc2f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.164880 May 03 09:13:52.933905 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 789/1406] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:52 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:13:53.727280 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2c6110b9-7e2c-4e30-be21-a9401c4a6db4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:53.728840 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-2c6110b9-7e2c-4e30-be21-a9401c4a6db4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:53.737597 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2c6110b9-7e2c-4e30-be21-a9401c4a6db4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:53.738040 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2c6110b9-7e2c-4e30-be21-a9401c4a6db4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:53.738824 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2c6110b9-7e2c-4e30-be21-a9401c4a6db4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:53.739247 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2c6110b9-7e2c-4e30-be21-a9401c4a6db4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:53.768341 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-2c6110b9-7e2c-4e30-be21-a9401c4a6db4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048260 May 03 09:13:53.768889 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 618/1407] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:53 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:53.961864 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-0c177ddb-0294-498d-8a98-f4c27b6e2e84 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:53.962929 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-0c177ddb-0294-498d-8a98-f4c27b6e2e84 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:53.972512 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0c177ddb-0294-498d-8a98-f4c27b6e2e84 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:53.972965 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0c177ddb-0294-498d-8a98-f4c27b6e2e84 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:53.973767 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0c177ddb-0294-498d-8a98-f4c27b6e2e84 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:53.974206 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0c177ddb-0294-498d-8a98-f4c27b6e2e84 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:54.124030 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-0c177ddb-0294-498d-8a98-f4c27b6e2e84 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:54.132480 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-0c177ddb-0294-498d-8a98-f4c27b6e2e84 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:54.133981 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-0c177ddb-0294-498d-8a98-f4c27b6e2e84 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:54.135147 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-0c177ddb-0294-498d-8a98-f4c27b6e2e84 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.180098 May 03 09:13:54.135706 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 790/1408] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:53 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:13:54.782911 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-8e8d99b2-cb3e-4623-8c0b-fb2a9d8cf9a4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:54.783952 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-8e8d99b2-cb3e-4623-8c0b-fb2a9d8cf9a4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:54.791693 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8e8d99b2-cb3e-4623-8c0b-fb2a9d8cf9a4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:54.792290 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8e8d99b2-cb3e-4623-8c0b-fb2a9d8cf9a4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:54.793161 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8e8d99b2-cb3e-4623-8c0b-fb2a9d8cf9a4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:54.793707 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8e8d99b2-cb3e-4623-8c0b-fb2a9d8cf9a4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:54.827051 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-8e8d99b2-cb3e-4623-8c0b-fb2a9d8cf9a4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050216 May 03 09:13:54.827666 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 619/1409] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:54 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:55.157543 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e70d2184-8c46-4ec9-b84d-e222a6fca446 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:55.158538 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e70d2184-8c46-4ec9-b84d-e222a6fca446 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:55.169098 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e70d2184-8c46-4ec9-b84d-e222a6fca446 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:55.169841 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e70d2184-8c46-4ec9-b84d-e222a6fca446 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:55.171106 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e70d2184-8c46-4ec9-b84d-e222a6fca446 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:55.171841 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e70d2184-8c46-4ec9-b84d-e222a6fca446 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:55.300002 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e70d2184-8c46-4ec9-b84d-e222a6fca446 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:55.308264 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e70d2184-8c46-4ec9-b84d-e222a6fca446 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:55.309760 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e70d2184-8c46-4ec9-b84d-e222a6fca446 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:55.310926 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e70d2184-8c46-4ec9-b84d-e222a6fca446 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.159915 May 03 09:13:55.311483 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 791/1410] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:55 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:13:55.842913 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-de3a1445-b61a-4aac-b9a2-98cdafd9fbbb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:55.844455 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-de3a1445-b61a-4aac-b9a2-98cdafd9fbbb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:55.855482 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-de3a1445-b61a-4aac-b9a2-98cdafd9fbbb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:55.856290 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-de3a1445-b61a-4aac-b9a2-98cdafd9fbbb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:55.857571 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-de3a1445-b61a-4aac-b9a2-98cdafd9fbbb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:55.858293 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-de3a1445-b61a-4aac-b9a2-98cdafd9fbbb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:55.888829 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-de3a1445-b61a-4aac-b9a2-98cdafd9fbbb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052591 May 03 09:13:55.889399 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 620/1411] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:55 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:56.329283 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b0412f1c-5a23-4828-a525-0d37a3b8dfd6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:56.329887 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b0412f1c-5a23-4828-a525-0d37a3b8dfd6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:56.336317 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b0412f1c-5a23-4828-a525-0d37a3b8dfd6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:56.336756 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b0412f1c-5a23-4828-a525-0d37a3b8dfd6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:56.337573 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b0412f1c-5a23-4828-a525-0d37a3b8dfd6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:56.337995 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b0412f1c-5a23-4828-a525-0d37a3b8dfd6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:56.470195 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b0412f1c-5a23-4828-a525-0d37a3b8dfd6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:56.479221 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b0412f1c-5a23-4828-a525-0d37a3b8dfd6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:56.480784 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b0412f1c-5a23-4828-a525-0d37a3b8dfd6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:56.481984 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b0412f1c-5a23-4828-a525-0d37a3b8dfd6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.156707 May 03 09:13:56.482515 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 792/1412] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:56 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:13:56.904591 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c49759f5-e3d8-4a71-b031-1baacc78d452 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:56.906107 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c49759f5-e3d8-4a71-b031-1baacc78d452 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:56.916142 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c49759f5-e3d8-4a71-b031-1baacc78d452 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:56.916895 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c49759f5-e3d8-4a71-b031-1baacc78d452 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:56.918152 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c49759f5-e3d8-4a71-b031-1baacc78d452 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:56.918885 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c49759f5-e3d8-4a71-b031-1baacc78d452 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:56.950166 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c49759f5-e3d8-4a71-b031-1baacc78d452 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052319 May 03 09:13:56.950974 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 621/1413] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:56 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:57.502831 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e274aa72-63bb-4b1d-b595-efb36c23300f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:57.503620 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e274aa72-63bb-4b1d-b595-efb36c23300f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:57.513876 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e274aa72-63bb-4b1d-b595-efb36c23300f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:57.514395 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e274aa72-63bb-4b1d-b595-efb36c23300f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:57.515578 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e274aa72-63bb-4b1d-b595-efb36c23300f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:57.516432 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e274aa72-63bb-4b1d-b595-efb36c23300f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:57.654378 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e274aa72-63bb-4b1d-b595-efb36c23300f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:57.667729 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e274aa72-63bb-4b1d-b595-efb36c23300f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:57.670082 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e274aa72-63bb-4b1d-b595-efb36c23300f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:57.671888 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e274aa72-63bb-4b1d-b595-efb36c23300f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.175415 May 03 09:13:57.672729 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 793/1414] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:57 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:13:57.966475 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c5815e96-4f28-4bde-8307-c07f22204bd6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:57.968416 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c5815e96-4f28-4bde-8307-c07f22204bd6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:57.975608 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c5815e96-4f28-4bde-8307-c07f22204bd6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:57.976126 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c5815e96-4f28-4bde-8307-c07f22204bd6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:57.976893 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c5815e96-4f28-4bde-8307-c07f22204bd6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:57.977322 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c5815e96-4f28-4bde-8307-c07f22204bd6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:58.006283 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c5815e96-4f28-4bde-8307-c07f22204bd6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046563 May 03 09:13:58.006834 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 622/1415] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:57 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:58.695034 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ccac202c-e26e-48f2-b9a0-a2a0195637f9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:58.695933 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ccac202c-e26e-48f2-b9a0-a2a0195637f9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:58.706609 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ccac202c-e26e-48f2-b9a0-a2a0195637f9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:58.707348 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ccac202c-e26e-48f2-b9a0-a2a0195637f9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:58.708663 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ccac202c-e26e-48f2-b9a0-a2a0195637f9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:58.709379 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ccac202c-e26e-48f2-b9a0-a2a0195637f9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:58.852089 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ccac202c-e26e-48f2-b9a0-a2a0195637f9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:58.861029 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ccac202c-e26e-48f2-b9a0-a2a0195637f9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:58.862532 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ccac202c-e26e-48f2-b9a0-a2a0195637f9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:13:58.863687 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ccac202c-e26e-48f2-b9a0-a2a0195637f9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.175546 May 03 09:13:58.864269 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 794/1416] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:58 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:13:59.019095 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ac016633-10c2-44f8-a42c-c8b001f10955 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:59.020018 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ac016633-10c2-44f8-a42c-c8b001f10955 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:59.026776 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ac016633-10c2-44f8-a42c-c8b001f10955 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:59.027171 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ac016633-10c2-44f8-a42c-c8b001f10955 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:59.028030 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ac016633-10c2-44f8-a42c-c8b001f10955 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:59.028557 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ac016633-10c2-44f8-a42c-c8b001f10955 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:59.058003 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ac016633-10c2-44f8-a42c-c8b001f10955 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043379 May 03 09:13:59.058557 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 623/1417] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:13:59 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:13:59.886477 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-73c4d050-b6c6-4b81-a30f-805257a64247 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:13:59.887459 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-73c4d050-b6c6-4b81-a30f-805257a64247 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:13:59.896233 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-73c4d050-b6c6-4b81-a30f-805257a64247 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:59.896686 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-73c4d050-b6c6-4b81-a30f-805257a64247 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:13:59.897467 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-73c4d050-b6c6-4b81-a30f-805257a64247 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:13:59.897901 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-73c4d050-b6c6-4b81-a30f-805257a64247 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:00.044256 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-73c4d050-b6c6-4b81-a30f-805257a64247 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:00.056694 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-73c4d050-b6c6-4b81-a30f-805257a64247 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:00.058913 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-73c4d050-b6c6-4b81-a30f-805257a64247 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:00.060785 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-73c4d050-b6c6-4b81-a30f-805257a64247 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.180778 May 03 09:14:00.061526 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 795/1418] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:13:59 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:14:00.069878 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4b2e252d-d2f7-4675-8027-251049029049 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:00.070837 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4b2e252d-d2f7-4675-8027-251049029049 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:00.077457 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4b2e252d-d2f7-4675-8027-251049029049 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:00.078079 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4b2e252d-d2f7-4675-8027-251049029049 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:00.078914 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4b2e252d-d2f7-4675-8027-251049029049 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:00.079356 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4b2e252d-d2f7-4675-8027-251049029049 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:00.109813 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-4b2e252d-d2f7-4675-8027-251049029049 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043791 May 03 09:14:00.110403 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 624/1419] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:14:00 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:14:01.083830 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-1bba3edc-452d-4d6b-921d-d2a5390b82da tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:01.084894 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-1bba3edc-452d-4d6b-921d-d2a5390b82da tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:01.096289 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1bba3edc-452d-4d6b-921d-d2a5390b82da tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:01.097035 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1bba3edc-452d-4d6b-921d-d2a5390b82da tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:01.098359 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1bba3edc-452d-4d6b-921d-d2a5390b82da tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:01.099087 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1bba3edc-452d-4d6b-921d-d2a5390b82da tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:01.122296 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e998f223-198c-4d2c-8cc8-fc4f5c6498b0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:01.123302 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e998f223-198c-4d2c-8cc8-fc4f5c6498b0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:01.129794 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e998f223-198c-4d2c-8cc8-fc4f5c6498b0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:01.130322 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e998f223-198c-4d2c-8cc8-fc4f5c6498b0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:01.131757 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e998f223-198c-4d2c-8cc8-fc4f5c6498b0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:01.131757 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e998f223-198c-4d2c-8cc8-fc4f5c6498b0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:01.162110 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e998f223-198c-4d2c-8cc8-fc4f5c6498b0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044487 May 03 09:14:01.162714 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 625/1420] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:14:01 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:14:01.231101 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-1bba3edc-452d-4d6b-921d-d2a5390b82da tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:01.240046 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-1bba3edc-452d-4d6b-921d-d2a5390b82da tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:01.241552 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-1bba3edc-452d-4d6b-921d-d2a5390b82da tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:01.242731 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-1bba3edc-452d-4d6b-921d-d2a5390b82da tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.165610 May 03 09:14:01.243350 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 796/1421] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:14:01 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:14:02.178164 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ce8f498a-a68b-419b-9860-9d858efa2498 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:02.179843 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ce8f498a-a68b-419b-9860-9d858efa2498 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:02.189695 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ce8f498a-a68b-419b-9860-9d858efa2498 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:02.190162 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ce8f498a-a68b-419b-9860-9d858efa2498 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:02.190921 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ce8f498a-a68b-419b-9860-9d858efa2498 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:02.191351 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ce8f498a-a68b-419b-9860-9d858efa2498 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:02.221620 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ce8f498a-a68b-419b-9860-9d858efa2498 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050437 May 03 09:14:02.222390 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 626/1422] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:14:02 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:14:02.261418 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b058dadb-3cfc-4ae4-9b2c-3c758303c3eb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:02.262043 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b058dadb-3cfc-4ae4-9b2c-3c758303c3eb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:02.268906 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b058dadb-3cfc-4ae4-9b2c-3c758303c3eb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:02.269357 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b058dadb-3cfc-4ae4-9b2c-3c758303c3eb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:02.270135 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b058dadb-3cfc-4ae4-9b2c-3c758303c3eb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:02.270556 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b058dadb-3cfc-4ae4-9b2c-3c758303c3eb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:02.409650 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b058dadb-3cfc-4ae4-9b2c-3c758303c3eb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:02.418285 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b058dadb-3cfc-4ae4-9b2c-3c758303c3eb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:02.419744 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b058dadb-3cfc-4ae4-9b2c-3c758303c3eb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:02.420950 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b058dadb-3cfc-4ae4-9b2c-3c758303c3eb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.163589 May 03 09:14:02.421515 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 797/1423] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:14:02 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:14:03.233617 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b01bf535-1fe0-40ef-a3e0-d99144f5d6e3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:03.234571 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b01bf535-1fe0-40ef-a3e0-d99144f5d6e3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:03.241380 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b01bf535-1fe0-40ef-a3e0-d99144f5d6e3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:03.241836 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b01bf535-1fe0-40ef-a3e0-d99144f5d6e3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:03.242622 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b01bf535-1fe0-40ef-a3e0-d99144f5d6e3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:03.243070 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b01bf535-1fe0-40ef-a3e0-d99144f5d6e3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:03.272874 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b01bf535-1fe0-40ef-a3e0-d99144f5d6e3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043191 May 03 09:14:03.273410 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 627/1424] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:14:03 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:14:03.519357 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-63a0bcc5-84da-4607-8576-57f1fa568284 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:03.519998 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-63a0bcc5-84da-4607-8576-57f1fa568284 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:03.526559 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-63a0bcc5-84da-4607-8576-57f1fa568284 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:03.526999 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-63a0bcc5-84da-4607-8576-57f1fa568284 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:03.527790 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-63a0bcc5-84da-4607-8576-57f1fa568284 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:03.528226 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-63a0bcc5-84da-4607-8576-57f1fa568284 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:03.667682 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-63a0bcc5-84da-4607-8576-57f1fa568284 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:03.676360 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-63a0bcc5-84da-4607-8576-57f1fa568284 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:03.677930 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-63a0bcc5-84da-4607-8576-57f1fa568284 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:03.679119 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-63a0bcc5-84da-4607-8576-57f1fa568284 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.236837 May 03 09:14:03.679679 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 798/1425] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:14:03 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:14:04.288283 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2c536e07-2ed5-4c56-9ef4-9c5ddce6bb8b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:04.289796 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-2c536e07-2ed5-4c56-9ef4-9c5ddce6bb8b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:04.299873 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2c536e07-2ed5-4c56-9ef4-9c5ddce6bb8b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:04.300328 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2c536e07-2ed5-4c56-9ef4-9c5ddce6bb8b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:04.301165 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2c536e07-2ed5-4c56-9ef4-9c5ddce6bb8b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:04.301627 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2c536e07-2ed5-4c56-9ef4-9c5ddce6bb8b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:04.334291 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-2c536e07-2ed5-4c56-9ef4-9c5ddce6bb8b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052619 May 03 09:14:04.337897 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 628/1426] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:14:04 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:14:04.703182 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d66c31e9-e766-4609-837e-2f27232cf413 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:04.704352 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d66c31e9-e766-4609-837e-2f27232cf413 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:04.713713 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d66c31e9-e766-4609-837e-2f27232cf413 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:04.714459 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d66c31e9-e766-4609-837e-2f27232cf413 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:04.715714 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d66c31e9-e766-4609-837e-2f27232cf413 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:04.716464 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d66c31e9-e766-4609-837e-2f27232cf413 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:04.848206 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d66c31e9-e766-4609-837e-2f27232cf413 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:04.856616 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d66c31e9-e766-4609-837e-2f27232cf413 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:04.858196 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d66c31e9-e766-4609-837e-2f27232cf413 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:04.859353 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d66c31e9-e766-4609-837e-2f27232cf413 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.163726 May 03 09:14:04.859965 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 799/1427] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:14:04 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:14:05.346985 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-953390c2-0a8f-4275-b685-e7491b9f00dd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:05.347938 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-953390c2-0a8f-4275-b685-e7491b9f00dd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:05.354864 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-953390c2-0a8f-4275-b685-e7491b9f00dd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:05.355309 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-953390c2-0a8f-4275-b685-e7491b9f00dd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:05.356097 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-953390c2-0a8f-4275-b685-e7491b9f00dd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:05.356529 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-953390c2-0a8f-4275-b685-e7491b9f00dd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:05.385522 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-953390c2-0a8f-4275-b685-e7491b9f00dd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043055 May 03 09:14:05.386082 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 629/1428] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:14:05 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:14:05.877708 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-67e61ce6-ae8b-4c9b-a5a4-57b128b73bf8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:05.878431 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-67e61ce6-ae8b-4c9b-a5a4-57b128b73bf8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:05.884950 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-67e61ce6-ae8b-4c9b-a5a4-57b128b73bf8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:05.885396 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-67e61ce6-ae8b-4c9b-a5a4-57b128b73bf8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:05.886192 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-67e61ce6-ae8b-4c9b-a5a4-57b128b73bf8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:05.886599 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-67e61ce6-ae8b-4c9b-a5a4-57b128b73bf8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:06.026182 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-67e61ce6-ae8b-4c9b-a5a4-57b128b73bf8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:06.034861 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-67e61ce6-ae8b-4c9b-a5a4-57b128b73bf8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:06.036392 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-67e61ce6-ae8b-4c9b-a5a4-57b128b73bf8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:06.037555 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-67e61ce6-ae8b-4c9b-a5a4-57b128b73bf8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.163764 May 03 09:14:06.038252 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 800/1429] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:14:05 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:14:06.399599 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b9697af7-69b3-41d2-924f-333c0d485122 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:06.400739 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b9697af7-69b3-41d2-924f-333c0d485122 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:06.408979 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b9697af7-69b3-41d2-924f-333c0d485122 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:06.409509 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b9697af7-69b3-41d2-924f-333c0d485122 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:06.410425 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b9697af7-69b3-41d2-924f-333c0d485122 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:06.410940 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b9697af7-69b3-41d2-924f-333c0d485122 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:06.443571 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b9697af7-69b3-41d2-924f-333c0d485122 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048697 May 03 09:14:06.444452 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 630/1430] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:14:06 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:14:07.058542 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-cb79a8f7-efce-419a-9d55-f2b91176ca0f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:07.059170 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-cb79a8f7-efce-419a-9d55-f2b91176ca0f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:07.067582 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cb79a8f7-efce-419a-9d55-f2b91176ca0f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:07.068399 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cb79a8f7-efce-419a-9d55-f2b91176ca0f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:07.069671 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cb79a8f7-efce-419a-9d55-f2b91176ca0f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:07.070399 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cb79a8f7-efce-419a-9d55-f2b91176ca0f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:07.210719 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-cb79a8f7-efce-419a-9d55-f2b91176ca0f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:07.219074 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-cb79a8f7-efce-419a-9d55-f2b91176ca0f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:07.220955 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-cb79a8f7-efce-419a-9d55-f2b91176ca0f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:07.222123 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-cb79a8f7-efce-419a-9d55-f2b91176ca0f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.169203 May 03 09:14:07.222672 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 801/1431] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:14:07 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:14:07.458958 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-62fd00a0-7adb-4679-a310-88c9aef4eee3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:07.460363 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-62fd00a0-7adb-4679-a310-88c9aef4eee3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:07.470687 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-62fd00a0-7adb-4679-a310-88c9aef4eee3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:07.471129 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-62fd00a0-7adb-4679-a310-88c9aef4eee3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:07.471936 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-62fd00a0-7adb-4679-a310-88c9aef4eee3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:07.472338 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-62fd00a0-7adb-4679-a310-88c9aef4eee3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:07.502155 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-62fd00a0-7adb-4679-a310-88c9aef4eee3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049977 May 03 09:14:07.502690 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 631/1432] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:14:07 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:14:08.240720 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d9699dd4-65cf-4713-b98d-d5947adb71db tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:08.241327 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d9699dd4-65cf-4713-b98d-d5947adb71db tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:08.248060 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d9699dd4-65cf-4713-b98d-d5947adb71db tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:08.248527 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d9699dd4-65cf-4713-b98d-d5947adb71db tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:08.249290 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d9699dd4-65cf-4713-b98d-d5947adb71db tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:08.249712 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d9699dd4-65cf-4713-b98d-d5947adb71db tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:08.392411 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d9699dd4-65cf-4713-b98d-d5947adb71db tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:08.404104 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d9699dd4-65cf-4713-b98d-d5947adb71db tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:08.406591 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d9699dd4-65cf-4713-b98d-d5947adb71db tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:08.408129 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d9699dd4-65cf-4713-b98d-d5947adb71db tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.171317 May 03 09:14:08.408674 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 802/1433] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:14:08 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:14:08.517883 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b6dd253c-94c2-481d-9df5-028f23087c9d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:08.519268 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b6dd253c-94c2-481d-9df5-028f23087c9d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:08.530129 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b6dd253c-94c2-481d-9df5-028f23087c9d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:08.530872 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b6dd253c-94c2-481d-9df5-028f23087c9d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:08.532342 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b6dd253c-94c2-481d-9df5-028f23087c9d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:08.532778 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b6dd253c-94c2-481d-9df5-028f23087c9d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:08.562235 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b6dd253c-94c2-481d-9df5-028f23087c9d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051214 May 03 09:14:08.563120 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 632/1434] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:14:08 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:14:09.430790 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e30b7a5a-4c69-4403-91a9-ed5f5cbc3b84 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:09.431729 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e30b7a5a-4c69-4403-91a9-ed5f5cbc3b84 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:09.442355 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e30b7a5a-4c69-4403-91a9-ed5f5cbc3b84 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:09.443137 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e30b7a5a-4c69-4403-91a9-ed5f5cbc3b84 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:09.444451 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e30b7a5a-4c69-4403-91a9-ed5f5cbc3b84 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:09.445166 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e30b7a5a-4c69-4403-91a9-ed5f5cbc3b84 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:09.574913 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9d06ae92-6be7-4d10-9f76-d7d6a183eda8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:09.575913 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9d06ae92-6be7-4d10-9f76-d7d6a183eda8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:09.582432 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9d06ae92-6be7-4d10-9f76-d7d6a183eda8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:09.582883 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9d06ae92-6be7-4d10-9f76-d7d6a183eda8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:09.584017 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9d06ae92-6be7-4d10-9f76-d7d6a183eda8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:09.584456 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9d06ae92-6be7-4d10-9f76-d7d6a183eda8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:09.589606 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e30b7a5a-4c69-4403-91a9-ed5f5cbc3b84 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:09.598591 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e30b7a5a-4c69-4403-91a9-ed5f5cbc3b84 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:09.600115 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e30b7a5a-4c69-4403-91a9-ed5f5cbc3b84 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:09.601285 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e30b7a5a-4c69-4403-91a9-ed5f5cbc3b84 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.177251 May 03 09:14:09.609569 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 803/1435] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:14:09 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:14:09.615443 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9d06ae92-6be7-4d10-9f76-d7d6a183eda8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045100 May 03 09:14:09.616017 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 633/1436] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:14:09 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:14:10.623827 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-57f21c6d-5f09-42b5-895c-75c2151802f4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:10.624897 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-57f21c6d-5f09-42b5-895c-75c2151802f4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:10.629505 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a57def0f-56f6-4160-b04d-7e33f86f1ca1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:10.630469 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a57def0f-56f6-4160-b04d-7e33f86f1ca1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:10.632463 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-57f21c6d-5f09-42b5-895c-75c2151802f4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:10.632911 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-57f21c6d-5f09-42b5-895c-75c2151802f4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:10.633676 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-57f21c6d-5f09-42b5-895c-75c2151802f4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:10.634110 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-57f21c6d-5f09-42b5-895c-75c2151802f4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:10.637146 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a57def0f-56f6-4160-b04d-7e33f86f1ca1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:10.637599 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a57def0f-56f6-4160-b04d-7e33f86f1ca1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:10.638407 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a57def0f-56f6-4160-b04d-7e33f86f1ca1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:10.638843 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a57def0f-56f6-4160-b04d-7e33f86f1ca1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:10.668336 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a57def0f-56f6-4160-b04d-7e33f86f1ca1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044332 May 03 09:14:10.672153 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 634/1437] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:14:10 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:14:10.765222 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-57f21c6d-5f09-42b5-895c-75c2151802f4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:10.777065 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-57f21c6d-5f09-42b5-895c-75c2151802f4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:10.779249 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-57f21c6d-5f09-42b5-895c-75c2151802f4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:10.781068 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-57f21c6d-5f09-42b5-895c-75c2151802f4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.163516 May 03 09:14:10.782089 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 804/1438] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:14:10 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:14:11.683398 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-cf3adaf8-73b2-4f3e-ae89-f24edf148a98 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:11.685000 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-cf3adaf8-73b2-4f3e-ae89-f24edf148a98 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:11.695677 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cf3adaf8-73b2-4f3e-ae89-f24edf148a98 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:11.696486 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cf3adaf8-73b2-4f3e-ae89-f24edf148a98 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:11.697742 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cf3adaf8-73b2-4f3e-ae89-f24edf148a98 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:11.698478 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cf3adaf8-73b2-4f3e-ae89-f24edf148a98 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:11.732792 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-cf3adaf8-73b2-4f3e-ae89-f24edf148a98 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055979 May 03 09:14:11.733356 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 635/1439] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:14:11 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:14:11.800685 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-fd827470-b903-4043-b53a-796915f2b769 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:11.801297 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-fd827470-b903-4043-b53a-796915f2b769 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:11.808537 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fd827470-b903-4043-b53a-796915f2b769 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:11.808998 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fd827470-b903-4043-b53a-796915f2b769 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:11.809773 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fd827470-b903-4043-b53a-796915f2b769 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:11.810261 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fd827470-b903-4043-b53a-796915f2b769 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:11.952881 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-fd827470-b903-4043-b53a-796915f2b769 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:11.965789 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-fd827470-b903-4043-b53a-796915f2b769 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:11.968196 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-fd827470-b903-4043-b53a-796915f2b769 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:11.970422 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-fd827470-b903-4043-b53a-796915f2b769 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.173682 May 03 09:14:11.971283 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 805/1440] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:14:11 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:14:12.749133 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-3ec81c93-4410-46fc-b18e-49bcb76e217a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:12.750468 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-3ec81c93-4410-46fc-b18e-49bcb76e217a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:12.758453 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3ec81c93-4410-46fc-b18e-49bcb76e217a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:12.758875 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3ec81c93-4410-46fc-b18e-49bcb76e217a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:12.759630 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3ec81c93-4410-46fc-b18e-49bcb76e217a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:12.760093 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3ec81c93-4410-46fc-b18e-49bcb76e217a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:12.789060 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-3ec81c93-4410-46fc-b18e-49bcb76e217a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046900 May 03 09:14:12.789642 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 636/1441] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:14:12 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:14:12.993778 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a93f3991-7968-4779-90c8-067c47cf964d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:12.994803 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a93f3991-7968-4779-90c8-067c47cf964d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:13.005481 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a93f3991-7968-4779-90c8-067c47cf964d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:13.006278 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a93f3991-7968-4779-90c8-067c47cf964d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:13.007624 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a93f3991-7968-4779-90c8-067c47cf964d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:13.008370 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a93f3991-7968-4779-90c8-067c47cf964d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:13.144117 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a93f3991-7968-4779-90c8-067c47cf964d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:13.154759 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a93f3991-7968-4779-90c8-067c47cf964d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:13.157184 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a93f3991-7968-4779-90c8-067c47cf964d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:13.159205 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a93f3991-7968-4779-90c8-067c47cf964d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.172191 May 03 09:14:13.160009 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 806/1442] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:14:12 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:14:13.801109 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ddd8f8b5-e86f-4c8a-83a6-c138b917ae04 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:13.802028 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ddd8f8b5-e86f-4c8a-83a6-c138b917ae04 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:13.809109 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ddd8f8b5-e86f-4c8a-83a6-c138b917ae04 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:13.809523 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ddd8f8b5-e86f-4c8a-83a6-c138b917ae04 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:13.810320 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ddd8f8b5-e86f-4c8a-83a6-c138b917ae04 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:13.810750 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ddd8f8b5-e86f-4c8a-83a6-c138b917ae04 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:13.841419 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ddd8f8b5-e86f-4c8a-83a6-c138b917ae04 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044460 May 03 09:14:13.841975 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 637/1443] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:14:13 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:14:14.182500 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-2f9068f2-c258-4008-82b6-950acdd54efd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:14.183469 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-2f9068f2-c258-4008-82b6-950acdd54efd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:14.192868 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2f9068f2-c258-4008-82b6-950acdd54efd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:14.193316 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2f9068f2-c258-4008-82b6-950acdd54efd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:14.194090 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2f9068f2-c258-4008-82b6-950acdd54efd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:14.194517 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2f9068f2-c258-4008-82b6-950acdd54efd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:14.327910 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-2f9068f2-c258-4008-82b6-950acdd54efd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:14.336612 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-2f9068f2-c258-4008-82b6-950acdd54efd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:14.338115 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-2f9068f2-c258-4008-82b6-950acdd54efd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:14.339283 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-2f9068f2-c258-4008-82b6-950acdd54efd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.163646 May 03 09:14:14.339861 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 807/1444] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:14:14 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:14:14.858394 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-8c1c479b-546e-467d-b11a-bd78b4e31506 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:14.859720 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-8c1c479b-546e-467d-b11a-bd78b4e31506 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:14.867271 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8c1c479b-546e-467d-b11a-bd78b4e31506 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:14.867806 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8c1c479b-546e-467d-b11a-bd78b4e31506 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:14.868507 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8c1c479b-546e-467d-b11a-bd78b4e31506 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:14.868951 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8c1c479b-546e-467d-b11a-bd78b4e31506 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:14.898279 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-8c1c479b-546e-467d-b11a-bd78b4e31506 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046852 May 03 09:14:14.898844 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 638/1445] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:14:14 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:14:15.362247 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-270cdc0a-00e5-4f5d-96a9-e488217cd830 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:15.362887 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-270cdc0a-00e5-4f5d-96a9-e488217cd830 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:15.369476 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-270cdc0a-00e5-4f5d-96a9-e488217cd830 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:15.369925 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-270cdc0a-00e5-4f5d-96a9-e488217cd830 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:15.370695 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-270cdc0a-00e5-4f5d-96a9-e488217cd830 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:15.371130 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-270cdc0a-00e5-4f5d-96a9-e488217cd830 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:15.509364 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-270cdc0a-00e5-4f5d-96a9-e488217cd830 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:15.518314 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-270cdc0a-00e5-4f5d-96a9-e488217cd830 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:15.519812 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-270cdc0a-00e5-4f5d-96a9-e488217cd830 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:15.521024 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-270cdc0a-00e5-4f5d-96a9-e488217cd830 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.165497 May 03 09:14:15.521604 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 808/1446] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:14:15 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:14:15.914411 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-78bde842-041d-4c8d-bfef-eb8b7ab7f126 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:15.915948 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-78bde842-041d-4c8d-bfef-eb8b7ab7f126 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:15.926399 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-78bde842-041d-4c8d-bfef-eb8b7ab7f126 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:15.927155 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-78bde842-041d-4c8d-bfef-eb8b7ab7f126 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:15.928439 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-78bde842-041d-4c8d-bfef-eb8b7ab7f126 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:15.929172 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-78bde842-041d-4c8d-bfef-eb8b7ab7f126 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:15.964184 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-78bde842-041d-4c8d-bfef-eb8b7ab7f126 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056366 May 03 09:14:15.964729 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 639/1447] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:14:15 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:14:16.545413 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9ba28022-17e6-45b9-9a5a-1e29dadc4126 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:16.546023 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9ba28022-17e6-45b9-9a5a-1e29dadc4126 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:16.552859 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9ba28022-17e6-45b9-9a5a-1e29dadc4126 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:16.553307 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9ba28022-17e6-45b9-9a5a-1e29dadc4126 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:16.554080 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9ba28022-17e6-45b9-9a5a-1e29dadc4126 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:16.554513 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9ba28022-17e6-45b9-9a5a-1e29dadc4126 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:16.690058 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9ba28022-17e6-45b9-9a5a-1e29dadc4126 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:16.698368 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9ba28022-17e6-45b9-9a5a-1e29dadc4126 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:16.699891 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9ba28022-17e6-45b9-9a5a-1e29dadc4126 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:16.701045 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9ba28022-17e6-45b9-9a5a-1e29dadc4126 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.159625 May 03 09:14:16.701641 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 809/1448] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:14:16 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:14:16.980604 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-37443b9f-710a-49cb-9692-3f721005a15c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:16.982159 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-37443b9f-710a-49cb-9692-3f721005a15c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:16.992149 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-37443b9f-710a-49cb-9692-3f721005a15c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:16.992593 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-37443b9f-710a-49cb-9692-3f721005a15c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:16.993368 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-37443b9f-710a-49cb-9692-3f721005a15c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:16.993806 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-37443b9f-710a-49cb-9692-3f721005a15c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:17.022737 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-37443b9f-710a-49cb-9692-3f721005a15c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048866 May 03 09:14:17.023295 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 640/1449] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:14:16 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:14:17.723829 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a6f0038d-cb84-4f90-8dd5-c823b87ff3ab tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:17.724668 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a6f0038d-cb84-4f90-8dd5-c823b87ff3ab tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:17.735360 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a6f0038d-cb84-4f90-8dd5-c823b87ff3ab tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:17.736165 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a6f0038d-cb84-4f90-8dd5-c823b87ff3ab tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:17.737425 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a6f0038d-cb84-4f90-8dd5-c823b87ff3ab tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:17.738141 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a6f0038d-cb84-4f90-8dd5-c823b87ff3ab tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:17.881871 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a6f0038d-cb84-4f90-8dd5-c823b87ff3ab tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:17.890812 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a6f0038d-cb84-4f90-8dd5-c823b87ff3ab tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:17.892382 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a6f0038d-cb84-4f90-8dd5-c823b87ff3ab tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:17.893553 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a6f0038d-cb84-4f90-8dd5-c823b87ff3ab tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.176701 May 03 09:14:17.894117 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 810/1450] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:14:17 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:14:18.038753 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a0d42bac-a140-477d-a715-edf643b8a54e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:18.040227 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a0d42bac-a140-477d-a715-edf643b8a54e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:18.050948 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a0d42bac-a140-477d-a715-edf643b8a54e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:18.051709 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a0d42bac-a140-477d-a715-edf643b8a54e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:18.053021 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a0d42bac-a140-477d-a715-edf643b8a54e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:18.053729 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a0d42bac-a140-477d-a715-edf643b8a54e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:18.090462 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a0d42bac-a140-477d-a715-edf643b8a54e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058784 May 03 09:14:18.091033 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 641/1451] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:14:18 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:14:18.916128 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a53fc14d-e181-4e7c-9423-505cb0e9c5a6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:18.917067 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a53fc14d-e181-4e7c-9423-505cb0e9c5a6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:18.928378 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a53fc14d-e181-4e7c-9423-505cb0e9c5a6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:18.929126 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a53fc14d-e181-4e7c-9423-505cb0e9c5a6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:18.930371 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a53fc14d-e181-4e7c-9423-505cb0e9c5a6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:18.931085 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a53fc14d-e181-4e7c-9423-505cb0e9c5a6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:19.075323 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a53fc14d-e181-4e7c-9423-505cb0e9c5a6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:19.084581 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a53fc14d-e181-4e7c-9423-505cb0e9c5a6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:19.086296 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a53fc14d-e181-4e7c-9423-505cb0e9c5a6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:19.087463 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a53fc14d-e181-4e7c-9423-505cb0e9c5a6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.177958 May 03 09:14:19.088015 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 811/1452] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:14:18 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:14:19.102004 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f7e4f365-434a-4037-885c-fa537e8294da tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:19.102931 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f7e4f365-434a-4037-885c-fa537e8294da tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:19.109283 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f7e4f365-434a-4037-885c-fa537e8294da tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:19.109728 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f7e4f365-434a-4037-885c-fa537e8294da tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:19.110479 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f7e4f365-434a-4037-885c-fa537e8294da tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:19.110896 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f7e4f365-434a-4037-885c-fa537e8294da tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:19.140559 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f7e4f365-434a-4037-885c-fa537e8294da tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042564 May 03 09:14:19.141354 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 642/1453] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:14:19 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:14:20.111069 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-102f4858-8355-42da-ab8e-ac9bc5a68130 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:20.112094 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-102f4858-8355-42da-ab8e-ac9bc5a68130 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:20.120059 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-102f4858-8355-42da-ab8e-ac9bc5a68130 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:20.120507 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-102f4858-8355-42da-ab8e-ac9bc5a68130 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:20.121278 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-102f4858-8355-42da-ab8e-ac9bc5a68130 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:20.121710 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-102f4858-8355-42da-ab8e-ac9bc5a68130 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:20.152942 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-cadc1c96-4436-4dd4-9c5c-02a24a37aa66 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:20.153933 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-cadc1c96-4436-4dd4-9c5c-02a24a37aa66 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:20.160965 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cadc1c96-4436-4dd4-9c5c-02a24a37aa66 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:20.161718 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cadc1c96-4436-4dd4-9c5c-02a24a37aa66 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:20.162509 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cadc1c96-4436-4dd4-9c5c-02a24a37aa66 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:20.162929 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cadc1c96-4436-4dd4-9c5c-02a24a37aa66 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:20.193058 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-cadc1c96-4436-4dd4-9c5c-02a24a37aa66 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044085 May 03 09:14:20.193619 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 643/1454] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:14:20 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:14:20.256743 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-102f4858-8355-42da-ab8e-ac9bc5a68130 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:20.264876 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-102f4858-8355-42da-ab8e-ac9bc5a68130 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:20.266356 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-102f4858-8355-42da-ab8e-ac9bc5a68130 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:20.267680 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-102f4858-8355-42da-ab8e-ac9bc5a68130 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.163416 May 03 09:14:20.268270 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 812/1455] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:14:20 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:14:21.208882 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-3ebddba0-eef5-42ef-a6ec-847cd07729d7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:21.210442 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-3ebddba0-eef5-42ef-a6ec-847cd07729d7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:21.217152 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3ebddba0-eef5-42ef-a6ec-847cd07729d7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:21.217601 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3ebddba0-eef5-42ef-a6ec-847cd07729d7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:21.218378 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3ebddba0-eef5-42ef-a6ec-847cd07729d7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:21.218818 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3ebddba0-eef5-42ef-a6ec-847cd07729d7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:21.251175 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-3ebddba0-eef5-42ef-a6ec-847cd07729d7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049644 May 03 09:14:21.251736 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 644/1456] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:14:21 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:14:21.286234 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-6752aaa7-51d7-4958-8db6-7820502f697c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:21.287055 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-6752aaa7-51d7-4958-8db6-7820502f697c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:21.293460 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6752aaa7-51d7-4958-8db6-7820502f697c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:21.293910 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6752aaa7-51d7-4958-8db6-7820502f697c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:21.294648 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6752aaa7-51d7-4958-8db6-7820502f697c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:21.295089 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6752aaa7-51d7-4958-8db6-7820502f697c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:21.425298 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-6752aaa7-51d7-4958-8db6-7820502f697c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:21.434406 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-6752aaa7-51d7-4958-8db6-7820502f697c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:21.435934 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-6752aaa7-51d7-4958-8db6-7820502f697c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:21.437109 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-6752aaa7-51d7-4958-8db6-7820502f697c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.154850 May 03 09:14:21.437643 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 813/1457] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:14:21 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:14:22.266635 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6d83d6fc-50a7-4998-b579-011443394d07 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:22.267575 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6d83d6fc-50a7-4998-b579-011443394d07 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:22.276026 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6d83d6fc-50a7-4998-b579-011443394d07 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:22.276533 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6d83d6fc-50a7-4998-b579-011443394d07 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:22.277346 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6d83d6fc-50a7-4998-b579-011443394d07 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:22.277749 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6d83d6fc-50a7-4998-b579-011443394d07 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:22.318203 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6d83d6fc-50a7-4998-b579-011443394d07 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057489 May 03 09:14:22.322572 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 645/1458] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:14:22 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:14:22.458986 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-76359ce3-b3d9-4b93-8227-31caafda8e7b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:22.459607 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-76359ce3-b3d9-4b93-8227-31caafda8e7b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:22.466578 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-76359ce3-b3d9-4b93-8227-31caafda8e7b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:22.466926 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-76359ce3-b3d9-4b93-8227-31caafda8e7b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:22.467701 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-76359ce3-b3d9-4b93-8227-31caafda8e7b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:22.468180 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-76359ce3-b3d9-4b93-8227-31caafda8e7b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:22.607154 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-76359ce3-b3d9-4b93-8227-31caafda8e7b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:22.615862 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-76359ce3-b3d9-4b93-8227-31caafda8e7b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:22.617392 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-76359ce3-b3d9-4b93-8227-31caafda8e7b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:22.618575 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-76359ce3-b3d9-4b93-8227-31caafda8e7b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.166124 May 03 09:14:22.619145 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 814/1459] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:14:22 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:14:23.333512 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2ceb4325-cd4f-49b7-8abc-a118d1a2b5e0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:23.334577 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-2ceb4325-cd4f-49b7-8abc-a118d1a2b5e0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:23.342123 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2ceb4325-cd4f-49b7-8abc-a118d1a2b5e0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:23.342622 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2ceb4325-cd4f-49b7-8abc-a118d1a2b5e0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:23.343496 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2ceb4325-cd4f-49b7-8abc-a118d1a2b5e0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:23.344053 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2ceb4325-cd4f-49b7-8abc-a118d1a2b5e0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:23.374046 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-2ceb4325-cd4f-49b7-8abc-a118d1a2b5e0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046957 May 03 09:14:23.374576 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 646/1460] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:14:23 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:14:23.640670 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ba65bab9-c914-46b1-821f-2b34d981a69f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:23.641693 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ba65bab9-c914-46b1-821f-2b34d981a69f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:23.652684 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ba65bab9-c914-46b1-821f-2b34d981a69f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:23.653389 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ba65bab9-c914-46b1-821f-2b34d981a69f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:23.654646 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ba65bab9-c914-46b1-821f-2b34d981a69f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:23.655356 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ba65bab9-c914-46b1-821f-2b34d981a69f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:23.787652 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ba65bab9-c914-46b1-821f-2b34d981a69f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:23.796040 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ba65bab9-c914-46b1-821f-2b34d981a69f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:23.797553 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ba65bab9-c914-46b1-821f-2b34d981a69f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:23.798755 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ba65bab9-c914-46b1-821f-2b34d981a69f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.164813 May 03 09:14:23.799321 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 815/1461] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:14:23 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:14:24.390619 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-eea1eb9f-b29a-422e-bb68-3102be4fb1bc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:24.392245 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-eea1eb9f-b29a-422e-bb68-3102be4fb1bc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:24.402433 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-eea1eb9f-b29a-422e-bb68-3102be4fb1bc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:24.403215 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-eea1eb9f-b29a-422e-bb68-3102be4fb1bc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:24.404535 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-eea1eb9f-b29a-422e-bb68-3102be4fb1bc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:24.405264 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-eea1eb9f-b29a-422e-bb68-3102be4fb1bc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:24.437521 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-eea1eb9f-b29a-422e-bb68-3102be4fb1bc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053718 May 03 09:14:24.437917 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 647/1462] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:14:24 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:14:24.821966 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e6f47a0b-92b3-4b18-b02c-3f9d4e0aef8b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:24.822979 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e6f47a0b-92b3-4b18-b02c-3f9d4e0aef8b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:24.833813 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e6f47a0b-92b3-4b18-b02c-3f9d4e0aef8b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:24.834266 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e6f47a0b-92b3-4b18-b02c-3f9d4e0aef8b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:24.835048 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e6f47a0b-92b3-4b18-b02c-3f9d4e0aef8b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:24.835483 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e6f47a0b-92b3-4b18-b02c-3f9d4e0aef8b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:24.981619 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e6f47a0b-92b3-4b18-b02c-3f9d4e0aef8b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:24.990039 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e6f47a0b-92b3-4b18-b02c-3f9d4e0aef8b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:24.991578 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e6f47a0b-92b3-4b18-b02c-3f9d4e0aef8b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:24.992783 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e6f47a0b-92b3-4b18-b02c-3f9d4e0aef8b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.177644 May 03 09:14:24.993350 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 816/1463] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:14:24 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:14:25.450556 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-95f98aea-4a24-4a6f-ba7a-8264d0af9588 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:14:25.451498 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-95f98aea-4a24-4a6f-ba7a-8264d0af9588 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:25.458852 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-95f98aea-4a24-4a6f-ba7a-8264d0af9588 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:25.459258 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-95f98aea-4a24-4a6f-ba7a-8264d0af9588 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:25.460093 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-95f98aea-4a24-4a6f-ba7a-8264d0af9588 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:25.460530 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-95f98aea-4a24-4a6f-ba7a-8264d0af9588 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:25.539485 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-95f98aea-4a24-4a6f-ba7a-8264d0af9588 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "POST /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/action" status: 200 len: 77081 microversion: 2.1 time: 0.092732 May 03 09:14:25.540212 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 648/1464] 10.222.0.11 () {60 vars in 1277 bytes} [Tue May 3 09:14:25 2022] POST /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2/action => generated 77081 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:14:25.675232 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-07cfa69f-e5c5-4332-af17-97bdb3dc5ed7 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] Calling method '.version_select at 0x7f09ce6740d0>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:25.698000 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-07cfa69f-e5c5-4332-af17-97bdb3dc5ed7 tempest-TestVolumeBootPattern-1335234347 tempest-TestVolumeBootPattern-1335234347-project] 10.222.0.11 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1090483213" status: 202 len: 0 microversion: 2.1 time: 0.026675 May 03 09:14:25.698601 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 817/1465] 10.222.0.11 () {58 vars in 1262 bytes} [Tue May 3 09:14:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1090483213 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 09:14:26.011515 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-edde87cb-c5f1-4c82-81e1-1f9c98cdff93 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:26.012594 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-edde87cb-c5f1-4c82-81e1-1f9c98cdff93 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:26.021788 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-edde87cb-c5f1-4c82-81e1-1f9c98cdff93 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:26.022519 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-edde87cb-c5f1-4c82-81e1-1f9c98cdff93 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:26.023548 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-edde87cb-c5f1-4c82-81e1-1f9c98cdff93 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:26.024258 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-edde87cb-c5f1-4c82-81e1-1f9c98cdff93 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:26.025032 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9fc5acf7-bc3b-4dbc-9830-cbf858b4845a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:26.025537 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9fc5acf7-bc3b-4dbc-9830-cbf858b4845a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:26.032201 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9fc5acf7-bc3b-4dbc-9830-cbf858b4845a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:26.032661 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9fc5acf7-bc3b-4dbc-9830-cbf858b4845a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:26.033449 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9fc5acf7-bc3b-4dbc-9830-cbf858b4845a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:26.033902 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9fc5acf7-bc3b-4dbc-9830-cbf858b4845a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:26.066581 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9fc5acf7-bc3b-4dbc-9830-cbf858b4845a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Going to try to terminate instance {{(pid=123391) delete /opt/stack/nova/nova/compute/api.py:2664}} May 03 09:14:26.160720 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9fc5acf7-bc3b-4dbc-9830-cbf858b4845a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "DELETE /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 204 len: 0 microversion: 2.1 time: 0.138435 May 03 09:14:26.161324 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 818/1466] 10.222.0.11 () {58 vars in 1238 bytes} [Tue May 3 09:14:26 2022] DELETE /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 03 09:14:26.171181 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-28d13550-0a63-4484-95f0-b5ca31c5a904 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:26.171921 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-28d13550-0a63-4484-95f0-b5ca31c5a904 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:26.177993 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-28d13550-0a63-4484-95f0-b5ca31c5a904 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:26.178439 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-28d13550-0a63-4484-95f0-b5ca31c5a904 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:26.179226 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-28d13550-0a63-4484-95f0-b5ca31c5a904 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:26.179661 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-28d13550-0a63-4484-95f0-b5ca31c5a904 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:26.273205 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-edde87cb-c5f1-4c82-81e1-1f9c98cdff93 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:26.281776 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-edde87cb-c5f1-4c82-81e1-1f9c98cdff93 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:26.283575 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-edde87cb-c5f1-4c82-81e1-1f9c98cdff93 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:26.284835 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-edde87cb-c5f1-4c82-81e1-1f9c98cdff93 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.277881 May 03 09:14:26.285564 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 649/1467] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:14:26 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:14:26.331483 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-28d13550-0a63-4484-95f0-b5ca31c5a904 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:26.339603 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-28d13550-0a63-4484-95f0-b5ca31c5a904 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.172994 May 03 09:14:26.340205 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 819/1468] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:14:26 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:14:27.302857 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-8b69d48c-c448-46bf-a72b-ac77feb545c6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:27.303435 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-8b69d48c-c448-46bf-a72b-ac77feb545c6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:27.320010 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8b69d48c-c448-46bf-a72b-ac77feb545c6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:27.320991 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8b69d48c-c448-46bf-a72b-ac77feb545c6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:27.322035 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8b69d48c-c448-46bf-a72b-ac77feb545c6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:27.322613 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8b69d48c-c448-46bf-a72b-ac77feb545c6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:27.358246 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-451b7d98-e46c-42f1-8dec-cb8791a358fb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:27.359508 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-451b7d98-e46c-42f1-8dec-cb8791a358fb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:27.374084 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-451b7d98-e46c-42f1-8dec-cb8791a358fb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:27.374862 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-451b7d98-e46c-42f1-8dec-cb8791a358fb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:27.375890 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-451b7d98-e46c-42f1-8dec-cb8791a358fb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:27.377142 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-451b7d98-e46c-42f1-8dec-cb8791a358fb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:27.513324 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-8b69d48c-c448-46bf-a72b-ac77feb545c6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:27.522595 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-8b69d48c-c448-46bf-a72b-ac77feb545c6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:27.524109 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-8b69d48c-c448-46bf-a72b-ac77feb545c6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:27.525248 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-8b69d48c-c448-46bf-a72b-ac77feb545c6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.226511 May 03 09:14:27.525970 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 650/1469] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:14:27 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:14:27.544167 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-451b7d98-e46c-42f1-8dec-cb8791a358fb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:27.555572 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-451b7d98-e46c-42f1-8dec-cb8791a358fb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.201265 May 03 09:14:27.556225 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 820/1470] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:14:27 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:14:28.544352 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c57bbd5a-adfd-455a-9556-800f43a92613 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:28.545651 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c57bbd5a-adfd-455a-9556-800f43a92613 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:28.562878 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c57bbd5a-adfd-455a-9556-800f43a92613 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:28.563585 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c57bbd5a-adfd-455a-9556-800f43a92613 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:28.564597 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c57bbd5a-adfd-455a-9556-800f43a92613 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:28.565182 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c57bbd5a-adfd-455a-9556-800f43a92613 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:28.573181 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-39e1156d-581e-4eb2-a2da-333b4c1a24d8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:28.575144 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-39e1156d-581e-4eb2-a2da-333b4c1a24d8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:28.585484 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-39e1156d-581e-4eb2-a2da-333b4c1a24d8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:28.586309 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-39e1156d-581e-4eb2-a2da-333b4c1a24d8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:28.588045 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-39e1156d-581e-4eb2-a2da-333b4c1a24d8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:28.588703 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-39e1156d-581e-4eb2-a2da-333b4c1a24d8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:28.905205 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c57bbd5a-adfd-455a-9556-800f43a92613 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:28.911109 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-39e1156d-581e-4eb2-a2da-333b4c1a24d8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:28.914209 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c57bbd5a-adfd-455a-9556-800f43a92613 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:28.915829 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c57bbd5a-adfd-455a-9556-800f43a92613 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:28.917159 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c57bbd5a-adfd-455a-9556-800f43a92613 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.376783 May 03 09:14:28.924462 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 651/1471] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:14:28 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:14:28.924649 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-39e1156d-581e-4eb2-a2da-333b4c1a24d8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.350939 May 03 09:14:28.924649 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 821/1472] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:14:28 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:14:29.934935 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-22410dec-a596-4ac1-a06d-738ff8e3840f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:29.935706 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-22410dec-a596-4ac1-a06d-738ff8e3840f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:29.936997 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9bedee7c-42b2-426b-92e7-47be72bc55f2 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:29.937606 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9bedee7c-42b2-426b-92e7-47be72bc55f2 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:29.942620 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-22410dec-a596-4ac1-a06d-738ff8e3840f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:29.943152 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-22410dec-a596-4ac1-a06d-738ff8e3840f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:29.944196 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-22410dec-a596-4ac1-a06d-738ff8e3840f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:29.944694 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-22410dec-a596-4ac1-a06d-738ff8e3840f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:29.945129 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9bedee7c-42b2-426b-92e7-47be72bc55f2 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:29.945555 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9bedee7c-42b2-426b-92e7-47be72bc55f2 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:29.946513 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9bedee7c-42b2-426b-92e7-47be72bc55f2 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:29.946937 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9bedee7c-42b2-426b-92e7-47be72bc55f2 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:30.271079 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-22410dec-a596-4ac1-a06d-738ff8e3840f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:30.277643 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9bedee7c-42b2-426b-92e7-47be72bc55f2 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:30.279991 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-22410dec-a596-4ac1-a06d-738ff8e3840f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:30.281692 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-22410dec-a596-4ac1-a06d-738ff8e3840f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:30.282893 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-22410dec-a596-4ac1-a06d-738ff8e3840f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.352101 May 03 09:14:30.283456 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 652/1473] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:14:29 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:14:30.288237 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9bedee7c-42b2-426b-92e7-47be72bc55f2 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.354932 May 03 09:14:30.297844 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 822/1474] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:14:29 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:14:31.303699 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a3f43ffe-974b-48d6-ba0e-0d019d95ab4b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:31.305083 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a3f43ffe-974b-48d6-ba0e-0d019d95ab4b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:31.305337 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-2516e3ea-c5cf-418c-88b5-b0d465ab51cd tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:31.306521 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-2516e3ea-c5cf-418c-88b5-b0d465ab51cd tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:31.312901 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2516e3ea-c5cf-418c-88b5-b0d465ab51cd tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:31.313108 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a3f43ffe-974b-48d6-ba0e-0d019d95ab4b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:31.313413 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a3f43ffe-974b-48d6-ba0e-0d019d95ab4b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:31.313738 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2516e3ea-c5cf-418c-88b5-b0d465ab51cd tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:31.314183 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a3f43ffe-974b-48d6-ba0e-0d019d95ab4b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:31.314614 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a3f43ffe-974b-48d6-ba0e-0d019d95ab4b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:31.314735 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2516e3ea-c5cf-418c-88b5-b0d465ab51cd tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:31.315114 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2516e3ea-c5cf-418c-88b5-b0d465ab51cd tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:31.604953 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-2516e3ea-c5cf-418c-88b5-b0d465ab51cd tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:31.606362 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a3f43ffe-974b-48d6-ba0e-0d019d95ab4b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:31.613916 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-2516e3ea-c5cf-418c-88b5-b0d465ab51cd tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.312705 May 03 09:14:31.616179 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a3f43ffe-974b-48d6-ba0e-0d019d95ab4b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:31.618134 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a3f43ffe-974b-48d6-ba0e-0d019d95ab4b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:31.620203 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a3f43ffe-974b-48d6-ba0e-0d019d95ab4b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.321349 May 03 09:14:31.621521 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 653/1475] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:14:31 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:14:31.624420 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 823/1476] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:14:31 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:14:32.630861 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e48d99a5-e09f-40b7-aafc-2acd05a8c6f4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:32.632142 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e48d99a5-e09f-40b7-aafc-2acd05a8c6f4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:32.641653 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e48d99a5-e09f-40b7-aafc-2acd05a8c6f4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:32.642189 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e48d99a5-e09f-40b7-aafc-2acd05a8c6f4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:32.643062 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e48d99a5-e09f-40b7-aafc-2acd05a8c6f4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:32.643571 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e48d99a5-e09f-40b7-aafc-2acd05a8c6f4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:32.643714 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-36c835ac-3a34-4526-82ff-38fa515ba1bb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:32.644938 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-36c835ac-3a34-4526-82ff-38fa515ba1bb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:32.655365 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-36c835ac-3a34-4526-82ff-38fa515ba1bb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:32.655849 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-36c835ac-3a34-4526-82ff-38fa515ba1bb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:32.656639 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-36c835ac-3a34-4526-82ff-38fa515ba1bb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:32.657069 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-36c835ac-3a34-4526-82ff-38fa515ba1bb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:32.873148 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e48d99a5-e09f-40b7-aafc-2acd05a8c6f4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:32.881374 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e48d99a5-e09f-40b7-aafc-2acd05a8c6f4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.254558 May 03 09:14:32.892029 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 654/1477] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:14:32 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:14:32.919439 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-36c835ac-3a34-4526-82ff-38fa515ba1bb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:32.941082 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-36c835ac-3a34-4526-82ff-38fa515ba1bb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:32.943583 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-36c835ac-3a34-4526-82ff-38fa515ba1bb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:32.945145 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-36c835ac-3a34-4526-82ff-38fa515ba1bb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.308769 May 03 09:14:32.945889 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 824/1478] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:14:32 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:14:33.898952 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-42c4b838-37db-44f3-8d80-728af482e2d9 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:33.899570 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-42c4b838-37db-44f3-8d80-728af482e2d9 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:33.906261 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-42c4b838-37db-44f3-8d80-728af482e2d9 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:33.906724 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-42c4b838-37db-44f3-8d80-728af482e2d9 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:33.907493 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-42c4b838-37db-44f3-8d80-728af482e2d9 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:33.907960 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-42c4b838-37db-44f3-8d80-728af482e2d9 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:33.963808 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5a580cf1-0ddf-4d2a-be1e-40cb11817862 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:33.964372 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5a580cf1-0ddf-4d2a-be1e-40cb11817862 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:33.971192 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5a580cf1-0ddf-4d2a-be1e-40cb11817862 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:33.972041 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5a580cf1-0ddf-4d2a-be1e-40cb11817862 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:33.972766 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5a580cf1-0ddf-4d2a-be1e-40cb11817862 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:33.973421 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5a580cf1-0ddf-4d2a-be1e-40cb11817862 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:34.084991 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-42c4b838-37db-44f3-8d80-728af482e2d9 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:34.093131 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-42c4b838-37db-44f3-8d80-728af482e2d9 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.198320 May 03 09:14:34.093749 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 655/1479] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:14:33 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:14:34.130560 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5a580cf1-0ddf-4d2a-be1e-40cb11817862 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:34.138813 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5a580cf1-0ddf-4d2a-be1e-40cb11817862 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:34.140343 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5a580cf1-0ddf-4d2a-be1e-40cb11817862 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:34.141547 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5a580cf1-0ddf-4d2a-be1e-40cb11817862 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.181728 May 03 09:14:34.142433 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 825/1480] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:14:33 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 09:14:35.110661 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-90fd9551-e56c-4296-872d-a37235ccb423 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:35.111286 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-90fd9551-e56c-4296-872d-a37235ccb423 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:35.118344 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-90fd9551-e56c-4296-872d-a37235ccb423 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:35.118788 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-90fd9551-e56c-4296-872d-a37235ccb423 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:35.119577 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-90fd9551-e56c-4296-872d-a37235ccb423 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:35.120047 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-90fd9551-e56c-4296-872d-a37235ccb423 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:35.162992 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-afac888c-e0bd-4b81-b715-7c345167f9cc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:35.163675 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-afac888c-e0bd-4b81-b715-7c345167f9cc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:35.170682 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-afac888c-e0bd-4b81-b715-7c345167f9cc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:35.171138 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-afac888c-e0bd-4b81-b715-7c345167f9cc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:35.171955 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-afac888c-e0bd-4b81-b715-7c345167f9cc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:35.172384 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-afac888c-e0bd-4b81-b715-7c345167f9cc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:35.302250 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-90fd9551-e56c-4296-872d-a37235ccb423 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:35.310413 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-90fd9551-e56c-4296-872d-a37235ccb423 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.203675 May 03 09:14:35.310980 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 656/1481] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:14:35 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:14:35.330842 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-afac888c-e0bd-4b81-b715-7c345167f9cc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:35.339687 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-afac888c-e0bd-4b81-b715-7c345167f9cc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:35.341220 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-afac888c-e0bd-4b81-b715-7c345167f9cc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:35.342395 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-afac888c-e0bd-4b81-b715-7c345167f9cc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.186317 May 03 09:14:35.342990 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 826/1482] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:14:35 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:14:36.327015 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-cee00aa9-1763-4318-8ede-544954be3f1c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:36.327634 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-cee00aa9-1763-4318-8ede-544954be3f1c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:36.334246 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cee00aa9-1763-4318-8ede-544954be3f1c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:36.334689 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cee00aa9-1763-4318-8ede-544954be3f1c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:36.335448 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cee00aa9-1763-4318-8ede-544954be3f1c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:36.335906 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cee00aa9-1763-4318-8ede-544954be3f1c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:36.361174 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-66109642-a593-42bc-bf67-3f557a62859d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:36.361732 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-66109642-a593-42bc-bf67-3f557a62859d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:36.368472 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-66109642-a593-42bc-bf67-3f557a62859d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:36.368923 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-66109642-a593-42bc-bf67-3f557a62859d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:36.369694 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-66109642-a593-42bc-bf67-3f557a62859d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:36.370827 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-66109642-a593-42bc-bf67-3f557a62859d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:36.515042 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-cee00aa9-1763-4318-8ede-544954be3f1c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:36.523278 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-cee00aa9-1763-4318-8ede-544954be3f1c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.200202 May 03 09:14:36.523842 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 657/1483] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:14:36 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:14:36.540650 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-66109642-a593-42bc-bf67-3f557a62859d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:36.549434 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-66109642-a593-42bc-bf67-3f557a62859d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:36.550973 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-66109642-a593-42bc-bf67-3f557a62859d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:36.552150 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-66109642-a593-42bc-bf67-3f557a62859d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.194916 May 03 09:14:36.552701 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 827/1484] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:14:36 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:14:37.543733 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d3a03016-2a33-42bf-800c-a1e691ed073f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:37.544481 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d3a03016-2a33-42bf-800c-a1e691ed073f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:37.553480 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d3a03016-2a33-42bf-800c-a1e691ed073f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:37.553920 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d3a03016-2a33-42bf-800c-a1e691ed073f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:37.554675 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d3a03016-2a33-42bf-800c-a1e691ed073f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:37.555098 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d3a03016-2a33-42bf-800c-a1e691ed073f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:37.570740 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c4a20fd5-a261-4d90-af77-58e815eede92 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:37.571367 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c4a20fd5-a261-4d90-af77-58e815eede92 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:37.578186 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c4a20fd5-a261-4d90-af77-58e815eede92 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:37.578638 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c4a20fd5-a261-4d90-af77-58e815eede92 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:37.579412 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c4a20fd5-a261-4d90-af77-58e815eede92 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:37.579873 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c4a20fd5-a261-4d90-af77-58e815eede92 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:37.740320 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d3a03016-2a33-42bf-800c-a1e691ed073f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:37.748911 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d3a03016-2a33-42bf-800c-a1e691ed073f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.211094 May 03 09:14:37.749488 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 658/1485] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:14:37 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:14:37.754506 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c4a20fd5-a261-4d90-af77-58e815eede92 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:37.765635 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c4a20fd5-a261-4d90-af77-58e815eede92 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:37.767121 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c4a20fd5-a261-4d90-af77-58e815eede92 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:37.768475 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c4a20fd5-a261-4d90-af77-58e815eede92 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.201811 May 03 09:14:37.769026 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 828/1486] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:14:37 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:14:38.765903 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-bc932e10-8238-40d0-a7d9-94b098947838 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:38.767171 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-bc932e10-8238-40d0-a7d9-94b098947838 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:38.774090 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bc932e10-8238-40d0-a7d9-94b098947838 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:38.774555 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bc932e10-8238-40d0-a7d9-94b098947838 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:38.775353 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bc932e10-8238-40d0-a7d9-94b098947838 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:38.776580 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bc932e10-8238-40d0-a7d9-94b098947838 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:38.790365 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-cddd86e5-6278-483b-90f6-74768a2fe9fc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:38.790963 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-cddd86e5-6278-483b-90f6-74768a2fe9fc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:38.798875 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cddd86e5-6278-483b-90f6-74768a2fe9fc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:38.798875 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cddd86e5-6278-483b-90f6-74768a2fe9fc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:38.799127 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cddd86e5-6278-483b-90f6-74768a2fe9fc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:38.799759 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cddd86e5-6278-483b-90f6-74768a2fe9fc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:38.970649 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-bc932e10-8238-40d0-a7d9-94b098947838 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:38.979040 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-bc932e10-8238-40d0-a7d9-94b098947838 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.217199 May 03 09:14:38.979619 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 659/1487] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:14:38 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:14:38.981778 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-cddd86e5-6278-483b-90f6-74768a2fe9fc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:38.992126 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-cddd86e5-6278-483b-90f6-74768a2fe9fc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:38.993620 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-cddd86e5-6278-483b-90f6-74768a2fe9fc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:38.994818 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-cddd86e5-6278-483b-90f6-74768a2fe9fc tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.208584 May 03 09:14:38.995388 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 829/1488] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:14:38 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:14:40.000519 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a6bd627d-1125-40ac-9433-1cf95a869a04 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:40.001544 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a6bd627d-1125-40ac-9433-1cf95a869a04 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:40.010383 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a6bd627d-1125-40ac-9433-1cf95a869a04 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:40.010868 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a6bd627d-1125-40ac-9433-1cf95a869a04 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:40.011626 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a6bd627d-1125-40ac-9433-1cf95a869a04 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:40.012088 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a6bd627d-1125-40ac-9433-1cf95a869a04 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:40.013568 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-92d21987-b022-40e7-9aa9-d4790f715d09 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:40.014222 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-92d21987-b022-40e7-9aa9-d4790f715d09 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:40.020896 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-92d21987-b022-40e7-9aa9-d4790f715d09 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:40.021332 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-92d21987-b022-40e7-9aa9-d4790f715d09 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:40.022096 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-92d21987-b022-40e7-9aa9-d4790f715d09 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:40.022558 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-92d21987-b022-40e7-9aa9-d4790f715d09 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:40.207634 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a6bd627d-1125-40ac-9433-1cf95a869a04 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:40.213813 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-92d21987-b022-40e7-9aa9-d4790f715d09 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:40.215667 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a6bd627d-1125-40ac-9433-1cf95a869a04 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.221663 May 03 09:14:40.216315 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 660/1489] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:14:39 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:14:40.223073 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-92d21987-b022-40e7-9aa9-d4790f715d09 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:40.224616 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-92d21987-b022-40e7-9aa9-d4790f715d09 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:40.225841 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-92d21987-b022-40e7-9aa9-d4790f715d09 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.216224 May 03 09:14:40.226419 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 830/1490] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:14:40 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:14:41.233698 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-1817bc45-4917-432f-a041-782e721c5117 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:41.234348 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-1817bc45-4917-432f-a041-782e721c5117 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:41.241358 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1817bc45-4917-432f-a041-782e721c5117 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:41.241909 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1817bc45-4917-432f-a041-782e721c5117 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:41.242674 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1817bc45-4917-432f-a041-782e721c5117 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:41.243100 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1817bc45-4917-432f-a041-782e721c5117 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:41.244468 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-804327e2-fd4d-4126-b6e8-c04f7a3f1534 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:41.245179 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-804327e2-fd4d-4126-b6e8-c04f7a3f1534 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:41.251970 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-804327e2-fd4d-4126-b6e8-c04f7a3f1534 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:41.252423 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-804327e2-fd4d-4126-b6e8-c04f7a3f1534 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:41.253346 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-804327e2-fd4d-4126-b6e8-c04f7a3f1534 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:41.253784 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-804327e2-fd4d-4126-b6e8-c04f7a3f1534 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:41.436539 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-1817bc45-4917-432f-a041-782e721c5117 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:41.439748 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-804327e2-fd4d-4126-b6e8-c04f7a3f1534 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:41.444538 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-1817bc45-4917-432f-a041-782e721c5117 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.214811 May 03 09:14:41.446061 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 661/1491] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:14:41 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:14:41.450452 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-804327e2-fd4d-4126-b6e8-c04f7a3f1534 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:41.452004 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-804327e2-fd4d-4126-b6e8-c04f7a3f1534 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:41.453178 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-804327e2-fd4d-4126-b6e8-c04f7a3f1534 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.213002 May 03 09:14:41.453730 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 831/1492] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:14:41 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:14:42.471427 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5682c313-531e-4c8d-ba36-017685abdf1b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:42.471427 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5682c313-531e-4c8d-ba36-017685abdf1b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:42.478664 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-52ff741b-8134-4e45-84f3-0e75eb1475f6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:42.479099 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5682c313-531e-4c8d-ba36-017685abdf1b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:42.479099 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5682c313-531e-4c8d-ba36-017685abdf1b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:42.479448 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-52ff741b-8134-4e45-84f3-0e75eb1475f6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:42.479881 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5682c313-531e-4c8d-ba36-017685abdf1b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:42.480348 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5682c313-531e-4c8d-ba36-017685abdf1b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:42.487315 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-52ff741b-8134-4e45-84f3-0e75eb1475f6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:42.487750 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-52ff741b-8134-4e45-84f3-0e75eb1475f6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:42.488621 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-52ff741b-8134-4e45-84f3-0e75eb1475f6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:42.489057 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-52ff741b-8134-4e45-84f3-0e75eb1475f6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:42.671043 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5682c313-531e-4c8d-ba36-017685abdf1b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:42.674993 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-52ff741b-8134-4e45-84f3-0e75eb1475f6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:42.680075 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5682c313-531e-4c8d-ba36-017685abdf1b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.218429 May 03 09:14:42.680643 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 662/1493] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:14:42 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:14:42.684487 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-52ff741b-8134-4e45-84f3-0e75eb1475f6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:42.686069 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-52ff741b-8134-4e45-84f3-0e75eb1475f6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:42.687222 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-52ff741b-8134-4e45-84f3-0e75eb1475f6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.218890 May 03 09:14:42.687803 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 832/1494] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:14:42 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:14:43.701407 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-091919e3-c5ac-419b-a8b7-66f50cc346e0 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:43.702413 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-091919e3-c5ac-419b-a8b7-66f50cc346e0 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:43.713267 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-091919e3-c5ac-419b-a8b7-66f50cc346e0 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:43.714026 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-091919e3-c5ac-419b-a8b7-66f50cc346e0 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:43.715449 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-091919e3-c5ac-419b-a8b7-66f50cc346e0 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:43.715691 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e0fed8db-d24c-4a15-ae98-402702a2aa4e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:43.716445 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-091919e3-c5ac-419b-a8b7-66f50cc346e0 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:43.716784 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e0fed8db-d24c-4a15-ae98-402702a2aa4e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:43.727283 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e0fed8db-d24c-4a15-ae98-402702a2aa4e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:43.727723 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e0fed8db-d24c-4a15-ae98-402702a2aa4e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:43.728545 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e0fed8db-d24c-4a15-ae98-402702a2aa4e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:43.728955 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e0fed8db-d24c-4a15-ae98-402702a2aa4e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:43.907986 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-091919e3-c5ac-419b-a8b7-66f50cc346e0 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:43.910923 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e0fed8db-d24c-4a15-ae98-402702a2aa4e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:43.916458 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-091919e3-c5ac-419b-a8b7-66f50cc346e0 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.221673 May 03 09:14:43.917167 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 663/1495] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:14:43 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:14:43.920012 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e0fed8db-d24c-4a15-ae98-402702a2aa4e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:43.921508 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e0fed8db-d24c-4a15-ae98-402702a2aa4e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:43.922658 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e0fed8db-d24c-4a15-ae98-402702a2aa4e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.213497 May 03 09:14:43.923196 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 833/1496] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:14:43 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:14:44.937801 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c5ae7c3a-fa17-4cf3-9072-eeed8138de47 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:44.938885 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c5ae7c3a-fa17-4cf3-9072-eeed8138de47 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:44.944674 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-85a92469-cfb1-4db5-ac94-5daf8a1ad24a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:44.945673 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-85a92469-cfb1-4db5-ac94-5daf8a1ad24a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:44.949951 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c5ae7c3a-fa17-4cf3-9072-eeed8138de47 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:44.950697 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c5ae7c3a-fa17-4cf3-9072-eeed8138de47 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:44.952016 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c5ae7c3a-fa17-4cf3-9072-eeed8138de47 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:44.952756 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c5ae7c3a-fa17-4cf3-9072-eeed8138de47 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:44.955723 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-85a92469-cfb1-4db5-ac94-5daf8a1ad24a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:44.956516 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-85a92469-cfb1-4db5-ac94-5daf8a1ad24a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:44.958108 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-85a92469-cfb1-4db5-ac94-5daf8a1ad24a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:44.958793 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-85a92469-cfb1-4db5-ac94-5daf8a1ad24a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:45.144805 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c5ae7c3a-fa17-4cf3-9072-eeed8138de47 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:45.154158 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-85a92469-cfb1-4db5-ac94-5daf8a1ad24a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:45.154481 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c5ae7c3a-fa17-4cf3-9072-eeed8138de47 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.222389 May 03 09:14:45.154481 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 664/1497] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:14:44 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:14:45.158456 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-85a92469-cfb1-4db5-ac94-5daf8a1ad24a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:45.160120 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-85a92469-cfb1-4db5-ac94-5daf8a1ad24a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:45.161379 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-85a92469-cfb1-4db5-ac94-5daf8a1ad24a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.223044 May 03 09:14:45.162020 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 834/1498] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:14:44 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:14:46.171613 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-8b1b9da9-9822-470f-9cf8-666158942c43 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:46.172281 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-8b1b9da9-9822-470f-9cf8-666158942c43 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:46.179669 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8b1b9da9-9822-470f-9cf8-666158942c43 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:46.180198 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8b1b9da9-9822-470f-9cf8-666158942c43 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:46.180343 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-2e2af029-fbd2-4a53-bba2-c63cd16941bf tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:46.180880 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-2e2af029-fbd2-4a53-bba2-c63cd16941bf tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:46.181046 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8b1b9da9-9822-470f-9cf8-666158942c43 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:46.181418 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8b1b9da9-9822-470f-9cf8-666158942c43 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:46.188307 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2e2af029-fbd2-4a53-bba2-c63cd16941bf tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:46.188953 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2e2af029-fbd2-4a53-bba2-c63cd16941bf tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:46.189744 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2e2af029-fbd2-4a53-bba2-c63cd16941bf tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:46.190048 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2e2af029-fbd2-4a53-bba2-c63cd16941bf tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:46.374820 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-8b1b9da9-9822-470f-9cf8-666158942c43 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:46.378130 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-2e2af029-fbd2-4a53-bba2-c63cd16941bf tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:46.383316 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-8b1b9da9-9822-470f-9cf8-666158942c43 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.216105 May 03 09:14:46.383938 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 665/1499] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:14:46 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:14:46.386935 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-2e2af029-fbd2-4a53-bba2-c63cd16941bf tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:46.388478 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-2e2af029-fbd2-4a53-bba2-c63cd16941bf tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:46.389651 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-2e2af029-fbd2-4a53-bba2-c63cd16941bf tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.213805 May 03 09:14:46.390202 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 835/1500] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:14:46 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:14:47.404977 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b7b265b2-a3ce-4029-9f80-141abc70e6b7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:47.405955 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b7b265b2-a3ce-4029-9f80-141abc70e6b7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:47.411692 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c16b82fa-03a8-40c4-bb6f-332df42b1c95 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:47.412723 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c16b82fa-03a8-40c4-bb6f-332df42b1c95 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:47.415706 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b7b265b2-a3ce-4029-9f80-141abc70e6b7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:47.416186 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b7b265b2-a3ce-4029-9f80-141abc70e6b7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:47.416957 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b7b265b2-a3ce-4029-9f80-141abc70e6b7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:47.417385 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b7b265b2-a3ce-4029-9f80-141abc70e6b7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:47.419867 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c16b82fa-03a8-40c4-bb6f-332df42b1c95 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:47.420316 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c16b82fa-03a8-40c4-bb6f-332df42b1c95 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:47.422439 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c16b82fa-03a8-40c4-bb6f-332df42b1c95 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:47.422439 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c16b82fa-03a8-40c4-bb6f-332df42b1c95 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:47.608631 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b7b265b2-a3ce-4029-9f80-141abc70e6b7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:47.611602 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c16b82fa-03a8-40c4-bb6f-332df42b1c95 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:47.620760 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b7b265b2-a3ce-4029-9f80-141abc70e6b7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.222239 May 03 09:14:47.621629 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 666/1501] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:14:47 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:14:47.623314 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c16b82fa-03a8-40c4-bb6f-332df42b1c95 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:47.624867 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c16b82fa-03a8-40c4-bb6f-332df42b1c95 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:47.626053 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c16b82fa-03a8-40c4-bb6f-332df42b1c95 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.220852 May 03 09:14:47.626635 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 836/1502] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:14:47 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:14:48.642531 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9bb9f9c8-bdd7-4367-9964-16e13c9d5907 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:48.643491 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9bb9f9c8-bdd7-4367-9964-16e13c9d5907 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:48.648837 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3e4614ab-be16-49bc-82e7-8fe2ff7bcab7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:48.649450 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-3e4614ab-be16-49bc-82e7-8fe2ff7bcab7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:48.651945 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9bb9f9c8-bdd7-4367-9964-16e13c9d5907 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:48.652402 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9bb9f9c8-bdd7-4367-9964-16e13c9d5907 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:48.653176 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9bb9f9c8-bdd7-4367-9964-16e13c9d5907 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:48.653602 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9bb9f9c8-bdd7-4367-9964-16e13c9d5907 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:48.655882 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3e4614ab-be16-49bc-82e7-8fe2ff7bcab7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:48.656301 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3e4614ab-be16-49bc-82e7-8fe2ff7bcab7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:48.657087 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3e4614ab-be16-49bc-82e7-8fe2ff7bcab7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:48.657522 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3e4614ab-be16-49bc-82e7-8fe2ff7bcab7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:48.837026 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9bb9f9c8-bdd7-4367-9964-16e13c9d5907 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:48.840083 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-3e4614ab-be16-49bc-82e7-8fe2ff7bcab7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:48.845964 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9bb9f9c8-bdd7-4367-9964-16e13c9d5907 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.209953 May 03 09:14:48.846642 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 667/1503] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:14:48 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:14:48.849548 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-3e4614ab-be16-49bc-82e7-8fe2ff7bcab7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:48.851045 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-3e4614ab-be16-49bc-82e7-8fe2ff7bcab7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:48.852287 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-3e4614ab-be16-49bc-82e7-8fe2ff7bcab7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.209717 May 03 09:14:48.852994 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 837/1504] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:14:48 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:14:49.862692 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-fae97cfe-590d-40b5-a8d1-ed769f1eb30b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:49.863291 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-fae97cfe-590d-40b5-a8d1-ed769f1eb30b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:49.870073 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fae97cfe-590d-40b5-a8d1-ed769f1eb30b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:49.870439 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f367fbf2-b6d4-41d7-92dd-ccc3f0076290 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:49.870930 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fae97cfe-590d-40b5-a8d1-ed769f1eb30b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:49.871043 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f367fbf2-b6d4-41d7-92dd-ccc3f0076290 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:49.871260 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fae97cfe-590d-40b5-a8d1-ed769f1eb30b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:49.871944 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fae97cfe-590d-40b5-a8d1-ed769f1eb30b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:49.877170 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f367fbf2-b6d4-41d7-92dd-ccc3f0076290 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:49.877633 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f367fbf2-b6d4-41d7-92dd-ccc3f0076290 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:49.878390 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f367fbf2-b6d4-41d7-92dd-ccc3f0076290 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:49.878817 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f367fbf2-b6d4-41d7-92dd-ccc3f0076290 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:50.135560 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f367fbf2-b6d4-41d7-92dd-ccc3f0076290 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:50.144511 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f367fbf2-b6d4-41d7-92dd-ccc3f0076290 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:50.146026 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f367fbf2-b6d4-41d7-92dd-ccc3f0076290 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:50.147158 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f367fbf2-b6d4-41d7-92dd-ccc3f0076290 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.280695 May 03 09:14:50.147709 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 838/1505] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:14:49 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 09:14:50.148248 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-fae97cfe-590d-40b5-a8d1-ed769f1eb30b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:50.157003 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-fae97cfe-590d-40b5-a8d1-ed769f1eb30b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.298260 May 03 09:14:50.157563 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 668/1506] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:14:49 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:14:51.169828 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-babfffa9-17b4-4c73-8bfc-21dc7ee8a925 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:51.170848 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-babfffa9-17b4-4c73-8bfc-21dc7ee8a925 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:51.177647 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-1b8546f1-6ea1-483c-b20c-15cef1c4ef15 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:51.178665 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-1b8546f1-6ea1-483c-b20c-15cef1c4ef15 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:51.181566 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-babfffa9-17b4-4c73-8bfc-21dc7ee8a925 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:51.182315 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-babfffa9-17b4-4c73-8bfc-21dc7ee8a925 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:51.183582 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-babfffa9-17b4-4c73-8bfc-21dc7ee8a925 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:51.184433 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-babfffa9-17b4-4c73-8bfc-21dc7ee8a925 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:51.189588 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1b8546f1-6ea1-483c-b20c-15cef1c4ef15 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:51.190329 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1b8546f1-6ea1-483c-b20c-15cef1c4ef15 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:51.191647 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1b8546f1-6ea1-483c-b20c-15cef1c4ef15 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:51.192585 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1b8546f1-6ea1-483c-b20c-15cef1c4ef15 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:51.376096 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-babfffa9-17b4-4c73-8bfc-21dc7ee8a925 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:51.380109 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-1b8546f1-6ea1-483c-b20c-15cef1c4ef15 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:51.386036 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-babfffa9-17b4-4c73-8bfc-21dc7ee8a925 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:51.387568 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-babfffa9-17b4-4c73-8bfc-21dc7ee8a925 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:51.388639 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-1b8546f1-6ea1-483c-b20c-15cef1c4ef15 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.217527 May 03 09:14:51.388808 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-babfffa9-17b4-4c73-8bfc-21dc7ee8a925 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.225828 May 03 09:14:51.389219 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 669/1507] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:14:51 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:14:51.389374 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 839/1508] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:14:51 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:14:52.408623 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5f9e07f2-9372-4cbd-ab9a-a687846f0143 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:52.409389 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-280b8577-48eb-460f-a8c6-e90efd0f556f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:52.409901 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5f9e07f2-9372-4cbd-ab9a-a687846f0143 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:52.410028 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-280b8577-48eb-460f-a8c6-e90efd0f556f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:52.418122 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5f9e07f2-9372-4cbd-ab9a-a687846f0143 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:52.418712 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5f9e07f2-9372-4cbd-ab9a-a687846f0143 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:52.418908 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-280b8577-48eb-460f-a8c6-e90efd0f556f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:52.419306 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-280b8577-48eb-460f-a8c6-e90efd0f556f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:52.419712 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5f9e07f2-9372-4cbd-ab9a-a687846f0143 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:52.420336 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5f9e07f2-9372-4cbd-ab9a-a687846f0143 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:52.420554 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-280b8577-48eb-460f-a8c6-e90efd0f556f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:52.420908 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-280b8577-48eb-460f-a8c6-e90efd0f556f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:52.608611 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5f9e07f2-9372-4cbd-ab9a-a687846f0143 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:52.617858 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-280b8577-48eb-460f-a8c6-e90efd0f556f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:52.618892 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5f9e07f2-9372-4cbd-ab9a-a687846f0143 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.215354 May 03 09:14:52.619803 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 670/1509] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:14:52 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:14:52.630302 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-280b8577-48eb-460f-a8c6-e90efd0f556f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:52.632435 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-280b8577-48eb-460f-a8c6-e90efd0f556f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:52.634279 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-280b8577-48eb-460f-a8c6-e90efd0f556f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.230264 May 03 09:14:52.634837 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 840/1510] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:14:52 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:14:53.640565 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b5901f16-c137-4d82-a5d1-ebb1b0afdc65 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:53.641175 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b5901f16-c137-4d82-a5d1-ebb1b0afdc65 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:53.647636 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b5901f16-c137-4d82-a5d1-ebb1b0afdc65 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:53.648124 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b5901f16-c137-4d82-a5d1-ebb1b0afdc65 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:53.648882 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b5901f16-c137-4d82-a5d1-ebb1b0afdc65 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:53.649310 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b5901f16-c137-4d82-a5d1-ebb1b0afdc65 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:53.652365 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-dd6abb6e-d56e-4e55-998f-872945055edb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:53.652977 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-dd6abb6e-d56e-4e55-998f-872945055edb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:53.659639 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dd6abb6e-d56e-4e55-998f-872945055edb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:53.660111 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dd6abb6e-d56e-4e55-998f-872945055edb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:53.660878 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dd6abb6e-d56e-4e55-998f-872945055edb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:53.661306 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dd6abb6e-d56e-4e55-998f-872945055edb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:53.837738 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b5901f16-c137-4d82-a5d1-ebb1b0afdc65 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:53.841154 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-dd6abb6e-d56e-4e55-998f-872945055edb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:53.846563 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b5901f16-c137-4d82-a5d1-ebb1b0afdc65 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.209894 May 03 09:14:53.847405 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 671/1511] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:14:53 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:14:53.851520 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-dd6abb6e-d56e-4e55-998f-872945055edb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:53.853091 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-dd6abb6e-d56e-4e55-998f-872945055edb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:53.854278 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-dd6abb6e-d56e-4e55-998f-872945055edb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.205742 May 03 09:14:53.854824 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 841/1512] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:14:53 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:14:54.864266 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9e75cc38-6848-4717-a3fc-9e1b680a416c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:54.864840 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9e75cc38-6848-4717-a3fc-9e1b680a416c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:54.872085 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9e75cc38-6848-4717-a3fc-9e1b680a416c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:54.872541 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9e75cc38-6848-4717-a3fc-9e1b680a416c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:54.872694 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-addec47f-4086-42e4-bf24-23e3ad6bd908 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:54.873222 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-addec47f-4086-42e4-bf24-23e3ad6bd908 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:54.873376 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9e75cc38-6848-4717-a3fc-9e1b680a416c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:54.873737 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9e75cc38-6848-4717-a3fc-9e1b680a416c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:54.880008 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-addec47f-4086-42e4-bf24-23e3ad6bd908 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:54.880454 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-addec47f-4086-42e4-bf24-23e3ad6bd908 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:54.881229 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-addec47f-4086-42e4-bf24-23e3ad6bd908 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:54.881680 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-addec47f-4086-42e4-bf24-23e3ad6bd908 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:55.062191 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9e75cc38-6848-4717-a3fc-9e1b680a416c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:55.065407 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-addec47f-4086-42e4-bf24-23e3ad6bd908 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:55.070116 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9e75cc38-6848-4717-a3fc-9e1b680a416c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.209967 May 03 09:14:55.070920 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 672/1513] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:14:54 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:14:55.074199 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-addec47f-4086-42e4-bf24-23e3ad6bd908 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:55.075755 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-addec47f-4086-42e4-bf24-23e3ad6bd908 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:55.077057 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-addec47f-4086-42e4-bf24-23e3ad6bd908 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.208433 May 03 09:14:55.077684 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 842/1514] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:14:54 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:14:56.092055 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-05d377bb-e5ee-4b8b-aea9-ce33acda5968 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:56.092945 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-05d377bb-e5ee-4b8b-aea9-ce33acda5968 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:56.099115 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-8222138a-8508-4e5b-8eb4-5d22e7880436 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:56.100173 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-8222138a-8508-4e5b-8eb4-5d22e7880436 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:56.104114 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-05d377bb-e5ee-4b8b-aea9-ce33acda5968 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:56.104881 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-05d377bb-e5ee-4b8b-aea9-ce33acda5968 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:56.106150 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-05d377bb-e5ee-4b8b-aea9-ce33acda5968 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:56.106895 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-05d377bb-e5ee-4b8b-aea9-ce33acda5968 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:56.109776 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8222138a-8508-4e5b-8eb4-5d22e7880436 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:56.110524 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8222138a-8508-4e5b-8eb4-5d22e7880436 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:56.111855 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8222138a-8508-4e5b-8eb4-5d22e7880436 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:56.112577 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8222138a-8508-4e5b-8eb4-5d22e7880436 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:56.299012 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-05d377bb-e5ee-4b8b-aea9-ce33acda5968 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:56.302268 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-8222138a-8508-4e5b-8eb4-5d22e7880436 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:56.307969 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-05d377bb-e5ee-4b8b-aea9-ce33acda5968 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.222615 May 03 09:14:56.309027 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 673/1515] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:14:56 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:14:56.310821 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-8222138a-8508-4e5b-8eb4-5d22e7880436 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:56.312430 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-8222138a-8508-4e5b-8eb4-5d22e7880436 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:56.313731 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-8222138a-8508-4e5b-8eb4-5d22e7880436 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.221881 May 03 09:14:56.314287 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 843/1516] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:14:56 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:14:57.327198 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-00cf6200-7372-4e16-b157-2625cf22ba1e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:57.327837 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-00cf6200-7372-4e16-b157-2625cf22ba1e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:57.332584 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-fce6a9c5-5ea3-4bb5-9adc-49662248225c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:57.333177 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-fce6a9c5-5ea3-4bb5-9adc-49662248225c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:57.334284 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-00cf6200-7372-4e16-b157-2625cf22ba1e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:57.334722 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-00cf6200-7372-4e16-b157-2625cf22ba1e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:57.335508 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-00cf6200-7372-4e16-b157-2625cf22ba1e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:57.335974 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-00cf6200-7372-4e16-b157-2625cf22ba1e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:57.339663 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fce6a9c5-5ea3-4bb5-9adc-49662248225c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:57.340134 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fce6a9c5-5ea3-4bb5-9adc-49662248225c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:57.340900 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fce6a9c5-5ea3-4bb5-9adc-49662248225c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:57.341327 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fce6a9c5-5ea3-4bb5-9adc-49662248225c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:57.524711 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-00cf6200-7372-4e16-b157-2625cf22ba1e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:57.528990 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-fce6a9c5-5ea3-4bb5-9adc-49662248225c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:57.533092 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-00cf6200-7372-4e16-b157-2625cf22ba1e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.210388 May 03 09:14:57.533666 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 674/1517] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:14:57 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:14:57.537748 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-fce6a9c5-5ea3-4bb5-9adc-49662248225c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:57.539230 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-fce6a9c5-5ea3-4bb5-9adc-49662248225c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:57.540428 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-fce6a9c5-5ea3-4bb5-9adc-49662248225c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.211798 May 03 09:14:57.540970 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 844/1518] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:14:57 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:14:58.550589 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-17aae6a1-e7ee-4e56-aa28-a6ae2ed01f65 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:58.551314 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-17aae6a1-e7ee-4e56-aa28-a6ae2ed01f65 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:58.558672 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-2d6fc59d-e304-4975-8725-cc67e91c440a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:58.559309 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-2d6fc59d-e304-4975-8725-cc67e91c440a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:58.560964 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-17aae6a1-e7ee-4e56-aa28-a6ae2ed01f65 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:58.561419 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-17aae6a1-e7ee-4e56-aa28-a6ae2ed01f65 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:58.562204 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-17aae6a1-e7ee-4e56-aa28-a6ae2ed01f65 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:58.562643 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-17aae6a1-e7ee-4e56-aa28-a6ae2ed01f65 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:58.569055 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2d6fc59d-e304-4975-8725-cc67e91c440a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:58.569507 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2d6fc59d-e304-4975-8725-cc67e91c440a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:58.570309 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2d6fc59d-e304-4975-8725-cc67e91c440a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:58.570746 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2d6fc59d-e304-4975-8725-cc67e91c440a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:58.759666 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-2d6fc59d-e304-4975-8725-cc67e91c440a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:58.762664 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-17aae6a1-e7ee-4e56-aa28-a6ae2ed01f65 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:58.768252 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-2d6fc59d-e304-4975-8725-cc67e91c440a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:58.769756 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-2d6fc59d-e304-4975-8725-cc67e91c440a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:14:58.770358 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-17aae6a1-e7ee-4e56-aa28-a6ae2ed01f65 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.223869 May 03 09:14:58.770930 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 675/1519] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:14:58 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:14:58.771039 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-2d6fc59d-e304-4975-8725-cc67e91c440a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.216408 May 03 09:14:58.771476 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 845/1520] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:14:58 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 09:14:59.792176 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-22e3538d-1f5d-4980-a303-2b221a3b19b7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:59.793080 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-80fd7c52-adce-4e88-9a8b-64bbb73a82f5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:14:59.793686 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-22e3538d-1f5d-4980-a303-2b221a3b19b7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:59.793995 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-80fd7c52-adce-4e88-9a8b-64bbb73a82f5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:14:59.804104 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-22e3538d-1f5d-4980-a303-2b221a3b19b7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:59.804857 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-22e3538d-1f5d-4980-a303-2b221a3b19b7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:59.805267 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-80fd7c52-adce-4e88-9a8b-64bbb73a82f5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:59.806007 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-80fd7c52-adce-4e88-9a8b-64bbb73a82f5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:59.806248 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-22e3538d-1f5d-4980-a303-2b221a3b19b7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:59.806801 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-22e3538d-1f5d-4980-a303-2b221a3b19b7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:59.807252 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-80fd7c52-adce-4e88-9a8b-64bbb73a82f5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:14:59.808012 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-80fd7c52-adce-4e88-9a8b-64bbb73a82f5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:14:59.998143 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-80fd7c52-adce-4e88-9a8b-64bbb73a82f5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:00.000664 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-22e3538d-1f5d-4980-a303-2b221a3b19b7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:00.006445 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-80fd7c52-adce-4e88-9a8b-64bbb73a82f5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:00.008027 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-80fd7c52-adce-4e88-9a8b-64bbb73a82f5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:00.008550 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-22e3538d-1f5d-4980-a303-2b221a3b19b7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.223011 May 03 09:15:00.009079 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 676/1521] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:14:59 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:15:00.009236 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-80fd7c52-adce-4e88-9a8b-64bbb73a82f5 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.222778 May 03 09:15:00.009727 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 846/1522] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:14:59 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:15:01.025782 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-eb17ab1c-3c17-4454-9697-9512d81d608f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:01.026453 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-eb17ab1c-3c17-4454-9697-9512d81d608f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:01.027451 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-feb2dce9-3a49-4614-a380-5a8d1bfcea5e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:01.028215 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-feb2dce9-3a49-4614-a380-5a8d1bfcea5e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:01.032778 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-eb17ab1c-3c17-4454-9697-9512d81d608f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:01.033404 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-eb17ab1c-3c17-4454-9697-9512d81d608f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:01.034388 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-eb17ab1c-3c17-4454-9697-9512d81d608f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:01.034710 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-feb2dce9-3a49-4614-a380-5a8d1bfcea5e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:01.034820 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-eb17ab1c-3c17-4454-9697-9512d81d608f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:01.035162 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-feb2dce9-3a49-4614-a380-5a8d1bfcea5e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:01.035960 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-feb2dce9-3a49-4614-a380-5a8d1bfcea5e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:01.036392 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-feb2dce9-3a49-4614-a380-5a8d1bfcea5e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:01.232639 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-eb17ab1c-3c17-4454-9697-9512d81d608f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:01.236642 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-feb2dce9-3a49-4614-a380-5a8d1bfcea5e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:01.240621 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-eb17ab1c-3c17-4454-9697-9512d81d608f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.218885 May 03 09:15:01.241219 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 677/1523] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:15:01 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:15:01.245620 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-feb2dce9-3a49-4614-a380-5a8d1bfcea5e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:01.247295 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-feb2dce9-3a49-4614-a380-5a8d1bfcea5e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:01.248566 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-feb2dce9-3a49-4614-a380-5a8d1bfcea5e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.225101 May 03 09:15:01.249220 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 847/1524] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:15:01 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:15:02.260338 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-09a4d6e4-834d-4d65-8707-a13dd553dcbd tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:02.262993 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-09a4d6e4-834d-4d65-8707-a13dd553dcbd tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:02.269153 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-26e10f6b-29a8-4767-85cb-725273479aaf tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:02.269770 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-09a4d6e4-834d-4d65-8707-a13dd553dcbd tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:02.270048 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-26e10f6b-29a8-4767-85cb-725273479aaf tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:02.270196 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-09a4d6e4-834d-4d65-8707-a13dd553dcbd tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:02.270964 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-09a4d6e4-834d-4d65-8707-a13dd553dcbd tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:02.271573 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-09a4d6e4-834d-4d65-8707-a13dd553dcbd tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:02.277908 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-26e10f6b-29a8-4767-85cb-725273479aaf tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:02.278353 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-26e10f6b-29a8-4767-85cb-725273479aaf tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:02.279152 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-26e10f6b-29a8-4767-85cb-725273479aaf tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:02.279583 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-26e10f6b-29a8-4767-85cb-725273479aaf tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:02.459478 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-09a4d6e4-834d-4d65-8707-a13dd553dcbd tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:02.463421 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-26e10f6b-29a8-4767-85cb-725273479aaf tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:02.467599 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-09a4d6e4-834d-4d65-8707-a13dd553dcbd tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.212509 May 03 09:15:02.468437 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 678/1525] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:15:02 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:15:02.472849 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-26e10f6b-29a8-4767-85cb-725273479aaf tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:02.474417 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-26e10f6b-29a8-4767-85cb-725273479aaf tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:02.475598 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-26e10f6b-29a8-4767-85cb-725273479aaf tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.211628 May 03 09:15:02.476179 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 848/1526] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:15:02 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:15:03.493111 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-57c892b6-a89f-415c-978a-8d5782694a02 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:03.495187 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-57c892b6-a89f-415c-978a-8d5782694a02 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:03.497055 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-0c373b6a-719f-436c-ab3f-a1f888274acb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:03.497669 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-0c373b6a-719f-436c-ab3f-a1f888274acb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:03.502295 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-57c892b6-a89f-415c-978a-8d5782694a02 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:03.502751 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-57c892b6-a89f-415c-978a-8d5782694a02 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:03.503557 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-57c892b6-a89f-415c-978a-8d5782694a02 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:03.504027 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-57c892b6-a89f-415c-978a-8d5782694a02 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:03.504187 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0c373b6a-719f-436c-ab3f-a1f888274acb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:03.504647 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0c373b6a-719f-436c-ab3f-a1f888274acb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:03.505411 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0c373b6a-719f-436c-ab3f-a1f888274acb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:03.505843 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0c373b6a-719f-436c-ab3f-a1f888274acb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:03.686913 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-57c892b6-a89f-415c-978a-8d5782694a02 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:03.693711 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-0c373b6a-719f-436c-ab3f-a1f888274acb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:03.701054 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-57c892b6-a89f-415c-978a-8d5782694a02 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.214584 May 03 09:15:03.701998 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 679/1527] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:15:03 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:15:03.702392 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-0c373b6a-719f-436c-ab3f-a1f888274acb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:03.703920 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-0c373b6a-719f-436c-ab3f-a1f888274acb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:03.705141 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-0c373b6a-719f-436c-ab3f-a1f888274acb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.213858 May 03 09:15:03.709419 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 849/1528] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:15:03 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:15:04.722955 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-12c5c689-ca44-46f5-88e8-a383dca3f67b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:04.723964 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-12c5c689-ca44-46f5-88e8-a383dca3f67b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:04.727335 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-1d2cbcc5-ae72-4d02-b2a1-08131c94253a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:04.729217 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-1d2cbcc5-ae72-4d02-b2a1-08131c94253a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:04.732809 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-12c5c689-ca44-46f5-88e8-a383dca3f67b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:04.733260 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-12c5c689-ca44-46f5-88e8-a383dca3f67b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:04.734064 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-12c5c689-ca44-46f5-88e8-a383dca3f67b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:04.734838 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-12c5c689-ca44-46f5-88e8-a383dca3f67b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:04.736348 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1d2cbcc5-ae72-4d02-b2a1-08131c94253a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:04.737057 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1d2cbcc5-ae72-4d02-b2a1-08131c94253a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:04.737568 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1d2cbcc5-ae72-4d02-b2a1-08131c94253a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:04.737991 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1d2cbcc5-ae72-4d02-b2a1-08131c94253a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:04.921281 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-12c5c689-ca44-46f5-88e8-a383dca3f67b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:04.924302 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-1d2cbcc5-ae72-4d02-b2a1-08131c94253a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:04.929643 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-12c5c689-ca44-46f5-88e8-a383dca3f67b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.213547 May 03 09:15:04.930304 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 680/1529] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:15:04 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:15:04.933055 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-1d2cbcc5-ae72-4d02-b2a1-08131c94253a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:04.934551 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-1d2cbcc5-ae72-4d02-b2a1-08131c94253a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:04.935720 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-1d2cbcc5-ae72-4d02-b2a1-08131c94253a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.215538 May 03 09:15:04.936288 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 850/1530] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:15:04 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:15:05.950883 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6eb27a38-336e-40c3-a1c6-40eb32a92da5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:05.951895 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6eb27a38-336e-40c3-a1c6-40eb32a92da5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:05.957689 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-507cf262-c9f5-497a-8211-f38add251392 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:05.958879 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-507cf262-c9f5-497a-8211-f38add251392 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:05.962628 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6eb27a38-336e-40c3-a1c6-40eb32a92da5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:05.963386 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6eb27a38-336e-40c3-a1c6-40eb32a92da5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:05.964671 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6eb27a38-336e-40c3-a1c6-40eb32a92da5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:05.965107 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6eb27a38-336e-40c3-a1c6-40eb32a92da5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:05.967609 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-507cf262-c9f5-497a-8211-f38add251392 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:05.968090 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-507cf262-c9f5-497a-8211-f38add251392 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:05.970587 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-507cf262-c9f5-497a-8211-f38add251392 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:05.970587 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-507cf262-c9f5-497a-8211-f38add251392 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:06.418977 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6eb27a38-336e-40c3-a1c6-40eb32a92da5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:06.423597 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-507cf262-c9f5-497a-8211-f38add251392 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:06.427573 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6eb27a38-336e-40c3-a1c6-40eb32a92da5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.483524 May 03 09:15:06.428180 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 681/1531] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:15:05 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:15:06.433932 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-507cf262-c9f5-497a-8211-f38add251392 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:06.435439 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-507cf262-c9f5-497a-8211-f38add251392 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:06.436729 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-507cf262-c9f5-497a-8211-f38add251392 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.485786 May 03 09:15:06.437310 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 851/1532] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:15:05 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:15:07.450877 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d60e6867-eda6-420f-a8e9-da432a0ca8a6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:07.452070 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d60e6867-eda6-420f-a8e9-da432a0ca8a6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:07.458550 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9f9ddff4-2af0-46d4-bb2e-8f7a1e40615b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:07.459533 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9f9ddff4-2af0-46d4-bb2e-8f7a1e40615b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:07.462539 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d60e6867-eda6-420f-a8e9-da432a0ca8a6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:07.463293 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d60e6867-eda6-420f-a8e9-da432a0ca8a6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:07.464553 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d60e6867-eda6-420f-a8e9-da432a0ca8a6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:07.465050 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d60e6867-eda6-420f-a8e9-da432a0ca8a6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:07.468062 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9f9ddff4-2af0-46d4-bb2e-8f7a1e40615b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:07.468515 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9f9ddff4-2af0-46d4-bb2e-8f7a1e40615b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:07.469659 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9f9ddff4-2af0-46d4-bb2e-8f7a1e40615b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:07.470100 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9f9ddff4-2af0-46d4-bb2e-8f7a1e40615b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:07.664689 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d60e6867-eda6-420f-a8e9-da432a0ca8a6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:07.668737 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9f9ddff4-2af0-46d4-bb2e-8f7a1e40615b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:07.673075 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d60e6867-eda6-420f-a8e9-da432a0ca8a6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.228863 May 03 09:15:07.673638 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 682/1533] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:15:07 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:15:07.677287 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9f9ddff4-2af0-46d4-bb2e-8f7a1e40615b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:07.678793 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9f9ddff4-2af0-46d4-bb2e-8f7a1e40615b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:07.680009 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9f9ddff4-2af0-46d4-bb2e-8f7a1e40615b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.228121 May 03 09:15:07.680575 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 852/1534] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:15:07 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:15:08.694819 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-bbeb3bc2-bd19-4bd6-b5a8-3ee89ed948a5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:08.695833 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-bbeb3bc2-bd19-4bd6-b5a8-3ee89ed948a5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:08.702393 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-683bf34a-f06b-4e01-8f16-7e117b09109e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:08.703405 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-683bf34a-f06b-4e01-8f16-7e117b09109e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:08.706574 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bbeb3bc2-bd19-4bd6-b5a8-3ee89ed948a5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:08.707321 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bbeb3bc2-bd19-4bd6-b5a8-3ee89ed948a5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:08.708638 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bbeb3bc2-bd19-4bd6-b5a8-3ee89ed948a5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:08.709361 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bbeb3bc2-bd19-4bd6-b5a8-3ee89ed948a5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:08.714471 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-683bf34a-f06b-4e01-8f16-7e117b09109e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:08.715000 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-683bf34a-f06b-4e01-8f16-7e117b09109e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:08.716006 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-683bf34a-f06b-4e01-8f16-7e117b09109e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:08.716445 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-683bf34a-f06b-4e01-8f16-7e117b09109e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:08.893885 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-bbeb3bc2-bd19-4bd6-b5a8-3ee89ed948a5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:08.901867 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-683bf34a-f06b-4e01-8f16-7e117b09109e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:08.903556 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-bbeb3bc2-bd19-4bd6-b5a8-3ee89ed948a5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.215361 May 03 09:15:08.904181 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 683/1535] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:15:08 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:15:08.910323 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-683bf34a-f06b-4e01-8f16-7e117b09109e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:08.911796 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-683bf34a-f06b-4e01-8f16-7e117b09109e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:08.912991 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-683bf34a-f06b-4e01-8f16-7e117b09109e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.217256 May 03 09:15:08.913535 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 853/1536] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:15:08 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:15:09.924805 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-74ad38e4-f2a3-48e8-be75-fd571f5a8f25 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:09.925787 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-74ad38e4-f2a3-48e8-be75-fd571f5a8f25 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:09.936661 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-74ad38e4-f2a3-48e8-be75-fd571f5a8f25 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:09.937390 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-74ad38e4-f2a3-48e8-be75-fd571f5a8f25 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:09.938235 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-42534822-4255-477d-9d75-f10215417bfd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:09.938979 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-74ad38e4-f2a3-48e8-be75-fd571f5a8f25 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:09.939328 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-74ad38e4-f2a3-48e8-be75-fd571f5a8f25 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:09.939558 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-42534822-4255-477d-9d75-f10215417bfd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:09.950189 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-42534822-4255-477d-9d75-f10215417bfd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:09.951064 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-42534822-4255-477d-9d75-f10215417bfd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:09.951880 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-42534822-4255-477d-9d75-f10215417bfd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:09.952315 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-42534822-4255-477d-9d75-f10215417bfd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:10.131359 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-74ad38e4-f2a3-48e8-be75-fd571f5a8f25 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:10.139545 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-74ad38e4-f2a3-48e8-be75-fd571f5a8f25 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.221547 May 03 09:15:10.140162 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 684/1537] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:15:09 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:15:10.142006 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-42534822-4255-477d-9d75-f10215417bfd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:10.151238 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-42534822-4255-477d-9d75-f10215417bfd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:10.152822 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-42534822-4255-477d-9d75-f10215417bfd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:10.154142 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-42534822-4255-477d-9d75-f10215417bfd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.223394 May 03 09:15:10.154703 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 854/1538] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:15:09 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:15:11.161131 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-091594e6-91ec-4a3e-822c-ef1e3587c754 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:11.161660 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-091594e6-91ec-4a3e-822c-ef1e3587c754 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:11.169590 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-091594e6-91ec-4a3e-822c-ef1e3587c754 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:11.170031 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-091594e6-91ec-4a3e-822c-ef1e3587c754 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:11.170789 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-091594e6-91ec-4a3e-822c-ef1e3587c754 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:11.171221 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-091594e6-91ec-4a3e-822c-ef1e3587c754 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:11.172466 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-cb1a2500-a78b-4ce3-90db-fb203ae22532 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:11.173079 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-cb1a2500-a78b-4ce3-90db-fb203ae22532 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:11.179900 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cb1a2500-a78b-4ce3-90db-fb203ae22532 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:11.180347 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cb1a2500-a78b-4ce3-90db-fb203ae22532 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:11.181110 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cb1a2500-a78b-4ce3-90db-fb203ae22532 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:11.181538 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cb1a2500-a78b-4ce3-90db-fb203ae22532 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:11.360931 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-091594e6-91ec-4a3e-822c-ef1e3587c754 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:11.364286 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-cb1a2500-a78b-4ce3-90db-fb203ae22532 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:11.369556 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-091594e6-91ec-4a3e-822c-ef1e3587c754 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.214724 May 03 09:15:11.370146 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 685/1539] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:15:11 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:15:11.374202 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-cb1a2500-a78b-4ce3-90db-fb203ae22532 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:11.376534 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-cb1a2500-a78b-4ce3-90db-fb203ae22532 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:11.378364 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-cb1a2500-a78b-4ce3-90db-fb203ae22532 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.209584 May 03 09:15:11.379172 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 855/1540] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:15:11 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 09:15:12.394813 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d02b0d63-9700-4012-a891-a3ad4648df17 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:12.395449 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d02b0d63-9700-4012-a891-a3ad4648df17 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:12.401753 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-65944ef6-ecb2-4577-b210-2ff05b6c7789 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:12.402451 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-65944ef6-ecb2-4577-b210-2ff05b6c7789 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:12.404371 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d02b0d63-9700-4012-a891-a3ad4648df17 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:12.405412 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d02b0d63-9700-4012-a891-a3ad4648df17 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:12.406260 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d02b0d63-9700-4012-a891-a3ad4648df17 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:12.406690 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d02b0d63-9700-4012-a891-a3ad4648df17 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:12.409899 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-65944ef6-ecb2-4577-b210-2ff05b6c7789 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:12.410342 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-65944ef6-ecb2-4577-b210-2ff05b6c7789 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:12.411104 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-65944ef6-ecb2-4577-b210-2ff05b6c7789 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:12.411529 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-65944ef6-ecb2-4577-b210-2ff05b6c7789 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:12.601730 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d02b0d63-9700-4012-a891-a3ad4648df17 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:12.605596 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-65944ef6-ecb2-4577-b210-2ff05b6c7789 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:12.609942 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d02b0d63-9700-4012-a891-a3ad4648df17 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.220889 May 03 09:15:12.610554 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 686/1541] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:15:12 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:15:12.614322 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-65944ef6-ecb2-4577-b210-2ff05b6c7789 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:12.615888 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-65944ef6-ecb2-4577-b210-2ff05b6c7789 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:12.617109 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-65944ef6-ecb2-4577-b210-2ff05b6c7789 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.220982 May 03 09:15:12.617648 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 856/1542] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:15:12 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:15:13.631540 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0cd9c557-a6a6-4842-86c0-1bb14e196a6a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:13.632639 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0cd9c557-a6a6-4842-86c0-1bb14e196a6a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:13.638478 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-fc66741c-842e-4316-82af-da4b5c9a9462 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:13.639563 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-fc66741c-842e-4316-82af-da4b5c9a9462 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:13.641912 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0cd9c557-a6a6-4842-86c0-1bb14e196a6a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:13.642359 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0cd9c557-a6a6-4842-86c0-1bb14e196a6a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:13.643129 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0cd9c557-a6a6-4842-86c0-1bb14e196a6a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:13.643561 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0cd9c557-a6a6-4842-86c0-1bb14e196a6a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:13.646286 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fc66741c-842e-4316-82af-da4b5c9a9462 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:13.646732 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fc66741c-842e-4316-82af-da4b5c9a9462 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:13.647523 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fc66741c-842e-4316-82af-da4b5c9a9462 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:13.647997 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fc66741c-842e-4316-82af-da4b5c9a9462 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:13.829161 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0cd9c557-a6a6-4842-86c0-1bb14e196a6a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:13.835678 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-fc66741c-842e-4316-82af-da4b5c9a9462 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:13.837790 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0cd9c557-a6a6-4842-86c0-1bb14e196a6a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.212857 May 03 09:15:13.838342 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 687/1543] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:15:13 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:15:13.846168 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-fc66741c-842e-4316-82af-da4b5c9a9462 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:13.848017 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-fc66741c-842e-4316-82af-da4b5c9a9462 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:13.849464 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-fc66741c-842e-4316-82af-da4b5c9a9462 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.217271 May 03 09:15:13.850429 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 857/1544] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:15:13 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:15:14.856093 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4731a6f3-4758-4661-b40a-962eb0c63e50 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:14.856754 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4731a6f3-4758-4661-b40a-962eb0c63e50 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:14.863840 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4731a6f3-4758-4661-b40a-962eb0c63e50 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:14.864301 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4731a6f3-4758-4661-b40a-962eb0c63e50 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:14.865109 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4731a6f3-4758-4661-b40a-962eb0c63e50 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:14.865544 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4731a6f3-4758-4661-b40a-962eb0c63e50 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:14.868035 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-6bb7f954-cde4-4a8b-8ebc-4b65e02f31fd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:14.869300 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-6bb7f954-cde4-4a8b-8ebc-4b65e02f31fd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:14.876500 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6bb7f954-cde4-4a8b-8ebc-4b65e02f31fd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:14.877077 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6bb7f954-cde4-4a8b-8ebc-4b65e02f31fd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:14.877926 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6bb7f954-cde4-4a8b-8ebc-4b65e02f31fd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:14.878402 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6bb7f954-cde4-4a8b-8ebc-4b65e02f31fd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:15.056181 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-4731a6f3-4758-4661-b40a-962eb0c63e50 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:15.062971 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-6bb7f954-cde4-4a8b-8ebc-4b65e02f31fd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:15.064504 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-4731a6f3-4758-4661-b40a-962eb0c63e50 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.212462 May 03 09:15:15.065086 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 688/1545] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:15:14 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:15:15.071876 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-6bb7f954-cde4-4a8b-8ebc-4b65e02f31fd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:15.073358 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-6bb7f954-cde4-4a8b-8ebc-4b65e02f31fd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:15.074525 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-6bb7f954-cde4-4a8b-8ebc-4b65e02f31fd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.210819 May 03 09:15:15.075067 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 858/1546] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:15:14 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:15:16.083671 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e547d514-7475-4c58-ab64-02912113f394 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:16.084308 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e547d514-7475-4c58-ab64-02912113f394 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:16.091315 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e547d514-7475-4c58-ab64-02912113f394 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:16.091803 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e547d514-7475-4c58-ab64-02912113f394 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:16.092734 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e547d514-7475-4c58-ab64-02912113f394 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:16.093169 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e547d514-7475-4c58-ab64-02912113f394 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:16.094101 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-89096bd4-2087-45eb-83db-621cbb80d24a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:16.094735 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-89096bd4-2087-45eb-83db-621cbb80d24a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:16.101515 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-89096bd4-2087-45eb-83db-621cbb80d24a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:16.101968 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-89096bd4-2087-45eb-83db-621cbb80d24a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:16.102758 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-89096bd4-2087-45eb-83db-621cbb80d24a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:16.103198 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-89096bd4-2087-45eb-83db-621cbb80d24a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:16.297284 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e547d514-7475-4c58-ab64-02912113f394 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:16.305419 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e547d514-7475-4c58-ab64-02912113f394 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.226447 May 03 09:15:16.306078 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 689/1547] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:15:16 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:15:16.311036 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-89096bd4-2087-45eb-83db-621cbb80d24a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:16.319406 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-89096bd4-2087-45eb-83db-621cbb80d24a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:16.320954 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-89096bd4-2087-45eb-83db-621cbb80d24a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:16.322123 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-89096bd4-2087-45eb-83db-621cbb80d24a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.232410 May 03 09:15:16.322716 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 859/1548] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:15:16 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:15:17.322750 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9dfa64fd-0d4c-424c-99cd-32d746c891e7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:17.323362 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9dfa64fd-0d4c-424c-99cd-32d746c891e7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:17.330198 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9dfa64fd-0d4c-424c-99cd-32d746c891e7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:17.330644 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9dfa64fd-0d4c-424c-99cd-32d746c891e7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:17.331402 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9dfa64fd-0d4c-424c-99cd-32d746c891e7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:17.331863 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9dfa64fd-0d4c-424c-99cd-32d746c891e7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:17.340685 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9b5598bb-d703-4e7c-a556-19c5095905b8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:17.341306 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9b5598bb-d703-4e7c-a556-19c5095905b8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:17.348430 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9b5598bb-d703-4e7c-a556-19c5095905b8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:17.348878 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9b5598bb-d703-4e7c-a556-19c5095905b8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:17.349650 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9b5598bb-d703-4e7c-a556-19c5095905b8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:17.350088 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9b5598bb-d703-4e7c-a556-19c5095905b8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:17.515746 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9dfa64fd-0d4c-424c-99cd-32d746c891e7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:17.524145 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9dfa64fd-0d4c-424c-99cd-32d746c891e7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.205284 May 03 09:15:17.524741 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 690/1549] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:15:17 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:15:17.531372 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9b5598bb-d703-4e7c-a556-19c5095905b8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:17.539912 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9b5598bb-d703-4e7c-a556-19c5095905b8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:17.541387 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9b5598bb-d703-4e7c-a556-19c5095905b8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:17.542572 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9b5598bb-d703-4e7c-a556-19c5095905b8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.205900 May 03 09:15:17.543125 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 860/1550] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:15:17 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:15:18.409848 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 09:15:18.410593 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: Tue May 3 09:15:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 03 09:15:18.541206 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-3d80ed5b-9bf8-4826-8111-514011e1e05a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:18.541874 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-3d80ed5b-9bf8-4826-8111-514011e1e05a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:18.548476 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3d80ed5b-9bf8-4826-8111-514011e1e05a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:18.548928 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3d80ed5b-9bf8-4826-8111-514011e1e05a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:18.549702 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3d80ed5b-9bf8-4826-8111-514011e1e05a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:18.550140 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3d80ed5b-9bf8-4826-8111-514011e1e05a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:18.561084 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-dd68aee2-d71b-4afa-905a-961eecf13203 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:18.561801 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-dd68aee2-d71b-4afa-905a-961eecf13203 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:18.568402 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dd68aee2-d71b-4afa-905a-961eecf13203 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:18.568912 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dd68aee2-d71b-4afa-905a-961eecf13203 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:18.569789 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dd68aee2-d71b-4afa-905a-961eecf13203 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:18.570285 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dd68aee2-d71b-4afa-905a-961eecf13203 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:18.742686 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-3d80ed5b-9bf8-4826-8111-514011e1e05a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:18.750921 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-3d80ed5b-9bf8-4826-8111-514011e1e05a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.213696 May 03 09:15:18.751534 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 691/1551] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:15:18 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:15:18.753465 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-dd68aee2-d71b-4afa-905a-961eecf13203 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:18.762205 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-dd68aee2-d71b-4afa-905a-961eecf13203 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:18.763718 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-dd68aee2-d71b-4afa-905a-961eecf13203 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:18.765043 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-dd68aee2-d71b-4afa-905a-961eecf13203 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.207947 May 03 09:15:18.765595 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 861/1552] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:15:18 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:15:19.768227 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9d00a7d7-3bb9-4d5f-b38a-a8fa38e8400f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:19.768838 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9d00a7d7-3bb9-4d5f-b38a-a8fa38e8400f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:19.775493 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9d00a7d7-3bb9-4d5f-b38a-a8fa38e8400f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:19.775976 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9d00a7d7-3bb9-4d5f-b38a-a8fa38e8400f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:19.776734 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9d00a7d7-3bb9-4d5f-b38a-a8fa38e8400f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:19.777161 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9d00a7d7-3bb9-4d5f-b38a-a8fa38e8400f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:19.783752 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-2bd8795d-85ee-4438-8afa-0ca4d554490b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:19.784405 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-2bd8795d-85ee-4438-8afa-0ca4d554490b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:19.791074 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2bd8795d-85ee-4438-8afa-0ca4d554490b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:19.791530 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2bd8795d-85ee-4438-8afa-0ca4d554490b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:19.792451 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2bd8795d-85ee-4438-8afa-0ca4d554490b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:19.792887 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2bd8795d-85ee-4438-8afa-0ca4d554490b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:19.975657 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9d00a7d7-3bb9-4d5f-b38a-a8fa38e8400f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:19.979973 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-2bd8795d-85ee-4438-8afa-0ca4d554490b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:19.983704 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9d00a7d7-3bb9-4d5f-b38a-a8fa38e8400f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.219469 May 03 09:15:19.984305 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 692/1553] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:15:19 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:15:19.988363 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-2bd8795d-85ee-4438-8afa-0ca4d554490b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:19.989882 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-2bd8795d-85ee-4438-8afa-0ca4d554490b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:19.991097 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-2bd8795d-85ee-4438-8afa-0ca4d554490b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.211361 May 03 09:15:19.991926 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 862/1554] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:15:19 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:15:21.005355 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-45051cc4-afbb-42c9-97c1-3f452e59c52c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:21.006407 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-45051cc4-afbb-42c9-97c1-3f452e59c52c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:21.014197 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a4d85adf-8e30-4bef-8627-4b9ae0f2c906 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:21.014751 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a4d85adf-8e30-4bef-8627-4b9ae0f2c906 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:21.016015 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-45051cc4-afbb-42c9-97c1-3f452e59c52c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:21.016602 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-45051cc4-afbb-42c9-97c1-3f452e59c52c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:21.017495 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-45051cc4-afbb-42c9-97c1-3f452e59c52c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:21.019503 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-45051cc4-afbb-42c9-97c1-3f452e59c52c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:21.021110 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a4d85adf-8e30-4bef-8627-4b9ae0f2c906 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:21.021568 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a4d85adf-8e30-4bef-8627-4b9ae0f2c906 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:21.022343 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a4d85adf-8e30-4bef-8627-4b9ae0f2c906 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:21.022778 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a4d85adf-8e30-4bef-8627-4b9ae0f2c906 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:21.227116 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-45051cc4-afbb-42c9-97c1-3f452e59c52c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:21.230177 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a4d85adf-8e30-4bef-8627-4b9ae0f2c906 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:21.235241 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-45051cc4-afbb-42c9-97c1-3f452e59c52c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.236335 May 03 09:15:21.235870 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 693/1555] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:15:20 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:15:21.239002 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a4d85adf-8e30-4bef-8627-4b9ae0f2c906 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:21.240621 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a4d85adf-8e30-4bef-8627-4b9ae0f2c906 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:21.241867 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a4d85adf-8e30-4bef-8627-4b9ae0f2c906 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.234369 May 03 09:15:21.242494 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 863/1556] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:15:21 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 09:15:22.255506 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6e02de6e-fa7a-475b-8dbf-eb6f7b0e6683 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:22.256438 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6e02de6e-fa7a-475b-8dbf-eb6f7b0e6683 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:22.264223 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9ee3f939-75eb-4ace-98fe-082b4c6f1b44 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:22.265330 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9ee3f939-75eb-4ace-98fe-082b4c6f1b44 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:22.267161 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6e02de6e-fa7a-475b-8dbf-eb6f7b0e6683 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:22.267988 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6e02de6e-fa7a-475b-8dbf-eb6f7b0e6683 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:22.269257 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6e02de6e-fa7a-475b-8dbf-eb6f7b0e6683 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:22.269962 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6e02de6e-fa7a-475b-8dbf-eb6f7b0e6683 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:22.275334 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9ee3f939-75eb-4ace-98fe-082b4c6f1b44 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:22.276099 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9ee3f939-75eb-4ace-98fe-082b4c6f1b44 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:22.277443 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9ee3f939-75eb-4ace-98fe-082b4c6f1b44 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:22.278143 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9ee3f939-75eb-4ace-98fe-082b4c6f1b44 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:22.466299 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6e02de6e-fa7a-475b-8dbf-eb6f7b0e6683 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:22.469688 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9ee3f939-75eb-4ace-98fe-082b4c6f1b44 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:22.477390 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6e02de6e-fa7a-475b-8dbf-eb6f7b0e6683 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.228594 May 03 09:15:22.478706 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9ee3f939-75eb-4ace-98fe-082b4c6f1b44 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:22.479531 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 694/1557] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:15:22 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:15:22.480245 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9ee3f939-75eb-4ace-98fe-082b4c6f1b44 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:22.481442 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9ee3f939-75eb-4ace-98fe-082b4c6f1b44 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.223886 May 03 09:15:22.481997 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 864/1558] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:15:22 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:15:23.505051 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-dc7fdd17-1048-46da-b397-398aa45a6623 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:23.505900 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-dc7fdd17-1048-46da-b397-398aa45a6623 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:23.506112 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3017f33b-97eb-4990-8635-977d16b59854 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:23.507170 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-3017f33b-97eb-4990-8635-977d16b59854 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:23.515467 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dc7fdd17-1048-46da-b397-398aa45a6623 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:23.515946 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dc7fdd17-1048-46da-b397-398aa45a6623 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:23.516513 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3017f33b-97eb-4990-8635-977d16b59854 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:23.516683 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dc7fdd17-1048-46da-b397-398aa45a6623 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:23.516959 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3017f33b-97eb-4990-8635-977d16b59854 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:23.517105 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dc7fdd17-1048-46da-b397-398aa45a6623 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:23.517717 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3017f33b-97eb-4990-8635-977d16b59854 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:23.518159 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3017f33b-97eb-4990-8635-977d16b59854 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:23.606264 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 09:15:23.606513 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: Tue May 3 09:15:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f (ip 10.222.0.11) !!! May 03 09:15:23.707893 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-dc7fdd17-1048-46da-b397-398aa45a6623 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:23.712239 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-3017f33b-97eb-4990-8635-977d16b59854 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:23.716847 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-dc7fdd17-1048-46da-b397-398aa45a6623 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:23.718429 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-dc7fdd17-1048-46da-b397-398aa45a6623 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:23.719992 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-dc7fdd17-1048-46da-b397-398aa45a6623 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.221769 May 03 09:15:23.720558 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 695/1559] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:15:23 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:15:23.721283 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-3017f33b-97eb-4990-8635-977d16b59854 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.221542 May 03 09:15:23.721978 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 865/1560] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:15:23 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:15:24.742703 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-12bb78d8-b0e3-4fd0-a3db-b6820b58ce0b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:24.743586 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-1f6f41e8-01ed-4e80-a86c-523761ff5f85 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:24.744316 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-12bb78d8-b0e3-4fd0-a3db-b6820b58ce0b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:24.744514 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-1f6f41e8-01ed-4e80-a86c-523761ff5f85 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:24.754339 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-12bb78d8-b0e3-4fd0-a3db-b6820b58ce0b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:24.754643 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1f6f41e8-01ed-4e80-a86c-523761ff5f85 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:24.755105 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-12bb78d8-b0e3-4fd0-a3db-b6820b58ce0b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:24.755983 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1f6f41e8-01ed-4e80-a86c-523761ff5f85 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:24.756409 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-12bb78d8-b0e3-4fd0-a3db-b6820b58ce0b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:24.757159 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-12bb78d8-b0e3-4fd0-a3db-b6820b58ce0b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:24.757386 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1f6f41e8-01ed-4e80-a86c-523761ff5f85 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:24.758124 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1f6f41e8-01ed-4e80-a86c-523761ff5f85 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:24.961416 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-1f6f41e8-01ed-4e80-a86c-523761ff5f85 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:24.965059 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-12bb78d8-b0e3-4fd0-a3db-b6820b58ce0b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:24.970151 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-1f6f41e8-01ed-4e80-a86c-523761ff5f85 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.233566 May 03 09:15:24.970774 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 866/1561] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:15:24 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:15:24.974077 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-12bb78d8-b0e3-4fd0-a3db-b6820b58ce0b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:24.975586 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-12bb78d8-b0e3-4fd0-a3db-b6820b58ce0b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:24.976818 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-12bb78d8-b0e3-4fd0-a3db-b6820b58ce0b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.240825 May 03 09:15:24.977373 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 696/1562] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:15:24 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:15:25.987576 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-11a92c0c-09d7-4a48-8828-05bb89fd6f25 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:25.988251 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-11a92c0c-09d7-4a48-8828-05bb89fd6f25 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:25.994605 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-11a92c0c-09d7-4a48-8828-05bb89fd6f25 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:25.995085 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-11a92c0c-09d7-4a48-8828-05bb89fd6f25 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:25.995883 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-11a92c0c-09d7-4a48-8828-05bb89fd6f25 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:25.996053 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d1626fab-0c50-4baa-942e-db0c49d7da60 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:25.996574 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-11a92c0c-09d7-4a48-8828-05bb89fd6f25 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:25.996687 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d1626fab-0c50-4baa-942e-db0c49d7da60 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:26.003338 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d1626fab-0c50-4baa-942e-db0c49d7da60 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:26.003787 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d1626fab-0c50-4baa-942e-db0c49d7da60 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:26.004548 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d1626fab-0c50-4baa-942e-db0c49d7da60 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:26.004980 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d1626fab-0c50-4baa-942e-db0c49d7da60 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:26.183071 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-11a92c0c-09d7-4a48-8828-05bb89fd6f25 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:26.186373 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d1626fab-0c50-4baa-942e-db0c49d7da60 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:26.191227 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-11a92c0c-09d7-4a48-8828-05bb89fd6f25 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.207697 May 03 09:15:26.191793 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 867/1563] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:15:25 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:15:26.195550 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d1626fab-0c50-4baa-942e-db0c49d7da60 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:26.197087 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d1626fab-0c50-4baa-942e-db0c49d7da60 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:26.198263 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d1626fab-0c50-4baa-942e-db0c49d7da60 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.206333 May 03 09:15:26.198814 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 697/1564] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:15:25 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:15:27.212365 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5c39e0ef-3819-4672-a57a-4b775f7d4f7c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:27.213689 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5c39e0ef-3819-4672-a57a-4b775f7d4f7c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:27.221849 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-37414148-6f71-4bd0-80b1-6cbaefacd198 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:27.222856 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-37414148-6f71-4bd0-80b1-6cbaefacd198 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:27.225460 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5c39e0ef-3819-4672-a57a-4b775f7d4f7c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:27.226107 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5c39e0ef-3819-4672-a57a-4b775f7d4f7c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:27.227503 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5c39e0ef-3819-4672-a57a-4b775f7d4f7c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:27.228193 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5c39e0ef-3819-4672-a57a-4b775f7d4f7c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:27.233704 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-37414148-6f71-4bd0-80b1-6cbaefacd198 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:27.235504 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-37414148-6f71-4bd0-80b1-6cbaefacd198 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:27.236341 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-37414148-6f71-4bd0-80b1-6cbaefacd198 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:27.236811 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-37414148-6f71-4bd0-80b1-6cbaefacd198 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:27.417500 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5c39e0ef-3819-4672-a57a-4b775f7d4f7c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:27.420726 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-37414148-6f71-4bd0-80b1-6cbaefacd198 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:27.425920 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5c39e0ef-3819-4672-a57a-4b775f7d4f7c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.220118 May 03 09:15:27.426536 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 868/1565] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:15:27 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:15:27.429285 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-37414148-6f71-4bd0-80b1-6cbaefacd198 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:27.430792 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-37414148-6f71-4bd0-80b1-6cbaefacd198 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:27.431990 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-37414148-6f71-4bd0-80b1-6cbaefacd198 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.217193 May 03 09:15:27.432539 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 698/1566] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:15:27 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:15:28.444405 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-836c8fd5-f227-4772-9032-a2c60fd3ab7f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:28.445224 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-836c8fd5-f227-4772-9032-a2c60fd3ab7f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:28.451334 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5446364a-5bee-40dc-bfad-c7c572797b87 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:28.452088 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5446364a-5bee-40dc-bfad-c7c572797b87 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:28.453494 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-836c8fd5-f227-4772-9032-a2c60fd3ab7f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:28.453935 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-836c8fd5-f227-4772-9032-a2c60fd3ab7f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:28.454713 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-836c8fd5-f227-4772-9032-a2c60fd3ab7f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:28.455138 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-836c8fd5-f227-4772-9032-a2c60fd3ab7f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:28.458487 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5446364a-5bee-40dc-bfad-c7c572797b87 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:28.458958 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5446364a-5bee-40dc-bfad-c7c572797b87 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:28.459719 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5446364a-5bee-40dc-bfad-c7c572797b87 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:28.460179 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5446364a-5bee-40dc-bfad-c7c572797b87 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:28.655872 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-836c8fd5-f227-4772-9032-a2c60fd3ab7f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:28.658874 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5446364a-5bee-40dc-bfad-c7c572797b87 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:28.664259 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-836c8fd5-f227-4772-9032-a2c60fd3ab7f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.224439 May 03 09:15:28.664841 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 869/1567] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:15:28 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:15:28.668336 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5446364a-5bee-40dc-bfad-c7c572797b87 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:28.669859 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5446364a-5bee-40dc-bfad-c7c572797b87 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:28.671019 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5446364a-5bee-40dc-bfad-c7c572797b87 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.224324 May 03 09:15:28.671564 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 699/1568] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:15:28 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:15:29.685811 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ec0a4a7e-676d-403e-b3a2-6b3d76fe01a5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:29.686853 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ec0a4a7e-676d-403e-b3a2-6b3d76fe01a5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:29.694330 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ec0a4a7e-676d-403e-b3a2-6b3d76fe01a5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:29.694806 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ec0a4a7e-676d-403e-b3a2-6b3d76fe01a5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:29.694954 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7bc127a5-efe4-4bca-bbb4-f78661c2c6bf tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:29.695475 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7bc127a5-efe4-4bca-bbb4-f78661c2c6bf tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:29.695657 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ec0a4a7e-676d-403e-b3a2-6b3d76fe01a5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:29.696113 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ec0a4a7e-676d-403e-b3a2-6b3d76fe01a5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:29.702853 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7bc127a5-efe4-4bca-bbb4-f78661c2c6bf tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:29.703331 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7bc127a5-efe4-4bca-bbb4-f78661c2c6bf tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:29.704188 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7bc127a5-efe4-4bca-bbb4-f78661c2c6bf tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:29.704646 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7bc127a5-efe4-4bca-bbb4-f78661c2c6bf tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:29.886398 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ec0a4a7e-676d-403e-b3a2-6b3d76fe01a5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:29.890720 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7bc127a5-efe4-4bca-bbb4-f78661c2c6bf tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:29.896960 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ec0a4a7e-676d-403e-b3a2-6b3d76fe01a5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.217763 May 03 09:15:29.901190 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7bc127a5-efe4-4bca-bbb4-f78661c2c6bf tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:29.902665 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7bc127a5-efe4-4bca-bbb4-f78661c2c6bf tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:29.903859 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7bc127a5-efe4-4bca-bbb4-f78661c2c6bf tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.213113 May 03 09:15:29.908052 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 700/1569] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:15:29 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:15:29.908232 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 870/1570] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:15:29 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:15:30.918249 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-3f071780-63dc-4c1e-8cfa-d6dd17248861 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:30.919368 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-3f071780-63dc-4c1e-8cfa-d6dd17248861 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:30.925368 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f295777b-5dcf-4512-8576-8bd5aa596ad1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:30.925944 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f295777b-5dcf-4512-8576-8bd5aa596ad1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:30.926642 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3f071780-63dc-4c1e-8cfa-d6dd17248861 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:30.927090 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3f071780-63dc-4c1e-8cfa-d6dd17248861 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:30.927901 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3f071780-63dc-4c1e-8cfa-d6dd17248861 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:30.928340 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3f071780-63dc-4c1e-8cfa-d6dd17248861 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:30.932402 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f295777b-5dcf-4512-8576-8bd5aa596ad1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:30.932845 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f295777b-5dcf-4512-8576-8bd5aa596ad1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:30.933609 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f295777b-5dcf-4512-8576-8bd5aa596ad1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:30.934042 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f295777b-5dcf-4512-8576-8bd5aa596ad1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:31.114904 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-3f071780-63dc-4c1e-8cfa-d6dd17248861 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:31.119054 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f295777b-5dcf-4512-8576-8bd5aa596ad1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:31.124368 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-3f071780-63dc-4c1e-8cfa-d6dd17248861 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.212571 May 03 09:15:31.125058 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 701/1571] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:15:30 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:15:31.127899 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f295777b-5dcf-4512-8576-8bd5aa596ad1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:31.129383 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f295777b-5dcf-4512-8576-8bd5aa596ad1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:31.130551 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f295777b-5dcf-4512-8576-8bd5aa596ad1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.209718 May 03 09:15:31.131123 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 871/1572] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:15:30 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:15:32.145037 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6d2ac602-6311-47df-864a-11c6221fb5be tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:32.146107 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6d2ac602-6311-47df-864a-11c6221fb5be tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:32.152709 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9aece7f7-a4e9-4ab7-b5b2-a1f4603da115 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:32.153707 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9aece7f7-a4e9-4ab7-b5b2-a1f4603da115 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:32.156477 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6d2ac602-6311-47df-864a-11c6221fb5be tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:32.156920 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6d2ac602-6311-47df-864a-11c6221fb5be tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:32.157692 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6d2ac602-6311-47df-864a-11c6221fb5be tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:32.158117 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6d2ac602-6311-47df-864a-11c6221fb5be tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:32.160790 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9aece7f7-a4e9-4ab7-b5b2-a1f4603da115 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:32.161230 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9aece7f7-a4e9-4ab7-b5b2-a1f4603da115 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:32.162003 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9aece7f7-a4e9-4ab7-b5b2-a1f4603da115 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:32.162432 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9aece7f7-a4e9-4ab7-b5b2-a1f4603da115 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:32.357057 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9aece7f7-a4e9-4ab7-b5b2-a1f4603da115 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:32.361327 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6d2ac602-6311-47df-864a-11c6221fb5be tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:32.365648 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9aece7f7-a4e9-4ab7-b5b2-a1f4603da115 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:32.367149 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9aece7f7-a4e9-4ab7-b5b2-a1f4603da115 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:32.368358 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9aece7f7-a4e9-4ab7-b5b2-a1f4603da115 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.222185 May 03 09:15:32.368923 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 872/1573] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:15:32 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:15:32.369428 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6d2ac602-6311-47df-864a-11c6221fb5be tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.231039 May 03 09:15:32.369982 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 702/1574] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:15:32 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:15:33.386560 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e5da17a1-ebf8-4b00-90c9-a362286aec74 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:33.387127 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-17abb64a-6240-4fa6-afe7-7136ab438832 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:33.387521 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e5da17a1-ebf8-4b00-90c9-a362286aec74 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:33.387629 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-17abb64a-6240-4fa6-afe7-7136ab438832 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:33.393527 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-17abb64a-6240-4fa6-afe7-7136ab438832 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:33.393769 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e5da17a1-ebf8-4b00-90c9-a362286aec74 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:33.393934 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-17abb64a-6240-4fa6-afe7-7136ab438832 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:33.394218 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e5da17a1-ebf8-4b00-90c9-a362286aec74 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:33.394718 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-17abb64a-6240-4fa6-afe7-7136ab438832 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:33.394978 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e5da17a1-ebf8-4b00-90c9-a362286aec74 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:33.395133 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-17abb64a-6240-4fa6-afe7-7136ab438832 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:33.395409 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e5da17a1-ebf8-4b00-90c9-a362286aec74 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:33.586388 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e5da17a1-ebf8-4b00-90c9-a362286aec74 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:33.590006 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-17abb64a-6240-4fa6-afe7-7136ab438832 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:33.596619 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e5da17a1-ebf8-4b00-90c9-a362286aec74 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.213914 May 03 09:15:33.597214 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 873/1575] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:15:33 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:15:33.600083 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-17abb64a-6240-4fa6-afe7-7136ab438832 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:33.601594 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-17abb64a-6240-4fa6-afe7-7136ab438832 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:33.602776 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-17abb64a-6240-4fa6-afe7-7136ab438832 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.220119 May 03 09:15:33.603359 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 703/1576] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:15:33 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:15:34.617489 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3fc2506d-fc2e-48e2-b180-5fd006e735b9 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:34.618508 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-3fc2506d-fc2e-48e2-b180-5fd006e735b9 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:34.624791 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4d9ed775-08d5-4cf8-8bad-5906502b20b3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:34.625786 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4d9ed775-08d5-4cf8-8bad-5906502b20b3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:34.629271 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3fc2506d-fc2e-48e2-b180-5fd006e735b9 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:34.630025 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3fc2506d-fc2e-48e2-b180-5fd006e735b9 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:34.631307 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3fc2506d-fc2e-48e2-b180-5fd006e735b9 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:34.632094 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3fc2506d-fc2e-48e2-b180-5fd006e735b9 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:34.636188 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4d9ed775-08d5-4cf8-8bad-5906502b20b3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:34.636933 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4d9ed775-08d5-4cf8-8bad-5906502b20b3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:34.640500 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4d9ed775-08d5-4cf8-8bad-5906502b20b3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:34.640500 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4d9ed775-08d5-4cf8-8bad-5906502b20b3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:34.823786 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-3fc2506d-fc2e-48e2-b180-5fd006e735b9 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:34.826553 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-4d9ed775-08d5-4cf8-8bad-5906502b20b3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:34.832297 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-3fc2506d-fc2e-48e2-b180-5fd006e735b9 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.221319 May 03 09:15:34.832916 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 874/1577] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:15:34 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:15:34.834896 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-4d9ed775-08d5-4cf8-8bad-5906502b20b3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:34.836394 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-4d9ed775-08d5-4cf8-8bad-5906502b20b3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:34.837550 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-4d9ed775-08d5-4cf8-8bad-5906502b20b3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.219254 May 03 09:15:34.838090 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 704/1578] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:15:34 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:15:35.817767 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 09:15:35.819707 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: Tue May 3 09:15:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 03 09:15:35.850313 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-6af31e8f-3375-4767-8ea1-33bc68843a3c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:35.850966 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-6af31e8f-3375-4767-8ea1-33bc68843a3c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:35.856282 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-1ace4de4-d399-4e3d-b9bc-4a48e7e1362f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:35.856885 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-1ace4de4-d399-4e3d-b9bc-4a48e7e1362f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:35.857724 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6af31e8f-3375-4767-8ea1-33bc68843a3c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:35.858174 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6af31e8f-3375-4767-8ea1-33bc68843a3c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:35.858947 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6af31e8f-3375-4767-8ea1-33bc68843a3c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:35.859381 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6af31e8f-3375-4767-8ea1-33bc68843a3c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:35.863569 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1ace4de4-d399-4e3d-b9bc-4a48e7e1362f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:35.864038 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1ace4de4-d399-4e3d-b9bc-4a48e7e1362f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:35.864820 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1ace4de4-d399-4e3d-b9bc-4a48e7e1362f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:35.865251 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1ace4de4-d399-4e3d-b9bc-4a48e7e1362f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:36.053234 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-6af31e8f-3375-4767-8ea1-33bc68843a3c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:36.056383 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-1ace4de4-d399-4e3d-b9bc-4a48e7e1362f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:36.061875 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-6af31e8f-3375-4767-8ea1-33bc68843a3c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.215438 May 03 09:15:36.062738 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 875/1579] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:15:35 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:15:36.066324 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-1ace4de4-d399-4e3d-b9bc-4a48e7e1362f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:36.068729 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-1ace4de4-d399-4e3d-b9bc-4a48e7e1362f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:36.070426 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-1ace4de4-d399-4e3d-b9bc-4a48e7e1362f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.217619 May 03 09:15:36.071157 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 705/1580] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:15:35 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:15:37.083476 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-4deb6e65-407a-4ad6-8df6-90cdaa9849d1 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:37.084411 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-4deb6e65-407a-4ad6-8df6-90cdaa9849d1 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:37.090863 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-06a2bc71-1411-4d4d-a7f3-2fcf5983b118 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:37.091667 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-06a2bc71-1411-4d4d-a7f3-2fcf5983b118 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:37.093181 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4deb6e65-407a-4ad6-8df6-90cdaa9849d1 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:37.094238 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4deb6e65-407a-4ad6-8df6-90cdaa9849d1 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:37.094872 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4deb6e65-407a-4ad6-8df6-90cdaa9849d1 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:37.095308 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4deb6e65-407a-4ad6-8df6-90cdaa9849d1 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:37.099192 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-06a2bc71-1411-4d4d-a7f3-2fcf5983b118 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:37.099637 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-06a2bc71-1411-4d4d-a7f3-2fcf5983b118 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:37.100496 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-06a2bc71-1411-4d4d-a7f3-2fcf5983b118 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:37.100937 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-06a2bc71-1411-4d4d-a7f3-2fcf5983b118 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:37.281736 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-4deb6e65-407a-4ad6-8df6-90cdaa9849d1 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:37.285804 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-06a2bc71-1411-4d4d-a7f3-2fcf5983b118 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:37.289782 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-4deb6e65-407a-4ad6-8df6-90cdaa9849d1 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.210991 May 03 09:15:37.290333 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 876/1581] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:15:37 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:15:37.294281 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-06a2bc71-1411-4d4d-a7f3-2fcf5983b118 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:37.295800 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-06a2bc71-1411-4d4d-a7f3-2fcf5983b118 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:37.296975 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-06a2bc71-1411-4d4d-a7f3-2fcf5983b118 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.211993 May 03 09:15:37.297545 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 706/1582] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:15:37 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:15:38.307023 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e9e1aa20-4720-4cd8-a936-0f0d5efc8b7b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:38.307540 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e9e1aa20-4720-4cd8-a936-0f0d5efc8b7b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:38.314452 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e9e1aa20-4720-4cd8-a936-0f0d5efc8b7b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:38.314906 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e9e1aa20-4720-4cd8-a936-0f0d5efc8b7b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:38.315682 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e9e1aa20-4720-4cd8-a936-0f0d5efc8b7b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:38.316154 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e9e1aa20-4720-4cd8-a936-0f0d5efc8b7b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:38.318772 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b95efee4-e2e6-4990-9eef-3f5d0bbc4361 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:38.319370 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b95efee4-e2e6-4990-9eef-3f5d0bbc4361 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:38.326044 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b95efee4-e2e6-4990-9eef-3f5d0bbc4361 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:38.326490 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b95efee4-e2e6-4990-9eef-3f5d0bbc4361 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:38.327248 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b95efee4-e2e6-4990-9eef-3f5d0bbc4361 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:38.327672 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b95efee4-e2e6-4990-9eef-3f5d0bbc4361 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:38.504308 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e9e1aa20-4720-4cd8-a936-0f0d5efc8b7b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:38.509575 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b95efee4-e2e6-4990-9eef-3f5d0bbc4361 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:38.515795 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e9e1aa20-4720-4cd8-a936-0f0d5efc8b7b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.212231 May 03 09:15:38.517272 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 877/1583] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:15:38 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:15:38.520410 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b95efee4-e2e6-4990-9eef-3f5d0bbc4361 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:38.521934 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b95efee4-e2e6-4990-9eef-3f5d0bbc4361 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:38.523092 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b95efee4-e2e6-4990-9eef-3f5d0bbc4361 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.208356 May 03 09:15:38.523658 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 707/1584] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:15:38 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:15:39.537094 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5b5a721c-d8e7-41f9-b1be-1e20b0d359d9 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:39.537979 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5b5a721c-d8e7-41f9-b1be-1e20b0d359d9 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:39.546566 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-753fe248-7160-4cb2-a88d-c866adb3cdda tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:39.547570 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-753fe248-7160-4cb2-a88d-c866adb3cdda tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:39.548665 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5b5a721c-d8e7-41f9-b1be-1e20b0d359d9 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:39.549429 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5b5a721c-d8e7-41f9-b1be-1e20b0d359d9 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:39.550702 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5b5a721c-d8e7-41f9-b1be-1e20b0d359d9 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:39.551425 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5b5a721c-d8e7-41f9-b1be-1e20b0d359d9 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:39.558026 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-753fe248-7160-4cb2-a88d-c866adb3cdda tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:39.558774 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-753fe248-7160-4cb2-a88d-c866adb3cdda tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:39.560201 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-753fe248-7160-4cb2-a88d-c866adb3cdda tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:39.560937 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-753fe248-7160-4cb2-a88d-c866adb3cdda tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:39.741488 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5b5a721c-d8e7-41f9-b1be-1e20b0d359d9 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:39.745329 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-753fe248-7160-4cb2-a88d-c866adb3cdda tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:39.749550 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5b5a721c-d8e7-41f9-b1be-1e20b0d359d9 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.219329 May 03 09:15:39.750143 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 878/1585] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:15:39 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:15:39.754160 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-753fe248-7160-4cb2-a88d-c866adb3cdda tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:39.755654 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-753fe248-7160-4cb2-a88d-c866adb3cdda tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:39.756856 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-753fe248-7160-4cb2-a88d-c866adb3cdda tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.216920 May 03 09:15:39.757391 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 708/1586] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:15:39 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:15:40.768681 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ee54515d-e4ad-445d-b9dd-c649d7a00b85 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:40.769275 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ee54515d-e4ad-445d-b9dd-c649d7a00b85 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:40.775307 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6cfc5398-92a4-4e68-a270-aab78b7baf37 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:40.775954 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6cfc5398-92a4-4e68-a270-aab78b7baf37 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:40.776282 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ee54515d-e4ad-445d-b9dd-c649d7a00b85 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:40.776779 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ee54515d-e4ad-445d-b9dd-c649d7a00b85 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:40.777616 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ee54515d-e4ad-445d-b9dd-c649d7a00b85 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:40.778159 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ee54515d-e4ad-445d-b9dd-c649d7a00b85 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:40.782628 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6cfc5398-92a4-4e68-a270-aab78b7baf37 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:40.783087 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6cfc5398-92a4-4e68-a270-aab78b7baf37 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:40.783849 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6cfc5398-92a4-4e68-a270-aab78b7baf37 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:40.784487 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6cfc5398-92a4-4e68-a270-aab78b7baf37 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:40.962548 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ee54515d-e4ad-445d-b9dd-c649d7a00b85 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:40.963587 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6cfc5398-92a4-4e68-a270-aab78b7baf37 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:40.972214 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ee54515d-e4ad-445d-b9dd-c649d7a00b85 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.208150 May 03 09:15:40.972793 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 879/1587] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:15:40 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:15:40.973360 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6cfc5398-92a4-4e68-a270-aab78b7baf37 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:40.974859 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6cfc5398-92a4-4e68-a270-aab78b7baf37 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:40.976082 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6cfc5398-92a4-4e68-a270-aab78b7baf37 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.204697 May 03 09:15:40.976667 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 709/1588] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:15:40 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:15:41.993620 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-04be29d7-0d3b-4340-a2aa-2c8607bf237b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:41.994634 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-04be29d7-0d3b-4340-a2aa-2c8607bf237b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:41.997193 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-306ee6a1-7f90-4dcf-be43-cb8ce04a5cb9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:41.998210 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-306ee6a1-7f90-4dcf-be43-cb8ce04a5cb9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:42.005289 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-04be29d7-0d3b-4340-a2aa-2c8607bf237b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:42.006040 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-04be29d7-0d3b-4340-a2aa-2c8607bf237b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:42.007273 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-04be29d7-0d3b-4340-a2aa-2c8607bf237b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:42.008136 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-04be29d7-0d3b-4340-a2aa-2c8607bf237b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:42.008768 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-306ee6a1-7f90-4dcf-be43-cb8ce04a5cb9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:42.009513 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-306ee6a1-7f90-4dcf-be43-cb8ce04a5cb9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:42.010780 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-306ee6a1-7f90-4dcf-be43-cb8ce04a5cb9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:42.011556 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-306ee6a1-7f90-4dcf-be43-cb8ce04a5cb9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:42.199715 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-04be29d7-0d3b-4340-a2aa-2c8607bf237b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:42.203513 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-306ee6a1-7f90-4dcf-be43-cb8ce04a5cb9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:42.208131 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-04be29d7-0d3b-4340-a2aa-2c8607bf237b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.221129 May 03 09:15:42.209010 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 880/1589] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:15:41 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:15:42.213942 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-306ee6a1-7f90-4dcf-be43-cb8ce04a5cb9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:42.215447 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-306ee6a1-7f90-4dcf-be43-cb8ce04a5cb9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:42.216651 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-306ee6a1-7f90-4dcf-be43-cb8ce04a5cb9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.225968 May 03 09:15:42.217224 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 710/1590] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:15:41 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:15:43.225737 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e16ac206-4641-4d95-ba3e-364b80438417 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:43.226346 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e16ac206-4641-4d95-ba3e-364b80438417 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:43.233113 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e16ac206-4641-4d95-ba3e-364b80438417 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:43.233555 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e16ac206-4641-4d95-ba3e-364b80438417 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:43.234320 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e16ac206-4641-4d95-ba3e-364b80438417 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:43.234604 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-02315aaf-62d8-455a-9e0e-763823e537fd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:43.235086 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e16ac206-4641-4d95-ba3e-364b80438417 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:43.235188 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-02315aaf-62d8-455a-9e0e-763823e537fd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:43.241807 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-02315aaf-62d8-455a-9e0e-763823e537fd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:43.242285 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-02315aaf-62d8-455a-9e0e-763823e537fd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:43.243072 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-02315aaf-62d8-455a-9e0e-763823e537fd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:43.243500 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-02315aaf-62d8-455a-9e0e-763823e537fd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:43.420387 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e16ac206-4641-4d95-ba3e-364b80438417 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:43.423603 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-02315aaf-62d8-455a-9e0e-763823e537fd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:43.429216 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e16ac206-4641-4d95-ba3e-364b80438417 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.207493 May 03 09:15:43.429834 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 881/1591] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:15:43 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:15:43.432668 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-02315aaf-62d8-455a-9e0e-763823e537fd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:43.434169 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-02315aaf-62d8-455a-9e0e-763823e537fd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:43.435355 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-02315aaf-62d8-455a-9e0e-763823e537fd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.204812 May 03 09:15:43.435924 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 711/1592] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:15:43 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:15:44.446558 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-7100d1c0-7b5a-48ea-9f72-927b5488d9b3 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:44.447168 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-7100d1c0-7b5a-48ea-9f72-927b5488d9b3 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:44.454058 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7100d1c0-7b5a-48ea-9f72-927b5488d9b3 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:44.454424 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-810b9ce4-8164-4aaf-9a93-6440946713a1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:44.454857 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7100d1c0-7b5a-48ea-9f72-927b5488d9b3 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:44.455183 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-810b9ce4-8164-4aaf-9a93-6440946713a1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:44.455358 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7100d1c0-7b5a-48ea-9f72-927b5488d9b3 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:44.455721 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7100d1c0-7b5a-48ea-9f72-927b5488d9b3 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:44.461912 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-810b9ce4-8164-4aaf-9a93-6440946713a1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:44.462371 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-810b9ce4-8164-4aaf-9a93-6440946713a1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:44.463140 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-810b9ce4-8164-4aaf-9a93-6440946713a1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:44.463567 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-810b9ce4-8164-4aaf-9a93-6440946713a1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:44.642057 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7100d1c0-7b5a-48ea-9f72-927b5488d9b3 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:44.648906 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-810b9ce4-8164-4aaf-9a93-6440946713a1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:44.650474 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-7100d1c0-7b5a-48ea-9f72-927b5488d9b3 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.207813 May 03 09:15:44.651061 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 882/1593] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:15:44 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:15:44.657500 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-810b9ce4-8164-4aaf-9a93-6440946713a1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:44.658984 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-810b9ce4-8164-4aaf-9a93-6440946713a1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:44.660202 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-810b9ce4-8164-4aaf-9a93-6440946713a1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.210579 May 03 09:15:44.660746 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 712/1594] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:15:44 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 09:15:45.670979 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d4c35941-7548-44f6-b76b-e93173021b91 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:45.672061 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d4c35941-7548-44f6-b76b-e93173021b91 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:45.678991 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d4c35941-7548-44f6-b76b-e93173021b91 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:45.679184 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5b56c844-17f2-4c6d-bcff-0df2e9e0e59f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:45.679620 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d4c35941-7548-44f6-b76b-e93173021b91 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:45.679909 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5b56c844-17f2-4c6d-bcff-0df2e9e0e59f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:45.680286 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d4c35941-7548-44f6-b76b-e93173021b91 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:45.680736 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d4c35941-7548-44f6-b76b-e93173021b91 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:45.686904 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5b56c844-17f2-4c6d-bcff-0df2e9e0e59f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:45.687390 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5b56c844-17f2-4c6d-bcff-0df2e9e0e59f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:45.688325 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5b56c844-17f2-4c6d-bcff-0df2e9e0e59f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:45.688785 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5b56c844-17f2-4c6d-bcff-0df2e9e0e59f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:45.864656 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d4c35941-7548-44f6-b76b-e93173021b91 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:45.872835 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5b56c844-17f2-4c6d-bcff-0df2e9e0e59f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:45.875313 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d4c35941-7548-44f6-b76b-e93173021b91 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.210397 May 03 09:15:45.876003 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 883/1595] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:15:45 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:15:45.885211 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5b56c844-17f2-4c6d-bcff-0df2e9e0e59f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:45.887499 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5b56c844-17f2-4c6d-bcff-0df2e9e0e59f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:45.889218 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5b56c844-17f2-4c6d-bcff-0df2e9e0e59f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.213968 May 03 09:15:45.889958 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 713/1596] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:15:45 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:15:46.901122 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f2f9b63d-4fff-47cb-8419-97f4defad790 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:46.902135 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f2f9b63d-4fff-47cb-8419-97f4defad790 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:46.909739 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-1bec9c39-d3f0-4c2d-ab63-852fea3aec65 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:46.910344 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-1bec9c39-d3f0-4c2d-ab63-852fea3aec65 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:46.910740 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f2f9b63d-4fff-47cb-8419-97f4defad790 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:46.911189 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f2f9b63d-4fff-47cb-8419-97f4defad790 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:46.911997 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f2f9b63d-4fff-47cb-8419-97f4defad790 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:46.912432 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f2f9b63d-4fff-47cb-8419-97f4defad790 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:46.916783 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1bec9c39-d3f0-4c2d-ab63-852fea3aec65 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:46.917233 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1bec9c39-d3f0-4c2d-ab63-852fea3aec65 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:46.917992 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1bec9c39-d3f0-4c2d-ab63-852fea3aec65 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:46.918422 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1bec9c39-d3f0-4c2d-ab63-852fea3aec65 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:47.098452 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f2f9b63d-4fff-47cb-8419-97f4defad790 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:47.102419 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-1bec9c39-d3f0-4c2d-ab63-852fea3aec65 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:47.107557 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f2f9b63d-4fff-47cb-8419-97f4defad790 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.213019 May 03 09:15:47.108155 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 884/1597] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:15:46 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:15:47.111828 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-1bec9c39-d3f0-4c2d-ab63-852fea3aec65 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:47.114094 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-1bec9c39-d3f0-4c2d-ab63-852fea3aec65 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:47.115921 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-1bec9c39-d3f0-4c2d-ab63-852fea3aec65 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.210983 May 03 09:15:47.116722 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 714/1598] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:15:46 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:15:48.129238 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-bf6f3df2-9793-4950-b7a7-647d3dd019cb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:48.129857 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-bf6f3df2-9793-4950-b7a7-647d3dd019cb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:48.137202 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-8a994ff3-cf34-41dd-b9c9-b23dd7919b3e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:48.137880 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-8a994ff3-cf34-41dd-b9c9-b23dd7919b3e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:48.138920 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bf6f3df2-9793-4950-b7a7-647d3dd019cb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:48.139512 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bf6f3df2-9793-4950-b7a7-647d3dd019cb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:48.140581 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bf6f3df2-9793-4950-b7a7-647d3dd019cb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:48.141066 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bf6f3df2-9793-4950-b7a7-647d3dd019cb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:48.145481 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8a994ff3-cf34-41dd-b9c9-b23dd7919b3e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:48.145929 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8a994ff3-cf34-41dd-b9c9-b23dd7919b3e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:48.146688 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8a994ff3-cf34-41dd-b9c9-b23dd7919b3e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:48.147132 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8a994ff3-cf34-41dd-b9c9-b23dd7919b3e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:48.338964 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-bf6f3df2-9793-4950-b7a7-647d3dd019cb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:48.342194 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-8a994ff3-cf34-41dd-b9c9-b23dd7919b3e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:48.347596 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-bf6f3df2-9793-4950-b7a7-647d3dd019cb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.223906 May 03 09:15:48.348232 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 885/1599] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:15:48 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:15:48.351585 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-8a994ff3-cf34-41dd-b9c9-b23dd7919b3e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:48.353113 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-8a994ff3-cf34-41dd-b9c9-b23dd7919b3e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:48.354271 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-8a994ff3-cf34-41dd-b9c9-b23dd7919b3e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.222815 May 03 09:15:48.354843 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 715/1600] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:15:48 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:15:49.364507 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9b027636-bc19-440a-951e-3f3d6b27acca tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:49.365099 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9b027636-bc19-440a-951e-3f3d6b27acca tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:49.371894 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9b027636-bc19-440a-951e-3f3d6b27acca tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:49.372346 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9b027636-bc19-440a-951e-3f3d6b27acca tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:49.372609 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d147033e-eff9-4994-b68f-24fc780ae4b8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:49.373178 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9b027636-bc19-440a-951e-3f3d6b27acca tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:49.373345 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d147033e-eff9-4994-b68f-24fc780ae4b8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:49.373610 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9b027636-bc19-440a-951e-3f3d6b27acca tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:49.379950 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d147033e-eff9-4994-b68f-24fc780ae4b8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:49.380413 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d147033e-eff9-4994-b68f-24fc780ae4b8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:49.381173 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d147033e-eff9-4994-b68f-24fc780ae4b8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:49.381604 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d147033e-eff9-4994-b68f-24fc780ae4b8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:49.558109 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9b027636-bc19-440a-951e-3f3d6b27acca tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:49.564880 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d147033e-eff9-4994-b68f-24fc780ae4b8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:49.566578 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9b027636-bc19-440a-951e-3f3d6b27acca tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.205993 May 03 09:15:49.567119 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 886/1601] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:15:49 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:15:49.573500 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d147033e-eff9-4994-b68f-24fc780ae4b8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:49.575004 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d147033e-eff9-4994-b68f-24fc780ae4b8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:49.576194 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d147033e-eff9-4994-b68f-24fc780ae4b8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.207461 May 03 09:15:49.576773 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 716/1602] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:15:49 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:15:50.583633 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b4c8e233-5418-49fb-95b2-066ec49ea051 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:50.584274 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b4c8e233-5418-49fb-95b2-066ec49ea051 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:50.591213 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b4c8e233-5418-49fb-95b2-066ec49ea051 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:50.591650 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b4c8e233-5418-49fb-95b2-066ec49ea051 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:50.592578 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b4c8e233-5418-49fb-95b2-066ec49ea051 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:50.593007 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b4c8e233-5418-49fb-95b2-066ec49ea051 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:50.595308 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6f12a556-a2bc-4f74-b888-42d4cdf62f7d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:50.596116 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6f12a556-a2bc-4f74-b888-42d4cdf62f7d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:50.602785 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6f12a556-a2bc-4f74-b888-42d4cdf62f7d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:50.603310 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6f12a556-a2bc-4f74-b888-42d4cdf62f7d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:50.604189 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6f12a556-a2bc-4f74-b888-42d4cdf62f7d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:50.604703 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6f12a556-a2bc-4f74-b888-42d4cdf62f7d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:50.873442 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b4c8e233-5418-49fb-95b2-066ec49ea051 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:50.881946 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b4c8e233-5418-49fb-95b2-066ec49ea051 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.302334 May 03 09:15:50.882527 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 887/1603] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:15:50 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:15:50.901573 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6f12a556-a2bc-4f74-b888-42d4cdf62f7d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:50.910897 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6f12a556-a2bc-4f74-b888-42d4cdf62f7d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:50.912441 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6f12a556-a2bc-4f74-b888-42d4cdf62f7d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:50.913611 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6f12a556-a2bc-4f74-b888-42d4cdf62f7d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.322899 May 03 09:15:50.914157 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 717/1604] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:15:50 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:15:51.898520 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f32bad17-365b-46b4-8dbe-4548bf550fbf tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:51.899140 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f32bad17-365b-46b4-8dbe-4548bf550fbf tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:51.905814 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f32bad17-365b-46b4-8dbe-4548bf550fbf tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:51.906260 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f32bad17-365b-46b4-8dbe-4548bf550fbf tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:51.907019 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f32bad17-365b-46b4-8dbe-4548bf550fbf tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:51.907448 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f32bad17-365b-46b4-8dbe-4548bf550fbf tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:51.932140 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-fa6b3a96-ec9e-4889-84d5-13de5288b1d9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:51.932694 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-fa6b3a96-ec9e-4889-84d5-13de5288b1d9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:51.939296 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fa6b3a96-ec9e-4889-84d5-13de5288b1d9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:51.940013 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fa6b3a96-ec9e-4889-84d5-13de5288b1d9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:51.940779 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fa6b3a96-ec9e-4889-84d5-13de5288b1d9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:51.941206 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fa6b3a96-ec9e-4889-84d5-13de5288b1d9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:52.084469 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f32bad17-365b-46b4-8dbe-4548bf550fbf tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:52.092448 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f32bad17-365b-46b4-8dbe-4548bf550fbf tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.197823 May 03 09:15:52.093027 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 888/1605] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:15:51 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:15:52.110582 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-fa6b3a96-ec9e-4889-84d5-13de5288b1d9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:52.119595 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-fa6b3a96-ec9e-4889-84d5-13de5288b1d9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:52.121121 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-fa6b3a96-ec9e-4889-84d5-13de5288b1d9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:52.122288 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-fa6b3a96-ec9e-4889-84d5-13de5288b1d9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.194173 May 03 09:15:52.122833 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 718/1606] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:15:51 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:15:53.113513 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-be8b17aa-b18e-4c53-9bc2-c937a7adf47b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:53.114527 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-be8b17aa-b18e-4c53-9bc2-c937a7adf47b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:53.125425 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-be8b17aa-b18e-4c53-9bc2-c937a7adf47b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:53.126076 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-be8b17aa-b18e-4c53-9bc2-c937a7adf47b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:53.127382 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-be8b17aa-b18e-4c53-9bc2-c937a7adf47b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:53.127815 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-be8b17aa-b18e-4c53-9bc2-c937a7adf47b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:53.139793 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ef9dfcae-0763-4065-b81b-e6ccd65be789 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:53.140461 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ef9dfcae-0763-4065-b81b-e6ccd65be789 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:53.147129 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ef9dfcae-0763-4065-b81b-e6ccd65be789 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:53.147581 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ef9dfcae-0763-4065-b81b-e6ccd65be789 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:53.148385 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ef9dfcae-0763-4065-b81b-e6ccd65be789 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:53.148814 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ef9dfcae-0763-4065-b81b-e6ccd65be789 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:53.570453 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-be8b17aa-b18e-4c53-9bc2-c937a7adf47b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:53.579077 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-be8b17aa-b18e-4c53-9bc2-c937a7adf47b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.472186 May 03 09:15:53.579655 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 889/1607] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:15:53 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:15:53.593958 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ef9dfcae-0763-4065-b81b-e6ccd65be789 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:53.606700 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ef9dfcae-0763-4065-b81b-e6ccd65be789 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:53.609068 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ef9dfcae-0763-4065-b81b-e6ccd65be789 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:53.610814 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ef9dfcae-0763-4065-b81b-e6ccd65be789 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.474632 May 03 09:15:53.611664 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 719/1608] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:15:53 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:15:54.596736 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-cf9cac99-e33d-42f9-b6cb-9eb44b875fd4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:54.597403 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-cf9cac99-e33d-42f9-b6cb-9eb44b875fd4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:54.604270 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cf9cac99-e33d-42f9-b6cb-9eb44b875fd4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:54.604713 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cf9cac99-e33d-42f9-b6cb-9eb44b875fd4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:54.605472 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cf9cac99-e33d-42f9-b6cb-9eb44b875fd4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:54.605901 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cf9cac99-e33d-42f9-b6cb-9eb44b875fd4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:54.629613 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6f146d72-ae72-4aaf-b2dd-9746c0dd442b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:54.630184 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6f146d72-ae72-4aaf-b2dd-9746c0dd442b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:54.636716 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6f146d72-ae72-4aaf-b2dd-9746c0dd442b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:54.637162 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6f146d72-ae72-4aaf-b2dd-9746c0dd442b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:54.637894 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6f146d72-ae72-4aaf-b2dd-9746c0dd442b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:54.638351 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6f146d72-ae72-4aaf-b2dd-9746c0dd442b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:54.794448 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-cf9cac99-e33d-42f9-b6cb-9eb44b875fd4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:54.802673 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-cf9cac99-e33d-42f9-b6cb-9eb44b875fd4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.210169 May 03 09:15:54.803368 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 890/1609] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:15:54 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:15:54.805496 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6f146d72-ae72-4aaf-b2dd-9746c0dd442b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:54.814124 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6f146d72-ae72-4aaf-b2dd-9746c0dd442b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:54.815721 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6f146d72-ae72-4aaf-b2dd-9746c0dd442b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:54.816918 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6f146d72-ae72-4aaf-b2dd-9746c0dd442b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.191290 May 03 09:15:54.817453 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 720/1610] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:15:54 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:15:55.825246 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-72dc5bd2-52b3-4afd-9567-7f4986feb1ab tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:55.826153 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-72dc5bd2-52b3-4afd-9567-7f4986feb1ab tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:55.834292 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-72dc5bd2-52b3-4afd-9567-7f4986feb1ab tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:55.834738 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-72dc5bd2-52b3-4afd-9567-7f4986feb1ab tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:55.835519 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-72dc5bd2-52b3-4afd-9567-7f4986feb1ab tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:55.835983 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-72dc5bd2-52b3-4afd-9567-7f4986feb1ab tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:55.836560 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-394195f8-5f02-469b-8e9d-668a2f04b27c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:55.837251 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-394195f8-5f02-469b-8e9d-668a2f04b27c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:55.844189 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-394195f8-5f02-469b-8e9d-668a2f04b27c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:55.844743 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-394195f8-5f02-469b-8e9d-668a2f04b27c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:55.845613 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-394195f8-5f02-469b-8e9d-668a2f04b27c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:55.846147 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-394195f8-5f02-469b-8e9d-668a2f04b27c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:56.021915 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-72dc5bd2-52b3-4afd-9567-7f4986feb1ab tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:56.025836 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-394195f8-5f02-469b-8e9d-668a2f04b27c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:56.030019 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-72dc5bd2-52b3-4afd-9567-7f4986feb1ab tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.211644 May 03 09:15:56.030576 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 891/1611] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:15:55 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:15:56.034583 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-394195f8-5f02-469b-8e9d-668a2f04b27c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:56.036112 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-394195f8-5f02-469b-8e9d-668a2f04b27c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:56.037291 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-394195f8-5f02-469b-8e9d-668a2f04b27c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.205244 May 03 09:15:56.037807 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 721/1612] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:15:55 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:15:57.050717 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c3564a91-13cc-4026-91b6-488ee736c2e4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:57.051708 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c3564a91-13cc-4026-91b6-488ee736c2e4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:57.063715 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-165822ab-5bca-495b-bbbc-29ebcb4f5df4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:57.064760 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-165822ab-5bca-495b-bbbc-29ebcb4f5df4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:57.068018 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c3564a91-13cc-4026-91b6-488ee736c2e4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:57.068477 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c3564a91-13cc-4026-91b6-488ee736c2e4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:57.069275 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c3564a91-13cc-4026-91b6-488ee736c2e4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:57.069710 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c3564a91-13cc-4026-91b6-488ee736c2e4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:57.073708 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-165822ab-5bca-495b-bbbc-29ebcb4f5df4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:57.074170 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-165822ab-5bca-495b-bbbc-29ebcb4f5df4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:57.074931 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-165822ab-5bca-495b-bbbc-29ebcb4f5df4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:57.075377 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-165822ab-5bca-495b-bbbc-29ebcb4f5df4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:57.263922 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c3564a91-13cc-4026-91b6-488ee736c2e4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:57.267309 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-165822ab-5bca-495b-bbbc-29ebcb4f5df4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:57.272238 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c3564a91-13cc-4026-91b6-488ee736c2e4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.228109 May 03 09:15:57.272816 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 892/1613] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:15:57 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:15:57.276233 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-165822ab-5bca-495b-bbbc-29ebcb4f5df4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:57.277736 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-165822ab-5bca-495b-bbbc-29ebcb4f5df4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:57.278902 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-165822ab-5bca-495b-bbbc-29ebcb4f5df4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.221796 May 03 09:15:57.279437 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 722/1614] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:15:57 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:15:58.294001 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-6cbaea64-1d38-491d-843a-aea61940078f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:58.295180 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-6cbaea64-1d38-491d-843a-aea61940078f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:58.301325 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-85f68697-6f82-4bca-bb84-972a7618a12a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:58.301937 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-85f68697-6f82-4bca-bb84-972a7618a12a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:58.304180 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6cbaea64-1d38-491d-843a-aea61940078f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:58.304652 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6cbaea64-1d38-491d-843a-aea61940078f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:58.305492 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6cbaea64-1d38-491d-843a-aea61940078f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:58.305911 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6cbaea64-1d38-491d-843a-aea61940078f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:58.308557 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-85f68697-6f82-4bca-bb84-972a7618a12a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:58.309012 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-85f68697-6f82-4bca-bb84-972a7618a12a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:58.309782 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-85f68697-6f82-4bca-bb84-972a7618a12a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:58.310209 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-85f68697-6f82-4bca-bb84-972a7618a12a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:58.491815 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-6cbaea64-1d38-491d-843a-aea61940078f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:58.495782 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-85f68697-6f82-4bca-bb84-972a7618a12a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:58.499813 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-6cbaea64-1d38-491d-843a-aea61940078f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.212832 May 03 09:15:58.500386 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 893/1615] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:15:58 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:15:58.504382 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-85f68697-6f82-4bca-bb84-972a7618a12a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:58.505900 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-85f68697-6f82-4bca-bb84-972a7618a12a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:58.507062 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-85f68697-6f82-4bca-bb84-972a7618a12a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.212074 May 03 09:15:58.507596 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 723/1616] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:15:58 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:15:59.521603 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-dc2858a7-fc3c-4828-b079-052eecf2961c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:59.522603 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-dc2858a7-fc3c-4828-b079-052eecf2961c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:59.529662 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-85574274-655e-4798-9769-ba56e48976c6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:15:59.530689 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-85574274-655e-4798-9769-ba56e48976c6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:15:59.533084 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dc2858a7-fc3c-4828-b079-052eecf2961c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:59.533832 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dc2858a7-fc3c-4828-b079-052eecf2961c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:59.535317 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dc2858a7-fc3c-4828-b079-052eecf2961c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:59.535963 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dc2858a7-fc3c-4828-b079-052eecf2961c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:59.541572 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-85574274-655e-4798-9769-ba56e48976c6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:59.542323 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-85574274-655e-4798-9769-ba56e48976c6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:59.543593 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-85574274-655e-4798-9769-ba56e48976c6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:15:59.544362 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-85574274-655e-4798-9769-ba56e48976c6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:15:59.730348 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-dc2858a7-fc3c-4828-b079-052eecf2961c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:59.733409 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-85574274-655e-4798-9769-ba56e48976c6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:59.740350 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-dc2858a7-fc3c-4828-b079-052eecf2961c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.225406 May 03 09:15:59.747833 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 894/1617] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:15:59 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:15:59.748081 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-85574274-655e-4798-9769-ba56e48976c6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:59.748081 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-85574274-655e-4798-9769-ba56e48976c6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:15:59.748081 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-85574274-655e-4798-9769-ba56e48976c6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.224775 May 03 09:15:59.748600 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 724/1618] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:15:59 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:16:00.762382 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ae0db0c6-07c3-4c7b-bbec-719f111d4813 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:00.763237 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ae0db0c6-07c3-4c7b-bbec-719f111d4813 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:00.770196 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-505b8cbb-c2a0-40eb-9954-26f779b8170c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:00.771346 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-505b8cbb-c2a0-40eb-9954-26f779b8170c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:00.773498 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ae0db0c6-07c3-4c7b-bbec-719f111d4813 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:00.774238 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ae0db0c6-07c3-4c7b-bbec-719f111d4813 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:00.775493 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ae0db0c6-07c3-4c7b-bbec-719f111d4813 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:00.776253 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ae0db0c6-07c3-4c7b-bbec-719f111d4813 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:00.781696 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-505b8cbb-c2a0-40eb-9954-26f779b8170c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:00.782442 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-505b8cbb-c2a0-40eb-9954-26f779b8170c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:00.783660 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-505b8cbb-c2a0-40eb-9954-26f779b8170c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:00.784540 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-505b8cbb-c2a0-40eb-9954-26f779b8170c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:00.970689 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ae0db0c6-07c3-4c7b-bbec-719f111d4813 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:00.974114 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-505b8cbb-c2a0-40eb-9954-26f779b8170c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:00.978812 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ae0db0c6-07c3-4c7b-bbec-719f111d4813 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.223730 May 03 09:16:00.979681 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 895/1619] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:00 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:00.982568 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-505b8cbb-c2a0-40eb-9954-26f779b8170c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:00.984178 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-505b8cbb-c2a0-40eb-9954-26f779b8170c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:00.985351 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-505b8cbb-c2a0-40eb-9954-26f779b8170c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.221745 May 03 09:16:00.985892 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 725/1620] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:16:00 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:16:01.995671 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-8e9e3371-cbf1-4cec-90ec-a1880c74373d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:01.996322 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-8e9e3371-cbf1-4cec-90ec-a1880c74373d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:02.002546 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b947cd4d-b1d1-452e-9171-b83c05291b4a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:02.003018 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8e9e3371-cbf1-4cec-90ec-a1880c74373d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:02.003249 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8e9e3371-cbf1-4cec-90ec-a1880c74373d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:02.003403 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b947cd4d-b1d1-452e-9171-b83c05291b4a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:02.004038 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8e9e3371-cbf1-4cec-90ec-a1880c74373d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:02.004464 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8e9e3371-cbf1-4cec-90ec-a1880c74373d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:02.009918 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b947cd4d-b1d1-452e-9171-b83c05291b4a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:02.010440 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b947cd4d-b1d1-452e-9171-b83c05291b4a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:02.011279 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b947cd4d-b1d1-452e-9171-b83c05291b4a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:02.011798 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b947cd4d-b1d1-452e-9171-b83c05291b4a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:02.188765 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-8e9e3371-cbf1-4cec-90ec-a1880c74373d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:02.196280 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b947cd4d-b1d1-452e-9171-b83c05291b4a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:02.197462 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-8e9e3371-cbf1-4cec-90ec-a1880c74373d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.205844 May 03 09:16:02.198053 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 896/1621] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:01 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:02.205090 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b947cd4d-b1d1-452e-9171-b83c05291b4a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:02.206738 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b947cd4d-b1d1-452e-9171-b83c05291b4a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:02.207956 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b947cd4d-b1d1-452e-9171-b83c05291b4a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.209245 May 03 09:16:02.208478 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 726/1622] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:16:01 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:16:03.216389 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-6d452bb5-d3b7-436f-9e76-2e182e245c06 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:03.217313 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-6d452bb5-d3b7-436f-9e76-2e182e245c06 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:03.225759 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6d452bb5-d3b7-436f-9e76-2e182e245c06 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:03.226202 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6d452bb5-d3b7-436f-9e76-2e182e245c06 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:03.226970 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6d452bb5-d3b7-436f-9e76-2e182e245c06 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:03.227396 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6d452bb5-d3b7-436f-9e76-2e182e245c06 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:03.229187 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-cfabcbad-6639-439c-8a2a-2e85010c2289 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:03.230046 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-cfabcbad-6639-439c-8a2a-2e85010c2289 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:03.237053 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cfabcbad-6639-439c-8a2a-2e85010c2289 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:03.237549 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cfabcbad-6639-439c-8a2a-2e85010c2289 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:03.238328 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cfabcbad-6639-439c-8a2a-2e85010c2289 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:03.238759 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cfabcbad-6639-439c-8a2a-2e85010c2289 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:03.414728 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-6d452bb5-d3b7-436f-9e76-2e182e245c06 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:03.419208 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-cfabcbad-6639-439c-8a2a-2e85010c2289 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:03.425819 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-6d452bb5-d3b7-436f-9e76-2e182e245c06 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.215102 May 03 09:16:03.426396 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 897/1623] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:03 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:03.429304 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-cfabcbad-6639-439c-8a2a-2e85010c2289 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:03.430798 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-cfabcbad-6639-439c-8a2a-2e85010c2289 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:03.432010 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-cfabcbad-6639-439c-8a2a-2e85010c2289 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.206799 May 03 09:16:03.432552 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 727/1624] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:16:03 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:16:04.453822 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4c88e839-2eec-4bc0-9985-00efeb19223b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:04.454906 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4c88e839-2eec-4bc0-9985-00efeb19223b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:04.465666 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4c88e839-2eec-4bc0-9985-00efeb19223b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:04.466308 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4c88e839-2eec-4bc0-9985-00efeb19223b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:04.467588 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4c88e839-2eec-4bc0-9985-00efeb19223b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:04.468757 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4c88e839-2eec-4bc0-9985-00efeb19223b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:04.619426 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-4c88e839-2eec-4bc0-9985-00efeb19223b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:04.627658 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-4c88e839-2eec-4bc0-9985-00efeb19223b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:04.629556 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-4c88e839-2eec-4bc0-9985-00efeb19223b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:04.630824 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-4c88e839-2eec-4bc0-9985-00efeb19223b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.183646 May 03 09:16:04.631580 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 728/1625] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:16:04 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:16:04.701630 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5c3dc176-36d7-4460-9929-1980ba8b447c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:04.702255 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5c3dc176-36d7-4460-9929-1980ba8b447c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:04.708146 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5c3dc176-36d7-4460-9929-1980ba8b447c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:04.708589 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5c3dc176-36d7-4460-9929-1980ba8b447c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:04.709344 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5c3dc176-36d7-4460-9929-1980ba8b447c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:04.709776 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5c3dc176-36d7-4460-9929-1980ba8b447c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:04.845910 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5c3dc176-36d7-4460-9929-1980ba8b447c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:04.853887 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5c3dc176-36d7-4460-9929-1980ba8b447c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.412346 May 03 09:16:04.854430 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 898/1626] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:04 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:05.654004 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5889c1e9-94b4-4293-bcac-30d566b3f9c8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:05.655006 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5889c1e9-94b4-4293-bcac-30d566b3f9c8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:05.665985 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5889c1e9-94b4-4293-bcac-30d566b3f9c8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:05.666760 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5889c1e9-94b4-4293-bcac-30d566b3f9c8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:05.668177 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5889c1e9-94b4-4293-bcac-30d566b3f9c8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:05.668887 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5889c1e9-94b4-4293-bcac-30d566b3f9c8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:05.804656 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5889c1e9-94b4-4293-bcac-30d566b3f9c8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:05.813364 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5889c1e9-94b4-4293-bcac-30d566b3f9c8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:05.814843 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5889c1e9-94b4-4293-bcac-30d566b3f9c8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:05.816049 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5889c1e9-94b4-4293-bcac-30d566b3f9c8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.168848 May 03 09:16:05.816676 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 729/1627] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:16:05 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:16:05.874301 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-8d749af7-ccce-42b6-9a17-825f1f344a93 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:05.875185 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-8d749af7-ccce-42b6-9a17-825f1f344a93 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:05.883249 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8d749af7-ccce-42b6-9a17-825f1f344a93 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:05.883704 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8d749af7-ccce-42b6-9a17-825f1f344a93 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:05.884510 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8d749af7-ccce-42b6-9a17-825f1f344a93 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:05.884940 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8d749af7-ccce-42b6-9a17-825f1f344a93 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:06.024013 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-8d749af7-ccce-42b6-9a17-825f1f344a93 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:06.032387 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-8d749af7-ccce-42b6-9a17-825f1f344a93 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.164279 May 03 09:16:06.032969 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 899/1628] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:05 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:06.834768 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ccf430d0-2628-4fe2-ae7d-50905257013e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:06.835388 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ccf430d0-2628-4fe2-ae7d-50905257013e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:06.842182 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ccf430d0-2628-4fe2-ae7d-50905257013e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:06.842631 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ccf430d0-2628-4fe2-ae7d-50905257013e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:06.843806 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ccf430d0-2628-4fe2-ae7d-50905257013e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:06.844254 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ccf430d0-2628-4fe2-ae7d-50905257013e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:06.980314 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ccf430d0-2628-4fe2-ae7d-50905257013e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:06.989464 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ccf430d0-2628-4fe2-ae7d-50905257013e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:06.990971 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ccf430d0-2628-4fe2-ae7d-50905257013e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:06.992199 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ccf430d0-2628-4fe2-ae7d-50905257013e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.161358 May 03 09:16:06.992768 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 730/1629] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:16:06 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:16:07.049982 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-7960b0e2-16ca-47a9-aeba-d7aea7b1c74f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:07.050503 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-7960b0e2-16ca-47a9-aeba-d7aea7b1c74f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:07.057405 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7960b0e2-16ca-47a9-aeba-d7aea7b1c74f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:07.057857 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7960b0e2-16ca-47a9-aeba-d7aea7b1c74f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:07.058626 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7960b0e2-16ca-47a9-aeba-d7aea7b1c74f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:07.059055 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7960b0e2-16ca-47a9-aeba-d7aea7b1c74f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:07.192509 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7960b0e2-16ca-47a9-aeba-d7aea7b1c74f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:07.201057 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-7960b0e2-16ca-47a9-aeba-d7aea7b1c74f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.155061 May 03 09:16:07.201617 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 900/1630] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:07 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:08.020761 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a6bdffb2-f8cf-4cf2-80a4-8a999f222029 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:08.021757 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a6bdffb2-f8cf-4cf2-80a4-8a999f222029 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:08.029982 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a6bdffb2-f8cf-4cf2-80a4-8a999f222029 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:08.030538 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a6bdffb2-f8cf-4cf2-80a4-8a999f222029 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:08.031475 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a6bdffb2-f8cf-4cf2-80a4-8a999f222029 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:08.032067 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a6bdffb2-f8cf-4cf2-80a4-8a999f222029 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:08.163516 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a6bdffb2-f8cf-4cf2-80a4-8a999f222029 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:08.172283 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a6bdffb2-f8cf-4cf2-80a4-8a999f222029 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:08.173756 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a6bdffb2-f8cf-4cf2-80a4-8a999f222029 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:08.174919 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a6bdffb2-f8cf-4cf2-80a4-8a999f222029 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.160652 May 03 09:16:08.175474 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 731/1631] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:16:08 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:16:08.218869 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-fdb284d0-912a-4628-b249-310f2061a2d7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:08.219485 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-fdb284d0-912a-4628-b249-310f2061a2d7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:08.226270 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fdb284d0-912a-4628-b249-310f2061a2d7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:08.226711 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fdb284d0-912a-4628-b249-310f2061a2d7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:08.227460 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fdb284d0-912a-4628-b249-310f2061a2d7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:08.227925 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fdb284d0-912a-4628-b249-310f2061a2d7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:08.365195 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-fdb284d0-912a-4628-b249-310f2061a2d7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:08.376352 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-fdb284d0-912a-4628-b249-310f2061a2d7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.161465 May 03 09:16:08.377141 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 901/1632] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:08 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:09.197426 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6e29d3af-d488-48ca-a666-5c13a8d323e4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:09.198378 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6e29d3af-d488-48ca-a666-5c13a8d323e4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:09.209123 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6e29d3af-d488-48ca-a666-5c13a8d323e4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:09.209563 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6e29d3af-d488-48ca-a666-5c13a8d323e4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:09.210329 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6e29d3af-d488-48ca-a666-5c13a8d323e4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:09.210755 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6e29d3af-d488-48ca-a666-5c13a8d323e4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:09.338700 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6e29d3af-d488-48ca-a666-5c13a8d323e4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:09.347459 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6e29d3af-d488-48ca-a666-5c13a8d323e4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:09.349004 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6e29d3af-d488-48ca-a666-5c13a8d323e4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:09.350197 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6e29d3af-d488-48ca-a666-5c13a8d323e4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.159490 May 03 09:16:09.350757 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 732/1633] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:16:09 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:16:09.394699 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-15888af1-d1af-4e9a-879f-fc6b048cf65c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:09.395316 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-15888af1-d1af-4e9a-879f-fc6b048cf65c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:09.402263 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-15888af1-d1af-4e9a-879f-fc6b048cf65c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:09.402795 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-15888af1-d1af-4e9a-879f-fc6b048cf65c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:09.403657 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-15888af1-d1af-4e9a-879f-fc6b048cf65c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:09.404213 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-15888af1-d1af-4e9a-879f-fc6b048cf65c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:09.535386 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-15888af1-d1af-4e9a-879f-fc6b048cf65c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:09.543595 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-15888af1-d1af-4e9a-879f-fc6b048cf65c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.152894 May 03 09:16:09.544343 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 902/1634] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:09 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:10.372802 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-afc535cb-a23b-4c24-a0cc-4e9c97ef7623 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:10.373768 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-afc535cb-a23b-4c24-a0cc-4e9c97ef7623 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:10.383047 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-afc535cb-a23b-4c24-a0cc-4e9c97ef7623 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:10.383492 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-afc535cb-a23b-4c24-a0cc-4e9c97ef7623 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:10.384278 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-afc535cb-a23b-4c24-a0cc-4e9c97ef7623 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:10.384710 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-afc535cb-a23b-4c24-a0cc-4e9c97ef7623 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:10.522544 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-afc535cb-a23b-4c24-a0cc-4e9c97ef7623 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:10.531262 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-afc535cb-a23b-4c24-a0cc-4e9c97ef7623 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:10.532775 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-afc535cb-a23b-4c24-a0cc-4e9c97ef7623 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:10.533935 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-afc535cb-a23b-4c24-a0cc-4e9c97ef7623 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.167742 May 03 09:16:10.534484 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 733/1635] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:16:10 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:16:10.560687 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3505d2ce-2aa5-4f75-8892-6922a6780b09 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:10.561297 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-3505d2ce-2aa5-4f75-8892-6922a6780b09 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:10.567790 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3505d2ce-2aa5-4f75-8892-6922a6780b09 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:10.568292 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3505d2ce-2aa5-4f75-8892-6922a6780b09 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:10.569101 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3505d2ce-2aa5-4f75-8892-6922a6780b09 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:10.569536 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3505d2ce-2aa5-4f75-8892-6922a6780b09 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:10.699483 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-3505d2ce-2aa5-4f75-8892-6922a6780b09 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:10.712263 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-3505d2ce-2aa5-4f75-8892-6922a6780b09 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.155141 May 03 09:16:10.713290 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 903/1636] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:10 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:11.556859 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6cabc30d-b7b1-4b7b-8cc7-80b855d5b126 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:11.557701 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6cabc30d-b7b1-4b7b-8cc7-80b855d5b126 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:11.568871 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6cabc30d-b7b1-4b7b-8cc7-80b855d5b126 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:11.569647 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6cabc30d-b7b1-4b7b-8cc7-80b855d5b126 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:11.570898 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6cabc30d-b7b1-4b7b-8cc7-80b855d5b126 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:11.571612 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6cabc30d-b7b1-4b7b-8cc7-80b855d5b126 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:11.711266 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6cabc30d-b7b1-4b7b-8cc7-80b855d5b126 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:11.720383 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6cabc30d-b7b1-4b7b-8cc7-80b855d5b126 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:11.721891 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6cabc30d-b7b1-4b7b-8cc7-80b855d5b126 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:11.723064 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6cabc30d-b7b1-4b7b-8cc7-80b855d5b126 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.172977 May 03 09:16:11.723626 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 734/1637] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:16:11 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:16:11.731796 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-0c316128-0d14-4526-9ff5-5ca8a2ed3b92 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:11.732395 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-0c316128-0d14-4526-9ff5-5ca8a2ed3b92 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:11.738903 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0c316128-0d14-4526-9ff5-5ca8a2ed3b92 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:11.739350 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0c316128-0d14-4526-9ff5-5ca8a2ed3b92 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:11.740314 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0c316128-0d14-4526-9ff5-5ca8a2ed3b92 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:11.740749 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0c316128-0d14-4526-9ff5-5ca8a2ed3b92 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:11.867300 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-0c316128-0d14-4526-9ff5-5ca8a2ed3b92 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:11.875606 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-0c316128-0d14-4526-9ff5-5ca8a2ed3b92 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.147666 May 03 09:16:11.876215 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 904/1638] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:11 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:12.743679 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2b58a7df-4224-44b0-ba2a-a178d5bf4dee tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:12.744348 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-2b58a7df-4224-44b0-ba2a-a178d5bf4dee tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:12.753720 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2b58a7df-4224-44b0-ba2a-a178d5bf4dee tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:12.754255 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2b58a7df-4224-44b0-ba2a-a178d5bf4dee tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:12.755548 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2b58a7df-4224-44b0-ba2a-a178d5bf4dee tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:12.756003 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2b58a7df-4224-44b0-ba2a-a178d5bf4dee tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:12.893220 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f0cd8774-72eb-44dd-8350-62b29c5e1e77 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:12.893817 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f0cd8774-72eb-44dd-8350-62b29c5e1e77 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:12.897663 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2b58a7df-4224-44b0-ba2a-a178d5bf4dee tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:12.900042 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f0cd8774-72eb-44dd-8350-62b29c5e1e77 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:12.900493 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f0cd8774-72eb-44dd-8350-62b29c5e1e77 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:12.901271 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f0cd8774-72eb-44dd-8350-62b29c5e1e77 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:12.901710 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f0cd8774-72eb-44dd-8350-62b29c5e1e77 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:12.906083 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2b58a7df-4224-44b0-ba2a-a178d5bf4dee tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:12.907529 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2b58a7df-4224-44b0-ba2a-a178d5bf4dee tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:12.908714 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-2b58a7df-4224-44b0-ba2a-a178d5bf4dee tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.170266 May 03 09:16:12.909298 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 735/1639] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:16:12 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:16:13.032143 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f0cd8774-72eb-44dd-8350-62b29c5e1e77 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:13.044064 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f0cd8774-72eb-44dd-8350-62b29c5e1e77 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.154461 May 03 09:16:13.044845 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 905/1640] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:12 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:13.931328 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-fae37920-59ef-46ce-aa40-a7515dd62f09 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:13.932348 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-fae37920-59ef-46ce-aa40-a7515dd62f09 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:13.942984 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fae37920-59ef-46ce-aa40-a7515dd62f09 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:13.943729 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fae37920-59ef-46ce-aa40-a7515dd62f09 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:13.945048 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fae37920-59ef-46ce-aa40-a7515dd62f09 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:13.945765 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fae37920-59ef-46ce-aa40-a7515dd62f09 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:14.064328 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-798e3055-2d63-437d-b726-a009e5aebbca tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:14.065064 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-798e3055-2d63-437d-b726-a009e5aebbca tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:14.072711 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-798e3055-2d63-437d-b726-a009e5aebbca tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:14.073159 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-798e3055-2d63-437d-b726-a009e5aebbca tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:14.073929 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-798e3055-2d63-437d-b726-a009e5aebbca tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:14.074342 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-798e3055-2d63-437d-b726-a009e5aebbca tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:14.094260 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-fae37920-59ef-46ce-aa40-a7515dd62f09 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:14.104398 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-fae37920-59ef-46ce-aa40-a7515dd62f09 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:14.105913 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-fae37920-59ef-46ce-aa40-a7515dd62f09 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:14.107100 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-fae37920-59ef-46ce-aa40-a7515dd62f09 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.182508 May 03 09:16:14.107701 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 736/1641] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:16:13 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:16:14.201723 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-798e3055-2d63-437d-b726-a009e5aebbca tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:14.210072 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-798e3055-2d63-437d-b726-a009e5aebbca tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.151837 May 03 09:16:14.210627 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 906/1642] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:14 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:15.129861 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0a9f0efa-4f45-4e59-98a5-b3849b5f737f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:15.130752 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0a9f0efa-4f45-4e59-98a5-b3849b5f737f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:15.139436 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0a9f0efa-4f45-4e59-98a5-b3849b5f737f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:15.140270 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0a9f0efa-4f45-4e59-98a5-b3849b5f737f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:15.141296 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0a9f0efa-4f45-4e59-98a5-b3849b5f737f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:15.141877 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0a9f0efa-4f45-4e59-98a5-b3849b5f737f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:15.229330 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-44a8f014-159a-441a-a63c-76c9f724a0a6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:15.230052 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-44a8f014-159a-441a-a63c-76c9f724a0a6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:15.238136 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-44a8f014-159a-441a-a63c-76c9f724a0a6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:15.238611 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-44a8f014-159a-441a-a63c-76c9f724a0a6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:15.239373 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-44a8f014-159a-441a-a63c-76c9f724a0a6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:15.239877 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-44a8f014-159a-441a-a63c-76c9f724a0a6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:15.296743 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0a9f0efa-4f45-4e59-98a5-b3849b5f737f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:15.305630 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0a9f0efa-4f45-4e59-98a5-b3849b5f737f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:15.307345 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0a9f0efa-4f45-4e59-98a5-b3849b5f737f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:15.308550 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0a9f0efa-4f45-4e59-98a5-b3849b5f737f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.185509 May 03 09:16:15.316041 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 737/1643] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:16:15 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:16:15.397702 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-44a8f014-159a-441a-a63c-76c9f724a0a6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:15.405966 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-44a8f014-159a-441a-a63c-76c9f724a0a6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.181026 May 03 09:16:15.406559 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 907/1644] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:15 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:16.326609 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d7cabd14-f796-4664-8734-a85fa5a426a8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:16.327197 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d7cabd14-f796-4664-8734-a85fa5a426a8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:16.333745 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d7cabd14-f796-4664-8734-a85fa5a426a8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:16.334192 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d7cabd14-f796-4664-8734-a85fa5a426a8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:16.334960 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d7cabd14-f796-4664-8734-a85fa5a426a8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:16.335394 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d7cabd14-f796-4664-8734-a85fa5a426a8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:16.422461 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-4b52ca1a-ec16-4201-9df9-596b158ceb3d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:16.423077 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-4b52ca1a-ec16-4201-9df9-596b158ceb3d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:16.429380 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4b52ca1a-ec16-4201-9df9-596b158ceb3d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:16.429827 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4b52ca1a-ec16-4201-9df9-596b158ceb3d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:16.430590 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4b52ca1a-ec16-4201-9df9-596b158ceb3d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:16.431032 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4b52ca1a-ec16-4201-9df9-596b158ceb3d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:16.465101 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d7cabd14-f796-4664-8734-a85fa5a426a8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:16.473920 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d7cabd14-f796-4664-8734-a85fa5a426a8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:16.475538 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d7cabd14-f796-4664-8734-a85fa5a426a8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:16.476761 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d7cabd14-f796-4664-8734-a85fa5a426a8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.154163 May 03 09:16:16.477312 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 738/1645] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:16:16 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:16:16.566120 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-4b52ca1a-ec16-4201-9df9-596b158ceb3d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:16.574743 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-4b52ca1a-ec16-4201-9df9-596b158ceb3d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.156193 May 03 09:16:16.575317 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 908/1646] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:16 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:16:17.499068 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ca7e90b5-6fb4-4386-ae1e-0b84ee7b2f77 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:17.500107 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ca7e90b5-6fb4-4386-ae1e-0b84ee7b2f77 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:17.510659 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ca7e90b5-6fb4-4386-ae1e-0b84ee7b2f77 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:17.511393 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ca7e90b5-6fb4-4386-ae1e-0b84ee7b2f77 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:17.512757 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ca7e90b5-6fb4-4386-ae1e-0b84ee7b2f77 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:17.513465 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ca7e90b5-6fb4-4386-ae1e-0b84ee7b2f77 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:17.591944 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-465023a3-d370-4631-9d0a-c0cc50ecee31 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:17.592592 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-465023a3-d370-4631-9d0a-c0cc50ecee31 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:17.599749 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-465023a3-d370-4631-9d0a-c0cc50ecee31 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:17.600237 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-465023a3-d370-4631-9d0a-c0cc50ecee31 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:17.601003 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-465023a3-d370-4631-9d0a-c0cc50ecee31 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:17.601439 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-465023a3-d370-4631-9d0a-c0cc50ecee31 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:17.655506 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ca7e90b5-6fb4-4386-ae1e-0b84ee7b2f77 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:17.665389 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ca7e90b5-6fb4-4386-ae1e-0b84ee7b2f77 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:17.666905 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ca7e90b5-6fb4-4386-ae1e-0b84ee7b2f77 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:17.668101 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ca7e90b5-6fb4-4386-ae1e-0b84ee7b2f77 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.175523 May 03 09:16:17.668630 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 739/1647] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:16:17 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:16:17.745168 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-465023a3-d370-4631-9d0a-c0cc50ecee31 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:17.757427 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-465023a3-d370-4631-9d0a-c0cc50ecee31 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.169126 May 03 09:16:17.758146 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 909/1648] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:17 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:18.690743 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-15112ddc-f07f-4ce2-a089-bbaeb73993ac tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:18.691591 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-15112ddc-f07f-4ce2-a089-bbaeb73993ac tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:18.701740 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-15112ddc-f07f-4ce2-a089-bbaeb73993ac tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:18.702313 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-15112ddc-f07f-4ce2-a089-bbaeb73993ac tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:18.703464 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-15112ddc-f07f-4ce2-a089-bbaeb73993ac tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:18.704075 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-15112ddc-f07f-4ce2-a089-bbaeb73993ac tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:18.774768 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-8c581e65-c324-4c77-bf96-130ab03b542e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:18.775349 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-8c581e65-c324-4c77-bf96-130ab03b542e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:18.781604 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8c581e65-c324-4c77-bf96-130ab03b542e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:18.782053 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8c581e65-c324-4c77-bf96-130ab03b542e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:18.782829 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8c581e65-c324-4c77-bf96-130ab03b542e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:18.783266 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8c581e65-c324-4c77-bf96-130ab03b542e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:18.872366 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-15112ddc-f07f-4ce2-a089-bbaeb73993ac tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:18.881185 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-15112ddc-f07f-4ce2-a089-bbaeb73993ac tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:18.882677 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-15112ddc-f07f-4ce2-a089-bbaeb73993ac tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:18.883883 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-15112ddc-f07f-4ce2-a089-bbaeb73993ac tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.199863 May 03 09:16:18.884444 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 740/1649] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:16:18 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:16:18.926757 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-8c581e65-c324-4c77-bf96-130ab03b542e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:18.935262 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-8c581e65-c324-4c77-bf96-130ab03b542e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.164501 May 03 09:16:18.935864 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 910/1650] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:18 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:19.906530 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-212e1504-0af0-4718-a808-52a585772a76 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:19.907505 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-212e1504-0af0-4718-a808-52a585772a76 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:19.918127 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-212e1504-0af0-4718-a808-52a585772a76 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:19.918854 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-212e1504-0af0-4718-a808-52a585772a76 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:19.920189 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-212e1504-0af0-4718-a808-52a585772a76 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:19.920942 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-212e1504-0af0-4718-a808-52a585772a76 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:19.952774 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-529c157d-9af7-4e55-80c6-ad83882e2914 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:19.953470 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-529c157d-9af7-4e55-80c6-ad83882e2914 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:19.960512 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-529c157d-9af7-4e55-80c6-ad83882e2914 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:19.960969 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-529c157d-9af7-4e55-80c6-ad83882e2914 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:19.961744 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-529c157d-9af7-4e55-80c6-ad83882e2914 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:19.962178 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-529c157d-9af7-4e55-80c6-ad83882e2914 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:20.101627 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-212e1504-0af0-4718-a808-52a585772a76 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:20.110247 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-212e1504-0af0-4718-a808-52a585772a76 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:20.111728 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-212e1504-0af0-4718-a808-52a585772a76 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:20.112923 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-212e1504-0af0-4718-a808-52a585772a76 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.213029 May 03 09:16:20.113476 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 741/1651] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:16:19 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:16:20.128740 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-529c157d-9af7-4e55-80c6-ad83882e2914 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:20.137629 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-529c157d-9af7-4e55-80c6-ad83882e2914 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.188734 May 03 09:16:20.138205 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 911/1652] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:19 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:21.135363 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4115ba8d-8d78-4c8a-bebf-4eba5b8301a8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:21.136391 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4115ba8d-8d78-4c8a-bebf-4eba5b8301a8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:21.147221 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4115ba8d-8d78-4c8a-bebf-4eba5b8301a8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:21.147675 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4115ba8d-8d78-4c8a-bebf-4eba5b8301a8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:21.148470 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4115ba8d-8d78-4c8a-bebf-4eba5b8301a8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:21.148907 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4115ba8d-8d78-4c8a-bebf-4eba5b8301a8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:21.154420 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-4497e46f-e6ea-4e12-9c85-4b7066e5a059 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:21.155109 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-4497e46f-e6ea-4e12-9c85-4b7066e5a059 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:21.161760 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4497e46f-e6ea-4e12-9c85-4b7066e5a059 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:21.162206 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4497e46f-e6ea-4e12-9c85-4b7066e5a059 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:21.163091 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4497e46f-e6ea-4e12-9c85-4b7066e5a059 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:21.163515 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4497e46f-e6ea-4e12-9c85-4b7066e5a059 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:21.339226 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-4115ba8d-8d78-4c8a-bebf-4eba5b8301a8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:21.348341 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-4115ba8d-8d78-4c8a-bebf-4eba5b8301a8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:21.349836 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-4115ba8d-8d78-4c8a-bebf-4eba5b8301a8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:21.350421 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-4497e46f-e6ea-4e12-9c85-4b7066e5a059 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:21.351126 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-4115ba8d-8d78-4c8a-bebf-4eba5b8301a8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.222325 May 03 09:16:21.351652 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 742/1653] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:16:21 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:16:21.358538 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-4497e46f-e6ea-4e12-9c85-4b7066e5a059 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.208002 May 03 09:16:21.359129 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 912/1654] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:21 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:22.373853 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-8830a341-8c54-4658-9d88-ba912a2da978 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:22.375211 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-8830a341-8c54-4658-9d88-ba912a2da978 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:22.377494 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-0aec44e5-be51-49bb-bbc9-a0ff5f064568 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:22.378303 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-0aec44e5-be51-49bb-bbc9-a0ff5f064568 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:22.384439 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8830a341-8c54-4658-9d88-ba912a2da978 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:22.385372 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8830a341-8c54-4658-9d88-ba912a2da978 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:22.386384 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8830a341-8c54-4658-9d88-ba912a2da978 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:22.386922 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0aec44e5-be51-49bb-bbc9-a0ff5f064568 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:22.387156 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8830a341-8c54-4658-9d88-ba912a2da978 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:22.387523 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0aec44e5-be51-49bb-bbc9-a0ff5f064568 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:22.388595 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0aec44e5-be51-49bb-bbc9-a0ff5f064568 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:22.389172 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0aec44e5-be51-49bb-bbc9-a0ff5f064568 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:22.583242 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-0aec44e5-be51-49bb-bbc9-a0ff5f064568 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:22.588568 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-8830a341-8c54-4658-9d88-ba912a2da978 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:22.594258 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-0aec44e5-be51-49bb-bbc9-a0ff5f064568 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.222040 May 03 09:16:22.594894 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 913/1655] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:22 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:22.598465 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-8830a341-8c54-4658-9d88-ba912a2da978 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:22.600058 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-8830a341-8c54-4658-9d88-ba912a2da978 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:22.601400 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-8830a341-8c54-4658-9d88-ba912a2da978 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.235252 May 03 09:16:22.601988 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 743/1656] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:16:22 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:16:23.626599 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e6806c37-32c6-4131-a257-5e6a33c27e80 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:23.627281 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e6806c37-32c6-4131-a257-5e6a33c27e80 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:23.634927 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e6806c37-32c6-4131-a257-5e6a33c27e80 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:23.635377 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e6806c37-32c6-4131-a257-5e6a33c27e80 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:23.636198 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e6806c37-32c6-4131-a257-5e6a33c27e80 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:23.636636 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e6806c37-32c6-4131-a257-5e6a33c27e80 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:23.668089 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-aa58b1e9-087a-47c9-b081-d050e26a27be tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:23.668672 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-aa58b1e9-087a-47c9-b081-d050e26a27be tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:23.675140 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aa58b1e9-087a-47c9-b081-d050e26a27be tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:23.675587 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aa58b1e9-087a-47c9-b081-d050e26a27be tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:23.676382 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aa58b1e9-087a-47c9-b081-d050e26a27be tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:23.676772 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aa58b1e9-087a-47c9-b081-d050e26a27be tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:23.819792 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e6806c37-32c6-4131-a257-5e6a33c27e80 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:23.828987 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e6806c37-32c6-4131-a257-5e6a33c27e80 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:23.830488 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e6806c37-32c6-4131-a257-5e6a33c27e80 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:23.831666 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e6806c37-32c6-4131-a257-5e6a33c27e80 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.210140 May 03 09:16:23.832300 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 914/1657] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:16:23 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:16:23.841814 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-aa58b1e9-087a-47c9-b081-d050e26a27be tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:23.850676 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-aa58b1e9-087a-47c9-b081-d050e26a27be tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.186620 May 03 09:16:23.851250 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 744/1658] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:23 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:24.850953 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-abf6e457-5a9e-4541-9a2a-4858d202e6d4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:24.851549 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-abf6e457-5a9e-4541-9a2a-4858d202e6d4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:24.860400 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-abf6e457-5a9e-4541-9a2a-4858d202e6d4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:24.860929 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-abf6e457-5a9e-4541-9a2a-4858d202e6d4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:24.861707 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-abf6e457-5a9e-4541-9a2a-4858d202e6d4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:24.862137 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-abf6e457-5a9e-4541-9a2a-4858d202e6d4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:24.868025 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f32ff77b-1bf0-4551-9868-fc43dcab4ca8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:24.868635 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f32ff77b-1bf0-4551-9868-fc43dcab4ca8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:24.874922 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f32ff77b-1bf0-4551-9868-fc43dcab4ca8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:24.875367 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f32ff77b-1bf0-4551-9868-fc43dcab4ca8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:24.876160 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f32ff77b-1bf0-4551-9868-fc43dcab4ca8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:24.876591 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f32ff77b-1bf0-4551-9868-fc43dcab4ca8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:25.053581 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-abf6e457-5a9e-4541-9a2a-4858d202e6d4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:25.056452 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f32ff77b-1bf0-4551-9868-fc43dcab4ca8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:25.062313 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-abf6e457-5a9e-4541-9a2a-4858d202e6d4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:25.063796 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-abf6e457-5a9e-4541-9a2a-4858d202e6d4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:25.064613 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f32ff77b-1bf0-4551-9868-fc43dcab4ca8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.200910 May 03 09:16:25.064992 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-abf6e457-5a9e-4541-9a2a-4858d202e6d4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.218084 May 03 09:16:25.065777 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 745/1659] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:24 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:25.065918 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 915/1660] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:16:24 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:16:25.912664 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-8f3fc071-90cc-4638-90ce-3bd0061673f6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:25.913298 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-8f3fc071-90cc-4638-90ce-3bd0061673f6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:25.920060 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8f3fc071-90cc-4638-90ce-3bd0061673f6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:25.920507 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8f3fc071-90cc-4638-90ce-3bd0061673f6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:25.921277 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8f3fc071-90cc-4638-90ce-3bd0061673f6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:25.921698 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8f3fc071-90cc-4638-90ce-3bd0061673f6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:25.947017 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-8f3fc071-90cc-4638-90ce-3bd0061673f6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Going to try to terminate instance {{(pid=123392) delete /opt/stack/nova/nova/compute/api.py:2664}} May 03 09:16:26.024164 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-8f3fc071-90cc-4638-90ce-3bd0061673f6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "DELETE /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 204 len: 0 microversion: 2.1 time: 0.117372 May 03 09:16:26.024755 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 746/1661] 10.222.0.11 () {58 vars in 1238 bytes} [Tue May 3 09:16:25 2022] DELETE /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 03 09:16:26.033201 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-59ceeef5-97b2-43b1-b826-5d08b2a8dba0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:26.033806 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-59ceeef5-97b2-43b1-b826-5d08b2a8dba0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:26.039927 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-59ceeef5-97b2-43b1-b826-5d08b2a8dba0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:26.040372 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-59ceeef5-97b2-43b1-b826-5d08b2a8dba0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:26.041137 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-59ceeef5-97b2-43b1-b826-5d08b2a8dba0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:26.041562 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-59ceeef5-97b2-43b1-b826-5d08b2a8dba0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:26.082696 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4ec53d27-e833-42bb-b7a0-9f45bd614b46 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:26.083387 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4ec53d27-e833-42bb-b7a0-9f45bd614b46 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:26.089981 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4ec53d27-e833-42bb-b7a0-9f45bd614b46 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:26.090531 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4ec53d27-e833-42bb-b7a0-9f45bd614b46 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:26.091371 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4ec53d27-e833-42bb-b7a0-9f45bd614b46 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:26.091917 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4ec53d27-e833-42bb-b7a0-9f45bd614b46 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:26.222893 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-59ceeef5-97b2-43b1-b826-5d08b2a8dba0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:26.231172 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-59ceeef5-97b2-43b1-b826-5d08b2a8dba0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1721 microversion: 2.1 time: 0.202026 May 03 09:16:26.231860 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 916/1662] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:26 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1721 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:26.236372 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-4834ec81-188f-4eac-b721-eef0a3897707 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:26.237049 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-4834ec81-188f-4eac-b721-eef0a3897707 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:26.243193 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4834ec81-188f-4eac-b721-eef0a3897707 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:26.243647 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4834ec81-188f-4eac-b721-eef0a3897707 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:26.244449 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4834ec81-188f-4eac-b721-eef0a3897707 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:26.244882 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4834ec81-188f-4eac-b721-eef0a3897707 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:26.248450 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-4ec53d27-e833-42bb-b7a0-9f45bd614b46 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:26.256401 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-4ec53d27-e833-42bb-b7a0-9f45bd614b46 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.177968 May 03 09:16:26.256959 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 747/1663] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:26 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:16:26.376294 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-4834ec81-188f-4eac-b721-eef0a3897707 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:26.384794 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-4834ec81-188f-4eac-b721-eef0a3897707 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:26.386303 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-4834ec81-188f-4eac-b721-eef0a3897707 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:26.387483 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-4834ec81-188f-4eac-b721-eef0a3897707 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.154668 May 03 09:16:26.388085 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 917/1664] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:16:26 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:16:27.249088 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5954f2c2-86b0-4674-b962-9e4fc8f1efb2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:27.249610 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5954f2c2-86b0-4674-b962-9e4fc8f1efb2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:27.256571 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5954f2c2-86b0-4674-b962-9e4fc8f1efb2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:27.257025 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5954f2c2-86b0-4674-b962-9e4fc8f1efb2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:27.257773 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5954f2c2-86b0-4674-b962-9e4fc8f1efb2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:27.258220 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5954f2c2-86b0-4674-b962-9e4fc8f1efb2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:27.275128 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a26e1929-ee92-4d5f-bb7d-73790fbf94bc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:27.276408 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a26e1929-ee92-4d5f-bb7d-73790fbf94bc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:27.283052 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a26e1929-ee92-4d5f-bb7d-73790fbf94bc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:27.283595 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a26e1929-ee92-4d5f-bb7d-73790fbf94bc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:27.284645 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a26e1929-ee92-4d5f-bb7d-73790fbf94bc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:27.285288 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a26e1929-ee92-4d5f-bb7d-73790fbf94bc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:27.327978 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5954f2c2-86b0-4674-b962-9e4fc8f1efb2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:27.336162 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5954f2c2-86b0-4674-b962-9e4fc8f1efb2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1653 microversion: 2.1 time: 0.091074 May 03 09:16:27.346563 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 748/1665] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:27 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1653 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:27.411189 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a907e478-7dc7-45f8-b053-1ee8619fc456 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:27.412336 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a907e478-7dc7-45f8-b053-1ee8619fc456 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:27.418866 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a907e478-7dc7-45f8-b053-1ee8619fc456 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:27.419315 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a907e478-7dc7-45f8-b053-1ee8619fc456 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:27.420121 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a907e478-7dc7-45f8-b053-1ee8619fc456 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:27.420556 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a907e478-7dc7-45f8-b053-1ee8619fc456 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:27.546200 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a26e1929-ee92-4d5f-bb7d-73790fbf94bc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:27.556674 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a26e1929-ee92-4d5f-bb7d-73790fbf94bc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.285984 May 03 09:16:27.557505 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 918/1666] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:27 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:16:27.640923 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a907e478-7dc7-45f8-b053-1ee8619fc456 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:27.654436 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a907e478-7dc7-45f8-b053-1ee8619fc456 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:27.656088 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a907e478-7dc7-45f8-b053-1ee8619fc456 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:27.657439 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a907e478-7dc7-45f8-b053-1ee8619fc456 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.250512 May 03 09:16:27.658467 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 749/1667] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:16:27 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:16:27.700615 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [req-89c9720a-4e68-4b64-84ba-fac3075f754a req-a438a066-274f-4819-84e8-ec2b0d50bd51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "309e7477-cc5c-4422-ac1e-46d32bc3991b", "name": "network-vif-deleted", "tag": "a1780ecc-31ca-4cfd-88ae-8e55c35791d7"}]} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:16:27.717340 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-89c9720a-4e68-4b64-84ba-fac3075f754a req-a438a066-274f-4819-84e8-ec2b0d50bd51 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:27.718166 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-89c9720a-4e68-4b64-84ba-fac3075f754a req-a438a066-274f-4819-84e8-ec2b0d50bd51 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:27.729617 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.compute.server_external_events [req-89c9720a-4e68-4b64-84ba-fac3075f754a req-a438a066-274f-4819-84e8-ec2b0d50bd51 service nova] Creating event network-vif-deleted:a1780ecc-31ca-4cfd-88ae-8e55c35791d7 for instance 309e7477-cc5c-4422-ac1e-46d32bc3991b on hv-cinder-84027 May 03 09:16:27.734588 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [req-89c9720a-4e68-4b64-84ba-fac3075f754a req-a438a066-274f-4819-84e8-ec2b0d50bd51 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114927 May 03 09:16:27.735175 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 919/1668] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 09:16:28.354459 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-50612a2f-0b9a-4c6e-95ba-840df0f4fbc9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:28.355081 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-50612a2f-0b9a-4c6e-95ba-840df0f4fbc9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:28.361742 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-50612a2f-0b9a-4c6e-95ba-840df0f4fbc9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:28.362199 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-50612a2f-0b9a-4c6e-95ba-840df0f4fbc9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:28.362972 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-50612a2f-0b9a-4c6e-95ba-840df0f4fbc9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:28.363411 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-50612a2f-0b9a-4c6e-95ba-840df0f4fbc9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:28.425509 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-50612a2f-0b9a-4c6e-95ba-840df0f4fbc9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:28.434593 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-50612a2f-0b9a-4c6e-95ba-840df0f4fbc9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.084177 May 03 09:16:28.435186 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 750/1669] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:28 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:28.575645 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-7b2f5bca-8dd3-4d81-8de5-6bd741143beb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:28.576376 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-7b2f5bca-8dd3-4d81-8de5-6bd741143beb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:28.582894 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7b2f5bca-8dd3-4d81-8de5-6bd741143beb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:28.583343 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7b2f5bca-8dd3-4d81-8de5-6bd741143beb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:28.584152 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7b2f5bca-8dd3-4d81-8de5-6bd741143beb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:28.584582 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7b2f5bca-8dd3-4d81-8de5-6bd741143beb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:28.676051 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0ba358b0-8f7f-4989-a86d-432e7f80d49f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:28.676670 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0ba358b0-8f7f-4989-a86d-432e7f80d49f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:28.683127 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0ba358b0-8f7f-4989-a86d-432e7f80d49f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:28.683579 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0ba358b0-8f7f-4989-a86d-432e7f80d49f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:28.684398 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0ba358b0-8f7f-4989-a86d-432e7f80d49f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:28.684829 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0ba358b0-8f7f-4989-a86d-432e7f80d49f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:29.032099 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7b2f5bca-8dd3-4d81-8de5-6bd741143beb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:29.040259 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-7b2f5bca-8dd3-4d81-8de5-6bd741143beb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.469387 May 03 09:16:29.040844 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 920/1670] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:28 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:29.052391 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0ba358b0-8f7f-4989-a86d-432e7f80d49f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:29.060858 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0ba358b0-8f7f-4989-a86d-432e7f80d49f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:29.062361 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0ba358b0-8f7f-4989-a86d-432e7f80d49f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:29.063535 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0ba358b0-8f7f-4989-a86d-432e7f80d49f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.391664 May 03 09:16:29.064155 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 751/1671] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:16:28 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:16:29.454986 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-789afb9f-5b18-433d-bd97-4731b499cc9d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:29.456042 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-789afb9f-5b18-433d-bd97-4731b499cc9d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:29.466418 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-789afb9f-5b18-433d-bd97-4731b499cc9d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:29.467070 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-789afb9f-5b18-433d-bd97-4731b499cc9d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:29.468772 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-789afb9f-5b18-433d-bd97-4731b499cc9d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:29.469499 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-789afb9f-5b18-433d-bd97-4731b499cc9d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:29.532248 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-789afb9f-5b18-433d-bd97-4731b499cc9d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:29.540460 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-789afb9f-5b18-433d-bd97-4731b499cc9d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.091923 May 03 09:16:29.541031 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 921/1672] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:29 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:30.058522 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9f7d2e7a-912d-4b67-b789-d9ebd1b65088 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:30.059112 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9f7d2e7a-912d-4b67-b789-d9ebd1b65088 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:30.065992 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9f7d2e7a-912d-4b67-b789-d9ebd1b65088 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:30.066445 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9f7d2e7a-912d-4b67-b789-d9ebd1b65088 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:30.067366 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9f7d2e7a-912d-4b67-b789-d9ebd1b65088 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:30.067810 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9f7d2e7a-912d-4b67-b789-d9ebd1b65088 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:30.081525 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a37b24bd-42d0-4019-91cb-cb6ef5c5f231 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:30.082141 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a37b24bd-42d0-4019-91cb-cb6ef5c5f231 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:30.090201 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a37b24bd-42d0-4019-91cb-cb6ef5c5f231 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:30.090676 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a37b24bd-42d0-4019-91cb-cb6ef5c5f231 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:30.091461 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a37b24bd-42d0-4019-91cb-cb6ef5c5f231 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:30.092057 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a37b24bd-42d0-4019-91cb-cb6ef5c5f231 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:30.253360 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9f7d2e7a-912d-4b67-b789-d9ebd1b65088 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:30.261618 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9f7d2e7a-912d-4b67-b789-d9ebd1b65088 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.207228 May 03 09:16:30.262159 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 752/1673] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:30 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:30.264575 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a37b24bd-42d0-4019-91cb-cb6ef5c5f231 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:30.273895 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a37b24bd-42d0-4019-91cb-cb6ef5c5f231 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:30.275403 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a37b24bd-42d0-4019-91cb-cb6ef5c5f231 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:30.276592 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a37b24bd-42d0-4019-91cb-cb6ef5c5f231 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.199087 May 03 09:16:30.277143 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 922/1674] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:16:30 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:16:30.557819 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b87891c7-8188-4551-b985-29e9f6ee1d17 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:30.558468 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b87891c7-8188-4551-b985-29e9f6ee1d17 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:30.565096 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b87891c7-8188-4551-b985-29e9f6ee1d17 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:30.565547 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b87891c7-8188-4551-b985-29e9f6ee1d17 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:30.566331 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b87891c7-8188-4551-b985-29e9f6ee1d17 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:30.566765 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b87891c7-8188-4551-b985-29e9f6ee1d17 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:30.629223 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b87891c7-8188-4551-b985-29e9f6ee1d17 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:30.641500 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b87891c7-8188-4551-b985-29e9f6ee1d17 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.087506 May 03 09:16:30.642320 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 753/1675] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:30 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:31.282682 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-348651da-284e-4674-89e7-3b1caf2e2f2d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:31.283960 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-348651da-284e-4674-89e7-3b1caf2e2f2d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:31.294877 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-348651da-284e-4674-89e7-3b1caf2e2f2d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:31.295629 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-348651da-284e-4674-89e7-3b1caf2e2f2d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:31.296929 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-348651da-284e-4674-89e7-3b1caf2e2f2d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:31.297642 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-348651da-284e-4674-89e7-3b1caf2e2f2d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:31.298501 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-331f4269-4034-4d29-8e7e-e92a05e89ca1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:31.299522 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-331f4269-4034-4d29-8e7e-e92a05e89ca1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:31.308095 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-331f4269-4034-4d29-8e7e-e92a05e89ca1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:31.308543 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-331f4269-4034-4d29-8e7e-e92a05e89ca1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:31.309316 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-331f4269-4034-4d29-8e7e-e92a05e89ca1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:31.309749 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-331f4269-4034-4d29-8e7e-e92a05e89ca1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:31.483447 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-348651da-284e-4674-89e7-3b1caf2e2f2d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:31.491936 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-348651da-284e-4674-89e7-3b1caf2e2f2d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.215594 May 03 09:16:31.492507 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 923/1676] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:31 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:31.494819 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-331f4269-4034-4d29-8e7e-e92a05e89ca1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:31.503430 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-331f4269-4034-4d29-8e7e-e92a05e89ca1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:31.504958 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-331f4269-4034-4d29-8e7e-e92a05e89ca1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:31.506140 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-331f4269-4034-4d29-8e7e-e92a05e89ca1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.214181 May 03 09:16:31.506703 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 754/1677] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:16:31 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:16:31.664730 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-55c07d00-0fc8-465f-8b30-85cd12aed80f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:31.665390 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-55c07d00-0fc8-465f-8b30-85cd12aed80f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:31.673387 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-55c07d00-0fc8-465f-8b30-85cd12aed80f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:31.673954 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-55c07d00-0fc8-465f-8b30-85cd12aed80f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:31.674966 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-55c07d00-0fc8-465f-8b30-85cd12aed80f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:31.675512 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-55c07d00-0fc8-465f-8b30-85cd12aed80f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:31.743697 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-55c07d00-0fc8-465f-8b30-85cd12aed80f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:31.752119 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-55c07d00-0fc8-465f-8b30-85cd12aed80f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.093952 May 03 09:16:31.752696 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 924/1678] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:31 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:32.512247 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-76fbee2a-7d60-4d15-acf2-fe1b0996e037 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:32.512939 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-76fbee2a-7d60-4d15-acf2-fe1b0996e037 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:32.522372 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-76fbee2a-7d60-4d15-acf2-fe1b0996e037 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:32.523003 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-76fbee2a-7d60-4d15-acf2-fe1b0996e037 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:32.524214 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-76fbee2a-7d60-4d15-acf2-fe1b0996e037 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:32.524840 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-76fbee2a-7d60-4d15-acf2-fe1b0996e037 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:32.527522 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-421d2e38-b00b-43f7-bcab-8a08161ccaba tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:32.528380 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-421d2e38-b00b-43f7-bcab-8a08161ccaba tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:32.536528 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-421d2e38-b00b-43f7-bcab-8a08161ccaba tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:32.537160 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-421d2e38-b00b-43f7-bcab-8a08161ccaba tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:32.538177 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-421d2e38-b00b-43f7-bcab-8a08161ccaba tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:32.538838 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-421d2e38-b00b-43f7-bcab-8a08161ccaba tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:32.711815 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-76fbee2a-7d60-4d15-acf2-fe1b0996e037 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:32.716946 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-421d2e38-b00b-43f7-bcab-8a08161ccaba tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:32.722972 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-76fbee2a-7d60-4d15-acf2-fe1b0996e037 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.216586 May 03 09:16:32.723784 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 755/1679] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:32 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:32.728715 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-421d2e38-b00b-43f7-bcab-8a08161ccaba tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:32.730169 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-421d2e38-b00b-43f7-bcab-8a08161ccaba tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:32.731366 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-421d2e38-b00b-43f7-bcab-8a08161ccaba tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.209681 May 03 09:16:32.732132 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 925/1680] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:16:32 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:16:32.771418 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-1aa9cef2-0e58-4910-9851-9131cc8fa77d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:32.772023 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-1aa9cef2-0e58-4910-9851-9131cc8fa77d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:32.778124 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1aa9cef2-0e58-4910-9851-9131cc8fa77d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:32.778577 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1aa9cef2-0e58-4910-9851-9131cc8fa77d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:32.779338 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1aa9cef2-0e58-4910-9851-9131cc8fa77d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:32.779791 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1aa9cef2-0e58-4910-9851-9131cc8fa77d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:32.841294 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-1aa9cef2-0e58-4910-9851-9131cc8fa77d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:32.849881 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-1aa9cef2-0e58-4910-9851-9131cc8fa77d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.082282 May 03 09:16:32.850452 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 756/1681] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:32 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:33.744556 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ea447a3e-802a-4e40-82cb-7567c1f8ba72 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:33.745327 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ea447a3e-802a-4e40-82cb-7567c1f8ba72 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:33.752584 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-70e8b2bc-8241-455f-a20e-582b551d4664 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:33.753330 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-70e8b2bc-8241-455f-a20e-582b551d4664 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:33.753797 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ea447a3e-802a-4e40-82cb-7567c1f8ba72 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:33.754324 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ea447a3e-802a-4e40-82cb-7567c1f8ba72 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:33.755244 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ea447a3e-802a-4e40-82cb-7567c1f8ba72 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:33.755747 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ea447a3e-802a-4e40-82cb-7567c1f8ba72 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:33.760931 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-70e8b2bc-8241-455f-a20e-582b551d4664 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:33.761748 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-70e8b2bc-8241-455f-a20e-582b551d4664 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:33.763296 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-70e8b2bc-8241-455f-a20e-582b551d4664 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:33.764300 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-70e8b2bc-8241-455f-a20e-582b551d4664 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:33.953047 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ea447a3e-802a-4e40-82cb-7567c1f8ba72 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:33.962053 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ea447a3e-802a-4e40-82cb-7567c1f8ba72 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.223125 May 03 09:16:33.962627 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 926/1682] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:33 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:33.966925 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-70e8b2bc-8241-455f-a20e-582b551d4664 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:33.970179 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-01e30573-a511-4705-bb12-5eae8a232eb8 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:33.970789 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-01e30573-a511-4705-bb12-5eae8a232eb8 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:33.976766 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-01e30573-a511-4705-bb12-5eae8a232eb8 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:33.977201 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-01e30573-a511-4705-bb12-5eae8a232eb8 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:33.977376 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-70e8b2bc-8241-455f-a20e-582b551d4664 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:33.977960 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-01e30573-a511-4705-bb12-5eae8a232eb8 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:33.978388 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-01e30573-a511-4705-bb12-5eae8a232eb8 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:33.978757 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-70e8b2bc-8241-455f-a20e-582b551d4664 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:33.979975 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-70e8b2bc-8241-455f-a20e-582b551d4664 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.232494 May 03 09:16:33.981052 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 757/1683] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:16:33 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:16:34.053547 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-01e30573-a511-4705-bb12-5eae8a232eb8 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:34.061933 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-01e30573-a511-4705-bb12-5eae8a232eb8 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.098344 May 03 09:16:34.062504 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 927/1684] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:33 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:34.983835 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-44430785-d65e-462d-9c03-cf505ececa67 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:34.984918 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-44430785-d65e-462d-9c03-cf505ececa67 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:34.994767 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-44430785-d65e-462d-9c03-cf505ececa67 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:34.995229 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-44430785-d65e-462d-9c03-cf505ececa67 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:34.996030 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-44430785-d65e-462d-9c03-cf505ececa67 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:34.996463 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-44430785-d65e-462d-9c03-cf505ececa67 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:34.999052 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e0dd1637-9df6-411d-b2a3-58811a8b1be4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:34.999649 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e0dd1637-9df6-411d-b2a3-58811a8b1be4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:35.006396 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e0dd1637-9df6-411d-b2a3-58811a8b1be4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:35.006848 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e0dd1637-9df6-411d-b2a3-58811a8b1be4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:35.007615 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e0dd1637-9df6-411d-b2a3-58811a8b1be4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:35.008084 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e0dd1637-9df6-411d-b2a3-58811a8b1be4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:35.194199 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-44430785-d65e-462d-9c03-cf505ececa67 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:35.197326 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e0dd1637-9df6-411d-b2a3-58811a8b1be4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:35.202934 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-44430785-d65e-462d-9c03-cf505ececa67 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.225373 May 03 09:16:35.204264 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 758/1685] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:34 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:35.206135 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e0dd1637-9df6-411d-b2a3-58811a8b1be4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:35.207646 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e0dd1637-9df6-411d-b2a3-58811a8b1be4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:35.208882 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e0dd1637-9df6-411d-b2a3-58811a8b1be4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.213796 May 03 09:16:35.209635 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 928/1686] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:16:34 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:16:35.215722 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c3bcb9f9-2130-4f12-8c95-fe75c2cc1cf0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:35.216394 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c3bcb9f9-2130-4f12-8c95-fe75c2cc1cf0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:35.222873 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c3bcb9f9-2130-4f12-8c95-fe75c2cc1cf0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:35.223345 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c3bcb9f9-2130-4f12-8c95-fe75c2cc1cf0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:35.224128 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c3bcb9f9-2130-4f12-8c95-fe75c2cc1cf0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:35.224560 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c3bcb9f9-2130-4f12-8c95-fe75c2cc1cf0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:35.291391 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c3bcb9f9-2130-4f12-8c95-fe75c2cc1cf0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:35.299805 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c3bcb9f9-2130-4f12-8c95-fe75c2cc1cf0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.088161 May 03 09:16:35.300384 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 759/1687] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:35 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:36.225050 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d8d42afe-cefd-43d9-9bc7-f85305418c2e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:36.226062 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d8d42afe-cefd-43d9-9bc7-f85305418c2e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:36.229231 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-708cfca0-5291-4f2d-ba58-8e84d3ed96f2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:36.229843 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-708cfca0-5291-4f2d-ba58-8e84d3ed96f2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:36.233173 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d8d42afe-cefd-43d9-9bc7-f85305418c2e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:36.233627 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d8d42afe-cefd-43d9-9bc7-f85305418c2e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:36.234406 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d8d42afe-cefd-43d9-9bc7-f85305418c2e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:36.234842 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d8d42afe-cefd-43d9-9bc7-f85305418c2e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:36.236334 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-708cfca0-5291-4f2d-ba58-8e84d3ed96f2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:36.236781 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-708cfca0-5291-4f2d-ba58-8e84d3ed96f2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:36.237536 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-708cfca0-5291-4f2d-ba58-8e84d3ed96f2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:36.237963 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-708cfca0-5291-4f2d-ba58-8e84d3ed96f2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:36.421341 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d8d42afe-cefd-43d9-9bc7-f85305418c2e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:36.424203 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-708cfca0-5291-4f2d-ba58-8e84d3ed96f2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:36.429584 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d8d42afe-cefd-43d9-9bc7-f85305418c2e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.211262 May 03 09:16:36.430171 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 929/1688] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:36 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:36.432567 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-708cfca0-5291-4f2d-ba58-8e84d3ed96f2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:36.434076 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-708cfca0-5291-4f2d-ba58-8e84d3ed96f2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:36.434650 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-002218d8-f37d-4c43-9628-fa7cd3843750 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:36.435250 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-002218d8-f37d-4c43-9628-fa7cd3843750 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:36.435354 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-708cfca0-5291-4f2d-ba58-8e84d3ed96f2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.211541 May 03 09:16:36.435990 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 760/1689] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:16:36 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:16:36.441344 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-002218d8-f37d-4c43-9628-fa7cd3843750 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:36.441787 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-002218d8-f37d-4c43-9628-fa7cd3843750 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:36.442544 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-002218d8-f37d-4c43-9628-fa7cd3843750 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:36.442968 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-002218d8-f37d-4c43-9628-fa7cd3843750 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:36.512523 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-002218d8-f37d-4c43-9628-fa7cd3843750 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:36.520922 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-002218d8-f37d-4c43-9628-fa7cd3843750 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.089784 May 03 09:16:36.521486 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 930/1690] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:36 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:37.451160 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6504254c-f11a-4fc4-be2f-373022fe802e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:37.452231 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6504254c-f11a-4fc4-be2f-373022fe802e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:37.457443 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-03443823-d4d9-487a-a96d-e2deb5cccef9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:37.458496 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-03443823-d4d9-487a-a96d-e2deb5cccef9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:37.465190 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6504254c-f11a-4fc4-be2f-373022fe802e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:37.465663 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6504254c-f11a-4fc4-be2f-373022fe802e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:37.466441 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6504254c-f11a-4fc4-be2f-373022fe802e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:37.466696 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-03443823-d4d9-487a-a96d-e2deb5cccef9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:37.466843 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6504254c-f11a-4fc4-be2f-373022fe802e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:37.467146 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-03443823-d4d9-487a-a96d-e2deb5cccef9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:37.468314 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-03443823-d4d9-487a-a96d-e2deb5cccef9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:37.468738 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-03443823-d4d9-487a-a96d-e2deb5cccef9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:37.652771 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6504254c-f11a-4fc4-be2f-373022fe802e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:37.655993 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-03443823-d4d9-487a-a96d-e2deb5cccef9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:37.660958 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6504254c-f11a-4fc4-be2f-373022fe802e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.216428 May 03 09:16:37.661630 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 761/1691] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:37 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:37.664791 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-03443823-d4d9-487a-a96d-e2deb5cccef9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:37.666380 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-03443823-d4d9-487a-a96d-e2deb5cccef9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:37.666537 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7d2bb0a7-275b-483e-a308-fd1d9ef53bd6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:37.667056 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7d2bb0a7-275b-483e-a308-fd1d9ef53bd6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:37.667537 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-03443823-d4d9-487a-a96d-e2deb5cccef9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.216671 May 03 09:16:37.668379 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 931/1692] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:16:37 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:16:37.672952 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7d2bb0a7-275b-483e-a308-fd1d9ef53bd6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:37.673404 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7d2bb0a7-275b-483e-a308-fd1d9ef53bd6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:37.674166 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7d2bb0a7-275b-483e-a308-fd1d9ef53bd6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:37.674813 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7d2bb0a7-275b-483e-a308-fd1d9ef53bd6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:37.736144 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7d2bb0a7-275b-483e-a308-fd1d9ef53bd6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:37.744511 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7d2bb0a7-275b-483e-a308-fd1d9ef53bd6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.081869 May 03 09:16:37.745100 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 762/1693] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:37 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:38.684631 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-30beb83a-f925-4e65-a9c9-3e7e644941f3 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:38.685246 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-30beb83a-f925-4e65-a9c9-3e7e644941f3 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:38.686770 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2328a94e-b808-4e21-b643-134ce5e57084 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:38.687376 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-2328a94e-b808-4e21-b643-134ce5e57084 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:38.692041 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-30beb83a-f925-4e65-a9c9-3e7e644941f3 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:38.692496 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-30beb83a-f925-4e65-a9c9-3e7e644941f3 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:38.693264 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-30beb83a-f925-4e65-a9c9-3e7e644941f3 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:38.693698 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-30beb83a-f925-4e65-a9c9-3e7e644941f3 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:38.693862 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2328a94e-b808-4e21-b643-134ce5e57084 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:38.694281 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2328a94e-b808-4e21-b643-134ce5e57084 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:38.695028 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2328a94e-b808-4e21-b643-134ce5e57084 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:38.695486 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2328a94e-b808-4e21-b643-134ce5e57084 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:38.883440 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-30beb83a-f925-4e65-a9c9-3e7e644941f3 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:38.886503 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2328a94e-b808-4e21-b643-134ce5e57084 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:38.891668 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-30beb83a-f925-4e65-a9c9-3e7e644941f3 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.211953 May 03 09:16:38.892326 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 932/1694] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:38 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:38.895148 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2328a94e-b808-4e21-b643-134ce5e57084 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:38.896677 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2328a94e-b808-4e21-b643-134ce5e57084 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:38.896814 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-652d0097-90dd-43e6-9565-33ee89d7ccb2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:38.897305 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-652d0097-90dd-43e6-9565-33ee89d7ccb2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:38.897848 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-2328a94e-b808-4e21-b643-134ce5e57084 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.215058 May 03 09:16:38.898562 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 763/1695] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:16:38 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:16:38.903069 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-652d0097-90dd-43e6-9565-33ee89d7ccb2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:38.903522 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-652d0097-90dd-43e6-9565-33ee89d7ccb2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:38.904327 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-652d0097-90dd-43e6-9565-33ee89d7ccb2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:38.904760 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-652d0097-90dd-43e6-9565-33ee89d7ccb2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:38.965326 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-652d0097-90dd-43e6-9565-33ee89d7ccb2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:38.973696 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-652d0097-90dd-43e6-9565-33ee89d7ccb2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.080459 May 03 09:16:38.974264 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 933/1696] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:38 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:39.913499 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d8302348-0884-4338-855c-7d5261356b60 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:39.914431 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d8302348-0884-4338-855c-7d5261356b60 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:39.918679 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-41d98a62-4c08-44be-87ee-4ba48d93a6e6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:39.919338 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-41d98a62-4c08-44be-87ee-4ba48d93a6e6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:39.921995 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d8302348-0884-4338-855c-7d5261356b60 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:39.922470 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d8302348-0884-4338-855c-7d5261356b60 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:39.923243 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d8302348-0884-4338-855c-7d5261356b60 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:39.923673 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d8302348-0884-4338-855c-7d5261356b60 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:39.925828 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-41d98a62-4c08-44be-87ee-4ba48d93a6e6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:39.926478 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-41d98a62-4c08-44be-87ee-4ba48d93a6e6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:39.927239 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-41d98a62-4c08-44be-87ee-4ba48d93a6e6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:39.929133 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-41d98a62-4c08-44be-87ee-4ba48d93a6e6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:40.122697 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d8302348-0884-4338-855c-7d5261356b60 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:40.125865 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-41d98a62-4c08-44be-87ee-4ba48d93a6e6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:40.130924 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d8302348-0884-4338-855c-7d5261356b60 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.224092 May 03 09:16:40.131481 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 764/1697] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:39 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:40.134322 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-41d98a62-4c08-44be-87ee-4ba48d93a6e6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:40.135899 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-41d98a62-4c08-44be-87ee-4ba48d93a6e6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:40.136316 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-59f9e1b2-d35d-4246-88d9-6c566c380947 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:40.136962 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-59f9e1b2-d35d-4246-88d9-6c566c380947 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:40.137077 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-41d98a62-4c08-44be-87ee-4ba48d93a6e6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.223507 May 03 09:16:40.137602 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 934/1698] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:16:39 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:16:40.143145 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-59f9e1b2-d35d-4246-88d9-6c566c380947 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:40.143597 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-59f9e1b2-d35d-4246-88d9-6c566c380947 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:40.144534 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-59f9e1b2-d35d-4246-88d9-6c566c380947 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:40.144953 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-59f9e1b2-d35d-4246-88d9-6c566c380947 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:40.208642 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-59f9e1b2-d35d-4246-88d9-6c566c380947 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:40.217771 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-59f9e1b2-d35d-4246-88d9-6c566c380947 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.084868 May 03 09:16:40.218350 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 765/1699] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:40 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:41.152235 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d899b083-d900-437f-99fa-7333ec530751 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:41.153024 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d899b083-d900-437f-99fa-7333ec530751 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:41.157359 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7bd55acb-4118-4898-91f4-69035190bd4d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:41.158169 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7bd55acb-4118-4898-91f4-69035190bd4d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:41.161619 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d899b083-d900-437f-99fa-7333ec530751 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:41.162213 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d899b083-d900-437f-99fa-7333ec530751 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:41.163224 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d899b083-d900-437f-99fa-7333ec530751 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:41.163811 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d899b083-d900-437f-99fa-7333ec530751 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:41.166611 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7bd55acb-4118-4898-91f4-69035190bd4d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:41.167206 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7bd55acb-4118-4898-91f4-69035190bd4d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:41.168277 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7bd55acb-4118-4898-91f4-69035190bd4d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:41.168860 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7bd55acb-4118-4898-91f4-69035190bd4d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:41.360353 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d899b083-d900-437f-99fa-7333ec530751 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:41.365139 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7bd55acb-4118-4898-91f4-69035190bd4d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:41.372183 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d899b083-d900-437f-99fa-7333ec530751 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.225773 May 03 09:16:41.373054 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 935/1700] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:41 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:41.378689 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7bd55acb-4118-4898-91f4-69035190bd4d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:41.379637 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-0a61b4fc-2727-4bef-858c-f80ba27d2b8b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:41.380559 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-0a61b4fc-2727-4bef-858c-f80ba27d2b8b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:41.380797 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7bd55acb-4118-4898-91f4-69035190bd4d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:41.382472 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7bd55acb-4118-4898-91f4-69035190bd4d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.230526 May 03 09:16:41.383253 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 766/1701] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:16:41 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:16:41.387294 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0a61b4fc-2727-4bef-858c-f80ba27d2b8b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:41.387739 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0a61b4fc-2727-4bef-858c-f80ba27d2b8b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:41.388534 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0a61b4fc-2727-4bef-858c-f80ba27d2b8b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:41.388961 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0a61b4fc-2727-4bef-858c-f80ba27d2b8b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:41.449324 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-0a61b4fc-2727-4bef-858c-f80ba27d2b8b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:41.457653 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-0a61b4fc-2727-4bef-858c-f80ba27d2b8b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.083510 May 03 09:16:41.458231 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 936/1702] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:41 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:42.397120 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-46221fab-21a1-4834-a2a1-fe764d0cae5b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:42.398000 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-46221fab-21a1-4834-a2a1-fe764d0cae5b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:42.405625 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f53fee92-cf9b-4b36-a06e-81f21c48b495 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:42.406634 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f53fee92-cf9b-4b36-a06e-81f21c48b495 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:42.407847 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-46221fab-21a1-4834-a2a1-fe764d0cae5b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:42.408539 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-46221fab-21a1-4834-a2a1-fe764d0cae5b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:42.409709 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-46221fab-21a1-4834-a2a1-fe764d0cae5b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:42.410360 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-46221fab-21a1-4834-a2a1-fe764d0cae5b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:42.415682 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f53fee92-cf9b-4b36-a06e-81f21c48b495 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:42.416323 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f53fee92-cf9b-4b36-a06e-81f21c48b495 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:42.417089 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f53fee92-cf9b-4b36-a06e-81f21c48b495 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:42.417503 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f53fee92-cf9b-4b36-a06e-81f21c48b495 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:42.597427 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-46221fab-21a1-4834-a2a1-fe764d0cae5b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:42.600962 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f53fee92-cf9b-4b36-a06e-81f21c48b495 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:42.605646 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-46221fab-21a1-4834-a2a1-fe764d0cae5b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.215195 May 03 09:16:42.606567 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 767/1703] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:42 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:42.609277 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f53fee92-cf9b-4b36-a06e-81f21c48b495 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:42.610780 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f53fee92-cf9b-4b36-a06e-81f21c48b495 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:42.611007 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2a06f2fd-b39c-463a-aa7a-831b310b77dc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:42.611613 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-2a06f2fd-b39c-463a-aa7a-831b310b77dc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:42.612222 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f53fee92-cf9b-4b36-a06e-81f21c48b495 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.212667 May 03 09:16:42.612775 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 937/1704] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:16:42 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:16:42.618031 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2a06f2fd-b39c-463a-aa7a-831b310b77dc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:42.618833 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2a06f2fd-b39c-463a-aa7a-831b310b77dc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:42.619927 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2a06f2fd-b39c-463a-aa7a-831b310b77dc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:42.620367 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2a06f2fd-b39c-463a-aa7a-831b310b77dc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:42.683329 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2a06f2fd-b39c-463a-aa7a-831b310b77dc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:42.691528 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-2a06f2fd-b39c-463a-aa7a-831b310b77dc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.083983 May 03 09:16:42.692152 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 768/1705] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:42 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:43.627966 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-fb27d636-056f-42f5-bc5e-56201c956a62 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:43.628815 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-fb27d636-056f-42f5-bc5e-56201c956a62 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:43.637167 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e170574a-6e78-4fff-b2e8-22e93d9006b4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:43.637753 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fb27d636-056f-42f5-bc5e-56201c956a62 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:43.637911 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e170574a-6e78-4fff-b2e8-22e93d9006b4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:43.638207 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fb27d636-056f-42f5-bc5e-56201c956a62 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:43.638982 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fb27d636-056f-42f5-bc5e-56201c956a62 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:43.639414 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fb27d636-056f-42f5-bc5e-56201c956a62 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:43.644082 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e170574a-6e78-4fff-b2e8-22e93d9006b4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:43.644532 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e170574a-6e78-4fff-b2e8-22e93d9006b4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:43.645302 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e170574a-6e78-4fff-b2e8-22e93d9006b4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:43.645880 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e170574a-6e78-4fff-b2e8-22e93d9006b4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:43.825470 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-fb27d636-056f-42f5-bc5e-56201c956a62 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:43.833647 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e170574a-6e78-4fff-b2e8-22e93d9006b4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:43.836839 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-fb27d636-056f-42f5-bc5e-56201c956a62 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.215302 May 03 09:16:43.837753 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 938/1706] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:43 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:43.843152 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-7e4f070b-be4b-48f5-898e-54dd86b66aec tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:43.843752 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-7e4f070b-be4b-48f5-898e-54dd86b66aec tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:43.844261 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e170574a-6e78-4fff-b2e8-22e93d9006b4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:43.845797 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e170574a-6e78-4fff-b2e8-22e93d9006b4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:43.847085 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e170574a-6e78-4fff-b2e8-22e93d9006b4 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.215167 May 03 09:16:43.847955 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 769/1707] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:16:43 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:16:43.851417 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7e4f070b-be4b-48f5-898e-54dd86b66aec tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:43.852150 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7e4f070b-be4b-48f5-898e-54dd86b66aec tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:43.853476 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7e4f070b-be4b-48f5-898e-54dd86b66aec tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:43.853914 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7e4f070b-be4b-48f5-898e-54dd86b66aec tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:43.922427 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7e4f070b-be4b-48f5-898e-54dd86b66aec tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:43.933495 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-7e4f070b-be4b-48f5-898e-54dd86b66aec tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.094790 May 03 09:16:43.934067 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 939/1708] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:43 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:44.856951 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-46d4bc5d-b845-4893-89d6-19078848154a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:44.857650 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-46d4bc5d-b845-4893-89d6-19078848154a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:44.866349 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-46d4bc5d-b845-4893-89d6-19078848154a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:44.866985 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-46d4bc5d-b845-4893-89d6-19078848154a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:44.868057 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-46d4bc5d-b845-4893-89d6-19078848154a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:44.868636 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-46d4bc5d-b845-4893-89d6-19078848154a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:44.869193 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ddc9badf-d038-4133-a446-6600da5fd06e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:44.869808 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ddc9badf-d038-4133-a446-6600da5fd06e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:44.876412 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ddc9badf-d038-4133-a446-6600da5fd06e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:44.876854 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ddc9badf-d038-4133-a446-6600da5fd06e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:44.877610 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ddc9badf-d038-4133-a446-6600da5fd06e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:44.878041 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ddc9badf-d038-4133-a446-6600da5fd06e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:45.059227 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-46d4bc5d-b845-4893-89d6-19078848154a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:45.062361 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ddc9badf-d038-4133-a446-6600da5fd06e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:45.067725 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-46d4bc5d-b845-4893-89d6-19078848154a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.216190 May 03 09:16:45.068358 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 770/1709] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:44 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:45.071009 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ddc9badf-d038-4133-a446-6600da5fd06e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:45.072653 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ddc9badf-d038-4133-a446-6600da5fd06e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:45.072904 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-aae112f8-a3de-40bd-b1c3-657bc2a5ba11 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:45.073487 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-aae112f8-a3de-40bd-b1c3-657bc2a5ba11 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:45.073815 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ddc9badf-d038-4133-a446-6600da5fd06e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.209946 May 03 09:16:45.074671 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 940/1710] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:16:44 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:16:45.079459 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aae112f8-a3de-40bd-b1c3-657bc2a5ba11 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:45.079924 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aae112f8-a3de-40bd-b1c3-657bc2a5ba11 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:45.080703 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aae112f8-a3de-40bd-b1c3-657bc2a5ba11 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:45.081135 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aae112f8-a3de-40bd-b1c3-657bc2a5ba11 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:45.145219 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-aae112f8-a3de-40bd-b1c3-657bc2a5ba11 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:45.153244 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-aae112f8-a3de-40bd-b1c3-657bc2a5ba11 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.083954 May 03 09:16:45.153806 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 771/1711] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:45 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:46.095208 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d2038548-d660-4360-932c-014b9b4fc1ea tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:46.096358 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a4aa1fc0-eb4b-4520-82d2-b4f334a79309 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:46.097009 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d2038548-d660-4360-932c-014b9b4fc1ea tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:46.097379 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a4aa1fc0-eb4b-4520-82d2-b4f334a79309 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:46.106087 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d2038548-d660-4360-932c-014b9b4fc1ea tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:46.106298 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a4aa1fc0-eb4b-4520-82d2-b4f334a79309 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:46.106537 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d2038548-d660-4360-932c-014b9b4fc1ea tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:46.106739 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a4aa1fc0-eb4b-4520-82d2-b4f334a79309 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:46.107527 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a4aa1fc0-eb4b-4520-82d2-b4f334a79309 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:46.107689 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d2038548-d660-4360-932c-014b9b4fc1ea tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:46.107998 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a4aa1fc0-eb4b-4520-82d2-b4f334a79309 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:46.108158 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d2038548-d660-4360-932c-014b9b4fc1ea tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:46.303470 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a4aa1fc0-eb4b-4520-82d2-b4f334a79309 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:46.306419 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d2038548-d660-4360-932c-014b9b4fc1ea tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:46.311996 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a4aa1fc0-eb4b-4520-82d2-b4f334a79309 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:46.313497 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a4aa1fc0-eb4b-4520-82d2-b4f334a79309 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:46.314590 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d2038548-d660-4360-932c-014b9b4fc1ea tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.232055 May 03 09:16:46.314699 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a4aa1fc0-eb4b-4520-82d2-b4f334a79309 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.225239 May 03 09:16:46.315426 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 941/1712] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:46 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:46.315549 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 772/1713] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:16:46 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:16:46.322457 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-47aebc87-aca3-4dee-b5f0-5ea864fda162 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:46.323064 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-47aebc87-aca3-4dee-b5f0-5ea864fda162 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:46.328885 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-47aebc87-aca3-4dee-b5f0-5ea864fda162 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:46.329339 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-47aebc87-aca3-4dee-b5f0-5ea864fda162 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:46.330108 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-47aebc87-aca3-4dee-b5f0-5ea864fda162 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:46.330540 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-47aebc87-aca3-4dee-b5f0-5ea864fda162 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:46.396011 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-47aebc87-aca3-4dee-b5f0-5ea864fda162 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:46.404282 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-47aebc87-aca3-4dee-b5f0-5ea864fda162 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.088150 May 03 09:16:46.404848 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 942/1714] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:46 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:47.180041 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 09:16:47.180961 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: Tue May 3 09:16:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 03 09:16:47.335813 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-aaae5a29-727b-4c5b-91b0-17bb9a249223 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:47.336788 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-aaae5a29-727b-4c5b-91b0-17bb9a249223 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:47.336998 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c403df51-0902-485a-96d8-e9c41418b00e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:47.338112 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c403df51-0902-485a-96d8-e9c41418b00e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:47.347976 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aaae5a29-727b-4c5b-91b0-17bb9a249223 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:47.348712 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aaae5a29-727b-4c5b-91b0-17bb9a249223 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:47.348984 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c403df51-0902-485a-96d8-e9c41418b00e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:47.349702 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c403df51-0902-485a-96d8-e9c41418b00e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:47.349947 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aaae5a29-727b-4c5b-91b0-17bb9a249223 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:47.350710 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aaae5a29-727b-4c5b-91b0-17bb9a249223 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:47.350964 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c403df51-0902-485a-96d8-e9c41418b00e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:47.351651 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c403df51-0902-485a-96d8-e9c41418b00e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:47.540181 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c403df51-0902-485a-96d8-e9c41418b00e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:47.543378 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-aaae5a29-727b-4c5b-91b0-17bb9a249223 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:47.548761 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c403df51-0902-485a-96d8-e9c41418b00e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:47.550273 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c403df51-0902-485a-96d8-e9c41418b00e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:47.551344 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-aaae5a29-727b-4c5b-91b0-17bb9a249223 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.221967 May 03 09:16:47.551526 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c403df51-0902-485a-96d8-e9c41418b00e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.221073 May 03 09:16:47.552176 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 773/1715] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:47 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:47.552328 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 943/1716] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:16:47 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:16:47.556327 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0a589184-297e-436b-bbc8-7fda5e8ddc97 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:47.556951 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0a589184-297e-436b-bbc8-7fda5e8ddc97 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:47.562881 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0a589184-297e-436b-bbc8-7fda5e8ddc97 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:47.563336 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0a589184-297e-436b-bbc8-7fda5e8ddc97 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:47.564168 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0a589184-297e-436b-bbc8-7fda5e8ddc97 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:47.564635 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0a589184-297e-436b-bbc8-7fda5e8ddc97 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:47.628284 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0a589184-297e-436b-bbc8-7fda5e8ddc97 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:47.636559 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0a589184-297e-436b-bbc8-7fda5e8ddc97 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.083678 May 03 09:16:47.637132 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 774/1717] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:47 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:48.570196 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9a33bb31-f263-45f4-b8ec-2519d3e04c53 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:48.570731 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0dc2fc0d-a5d8-4f88-b20e-91befb204d00 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:48.571112 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9a33bb31-f263-45f4-b8ec-2519d3e04c53 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:48.571202 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0dc2fc0d-a5d8-4f88-b20e-91befb204d00 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:48.577603 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0dc2fc0d-a5d8-4f88-b20e-91befb204d00 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:48.577810 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9a33bb31-f263-45f4-b8ec-2519d3e04c53 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:48.578048 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0dc2fc0d-a5d8-4f88-b20e-91befb204d00 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:48.578204 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9a33bb31-f263-45f4-b8ec-2519d3e04c53 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:48.578845 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0dc2fc0d-a5d8-4f88-b20e-91befb204d00 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:48.578999 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9a33bb31-f263-45f4-b8ec-2519d3e04c53 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:48.579246 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0dc2fc0d-a5d8-4f88-b20e-91befb204d00 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:48.579407 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9a33bb31-f263-45f4-b8ec-2519d3e04c53 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:48.770269 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9a33bb31-f263-45f4-b8ec-2519d3e04c53 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:48.774089 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0dc2fc0d-a5d8-4f88-b20e-91befb204d00 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:48.779913 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9a33bb31-f263-45f4-b8ec-2519d3e04c53 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.213824 May 03 09:16:48.780536 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 944/1718] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:48 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:48.783192 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0dc2fc0d-a5d8-4f88-b20e-91befb204d00 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:48.784768 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0dc2fc0d-a5d8-4f88-b20e-91befb204d00 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:48.784941 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f06bfb0d-100e-476b-9c42-9ef2845f0fd5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:48.785537 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f06bfb0d-100e-476b-9c42-9ef2845f0fd5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:48.785943 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0dc2fc0d-a5d8-4f88-b20e-91befb204d00 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.219512 May 03 09:16:48.788326 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 775/1719] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:16:48 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:16:48.791544 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f06bfb0d-100e-476b-9c42-9ef2845f0fd5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:48.792103 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f06bfb0d-100e-476b-9c42-9ef2845f0fd5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:48.792867 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f06bfb0d-100e-476b-9c42-9ef2845f0fd5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:48.793366 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f06bfb0d-100e-476b-9c42-9ef2845f0fd5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:48.857027 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f06bfb0d-100e-476b-9c42-9ef2845f0fd5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:48.864959 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f06bfb0d-100e-476b-9c42-9ef2845f0fd5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.083491 May 03 09:16:48.865534 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 945/1720] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:48 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:49.800181 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-316ca35d-7c3c-44f7-8e97-f03b13f5a03b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:49.800955 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-316ca35d-7c3c-44f7-8e97-f03b13f5a03b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:49.806406 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5a3c3aae-e00e-476d-801a-52c00bf60b98 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:49.807324 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5a3c3aae-e00e-476d-801a-52c00bf60b98 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:49.809700 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-316ca35d-7c3c-44f7-8e97-f03b13f5a03b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:49.810307 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-316ca35d-7c3c-44f7-8e97-f03b13f5a03b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:49.811336 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-316ca35d-7c3c-44f7-8e97-f03b13f5a03b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:49.811962 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-316ca35d-7c3c-44f7-8e97-f03b13f5a03b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:49.815631 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5a3c3aae-e00e-476d-801a-52c00bf60b98 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:49.816262 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5a3c3aae-e00e-476d-801a-52c00bf60b98 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:49.817235 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5a3c3aae-e00e-476d-801a-52c00bf60b98 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:49.817818 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5a3c3aae-e00e-476d-801a-52c00bf60b98 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:49.999939 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-316ca35d-7c3c-44f7-8e97-f03b13f5a03b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:50.002734 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5a3c3aae-e00e-476d-801a-52c00bf60b98 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:50.008020 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-316ca35d-7c3c-44f7-8e97-f03b13f5a03b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.213263 May 03 09:16:50.008798 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 776/1721] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:49 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:50.012264 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5a3c3aae-e00e-476d-801a-52c00bf60b98 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:50.013138 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-bc18dd03-bbd5-43f5-8378-1a60db23b108 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:50.013741 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-bc18dd03-bbd5-43f5-8378-1a60db23b108 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:50.013872 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5a3c3aae-e00e-476d-801a-52c00bf60b98 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:50.014958 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5a3c3aae-e00e-476d-801a-52c00bf60b98 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.213943 May 03 09:16:50.015630 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 946/1722] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:16:49 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:16:50.019556 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bc18dd03-bbd5-43f5-8378-1a60db23b108 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:50.020042 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bc18dd03-bbd5-43f5-8378-1a60db23b108 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:50.020817 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bc18dd03-bbd5-43f5-8378-1a60db23b108 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:50.021255 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bc18dd03-bbd5-43f5-8378-1a60db23b108 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:50.090169 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-bc18dd03-bbd5-43f5-8378-1a60db23b108 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:50.098829 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-bc18dd03-bbd5-43f5-8378-1a60db23b108 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.089257 May 03 09:16:50.099397 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 777/1723] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:50 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:51.028515 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d2a4c590-ed1e-4caf-abfa-a9936a692201 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:51.029244 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d2a4c590-ed1e-4caf-abfa-a9936a692201 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:51.033019 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e79386df-96ab-44e7-9f9e-50aa21e6afd2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:51.033637 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e79386df-96ab-44e7-9f9e-50aa21e6afd2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:51.036175 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d2a4c590-ed1e-4caf-abfa-a9936a692201 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:51.036591 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d2a4c590-ed1e-4caf-abfa-a9936a692201 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:51.037392 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d2a4c590-ed1e-4caf-abfa-a9936a692201 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:51.037819 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d2a4c590-ed1e-4caf-abfa-a9936a692201 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:51.040240 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e79386df-96ab-44e7-9f9e-50aa21e6afd2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:51.040806 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e79386df-96ab-44e7-9f9e-50aa21e6afd2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:51.041581 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e79386df-96ab-44e7-9f9e-50aa21e6afd2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:51.042016 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e79386df-96ab-44e7-9f9e-50aa21e6afd2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:51.225621 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d2a4c590-ed1e-4caf-abfa-a9936a692201 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:51.230038 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e79386df-96ab-44e7-9f9e-50aa21e6afd2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:51.233845 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d2a4c590-ed1e-4caf-abfa-a9936a692201 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.210087 May 03 09:16:51.239520 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 947/1724] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:51 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:51.239676 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e79386df-96ab-44e7-9f9e-50aa21e6afd2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:51.239816 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d4baa0a8-4152-44fb-8e69-b38e42b5294d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:51.239816 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d4baa0a8-4152-44fb-8e69-b38e42b5294d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:51.240333 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e79386df-96ab-44e7-9f9e-50aa21e6afd2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:51.241389 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e79386df-96ab-44e7-9f9e-50aa21e6afd2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.212352 May 03 09:16:51.242220 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 778/1725] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:16:51 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:16:51.245437 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d4baa0a8-4152-44fb-8e69-b38e42b5294d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:51.245882 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d4baa0a8-4152-44fb-8e69-b38e42b5294d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:51.246657 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d4baa0a8-4152-44fb-8e69-b38e42b5294d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:51.247105 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d4baa0a8-4152-44fb-8e69-b38e42b5294d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:51.308618 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d4baa0a8-4152-44fb-8e69-b38e42b5294d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:51.316701 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d4baa0a8-4152-44fb-8e69-b38e42b5294d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.081346 May 03 09:16:51.317280 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 948/1726] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:51 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:52.250843 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9de67885-69f6-4420-a089-e34b2d086872 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:52.251468 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9de67885-69f6-4420-a089-e34b2d086872 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:52.258293 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9de67885-69f6-4420-a089-e34b2d086872 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:52.258743 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9de67885-69f6-4420-a089-e34b2d086872 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:52.259517 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9de67885-69f6-4420-a089-e34b2d086872 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:52.259791 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b1ae3dca-eac4-4f96-82ec-9290fdfefa3d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:52.260255 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9de67885-69f6-4420-a089-e34b2d086872 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:52.260426 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b1ae3dca-eac4-4f96-82ec-9290fdfefa3d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:52.267060 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b1ae3dca-eac4-4f96-82ec-9290fdfefa3d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:52.267478 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b1ae3dca-eac4-4f96-82ec-9290fdfefa3d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:52.268318 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b1ae3dca-eac4-4f96-82ec-9290fdfefa3d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:52.268753 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b1ae3dca-eac4-4f96-82ec-9290fdfefa3d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:52.446603 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9de67885-69f6-4420-a089-e34b2d086872 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:52.451674 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b1ae3dca-eac4-4f96-82ec-9290fdfefa3d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:52.457723 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9de67885-69f6-4420-a089-e34b2d086872 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.210640 May 03 09:16:52.458535 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 779/1727] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:52 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:52.462366 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b1ae3dca-eac4-4f96-82ec-9290fdfefa3d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:52.463088 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-854744bf-1244-4abb-93b8-3b5dba23886b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:52.463691 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-854744bf-1244-4abb-93b8-3b5dba23886b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:52.463880 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b1ae3dca-eac4-4f96-82ec-9290fdfefa3d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:52.465198 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b1ae3dca-eac4-4f96-82ec-9290fdfefa3d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.209261 May 03 09:16:52.465764 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 949/1728] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:16:52 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 09:16:52.469926 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-854744bf-1244-4abb-93b8-3b5dba23886b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:52.470379 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-854744bf-1244-4abb-93b8-3b5dba23886b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:52.471146 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-854744bf-1244-4abb-93b8-3b5dba23886b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:52.471604 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-854744bf-1244-4abb-93b8-3b5dba23886b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:52.532540 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-854744bf-1244-4abb-93b8-3b5dba23886b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:52.541334 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-854744bf-1244-4abb-93b8-3b5dba23886b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.081826 May 03 09:16:52.541902 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 780/1729] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:52 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:53.480267 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-bbcfb567-6b28-4dbe-801a-09580dcc2d82 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:53.481393 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-bbcfb567-6b28-4dbe-801a-09580dcc2d82 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:53.488262 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-43694afe-b00f-40b1-ba88-d4e801bbe8f2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:53.489204 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-43694afe-b00f-40b1-ba88-d4e801bbe8f2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:53.492418 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bbcfb567-6b28-4dbe-801a-09580dcc2d82 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:53.493176 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bbcfb567-6b28-4dbe-801a-09580dcc2d82 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:53.494567 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bbcfb567-6b28-4dbe-801a-09580dcc2d82 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:53.495301 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bbcfb567-6b28-4dbe-801a-09580dcc2d82 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:53.499684 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-43694afe-b00f-40b1-ba88-d4e801bbe8f2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:53.500486 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-43694afe-b00f-40b1-ba88-d4e801bbe8f2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:53.501735 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-43694afe-b00f-40b1-ba88-d4e801bbe8f2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:53.502455 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-43694afe-b00f-40b1-ba88-d4e801bbe8f2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:53.688343 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-43694afe-b00f-40b1-ba88-d4e801bbe8f2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:53.691455 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-bbcfb567-6b28-4dbe-801a-09580dcc2d82 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:53.697897 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-43694afe-b00f-40b1-ba88-d4e801bbe8f2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:53.699405 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-43694afe-b00f-40b1-ba88-d4e801bbe8f2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:53.699584 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-bbcfb567-6b28-4dbe-801a-09580dcc2d82 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.226126 May 03 09:16:53.700125 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 950/1730] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:53 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:53.700572 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-43694afe-b00f-40b1-ba88-d4e801bbe8f2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.218885 May 03 09:16:53.701263 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 781/1731] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:16:53 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:16:53.705020 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-989ef7b2-7860-4ca1-b828-4d4f755a3b9b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:53.705639 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-989ef7b2-7860-4ca1-b828-4d4f755a3b9b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:53.711432 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-989ef7b2-7860-4ca1-b828-4d4f755a3b9b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:53.712120 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-989ef7b2-7860-4ca1-b828-4d4f755a3b9b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:53.713006 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-989ef7b2-7860-4ca1-b828-4d4f755a3b9b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:53.713445 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-989ef7b2-7860-4ca1-b828-4d4f755a3b9b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:53.787081 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-989ef7b2-7860-4ca1-b828-4d4f755a3b9b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:53.798698 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-989ef7b2-7860-4ca1-b828-4d4f755a3b9b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.097263 May 03 09:16:53.799503 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 951/1732] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:53 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:54.722540 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5d16a257-14fe-44bd-8950-45a8e859be9b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:54.723496 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-255969eb-13ab-4292-9b06-68f2cbef914d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:54.724251 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5d16a257-14fe-44bd-8950-45a8e859be9b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:54.724443 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-255969eb-13ab-4292-9b06-68f2cbef914d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:54.734683 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-255969eb-13ab-4292-9b06-68f2cbef914d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:54.735010 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5d16a257-14fe-44bd-8950-45a8e859be9b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:54.735402 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-255969eb-13ab-4292-9b06-68f2cbef914d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:54.735637 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5d16a257-14fe-44bd-8950-45a8e859be9b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:54.736775 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-255969eb-13ab-4292-9b06-68f2cbef914d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:54.737025 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5d16a257-14fe-44bd-8950-45a8e859be9b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:54.737506 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-255969eb-13ab-4292-9b06-68f2cbef914d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:54.737753 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5d16a257-14fe-44bd-8950-45a8e859be9b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:54.936978 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-255969eb-13ab-4292-9b06-68f2cbef914d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:54.941529 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5d16a257-14fe-44bd-8950-45a8e859be9b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:54.951008 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-255969eb-13ab-4292-9b06-68f2cbef914d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:54.951661 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5d16a257-14fe-44bd-8950-45a8e859be9b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.236099 May 03 09:16:54.952331 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 782/1733] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:54 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:54.952614 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-255969eb-13ab-4292-9b06-68f2cbef914d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:54.953825 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-255969eb-13ab-4292-9b06-68f2cbef914d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.237631 May 03 09:16:54.955100 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 952/1734] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:16:54 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:16:54.956977 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-73d55b2f-79ae-4ff5-bd11-e3a654a3689a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:54.957620 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-73d55b2f-79ae-4ff5-bd11-e3a654a3689a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:54.964340 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-73d55b2f-79ae-4ff5-bd11-e3a654a3689a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:54.964812 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-73d55b2f-79ae-4ff5-bd11-e3a654a3689a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:54.965596 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-73d55b2f-79ae-4ff5-bd11-e3a654a3689a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:54.966029 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-73d55b2f-79ae-4ff5-bd11-e3a654a3689a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:55.034031 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-73d55b2f-79ae-4ff5-bd11-e3a654a3689a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:55.044983 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-73d55b2f-79ae-4ff5-bd11-e3a654a3689a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.091692 May 03 09:16:55.045553 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 783/1735] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:54 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:55.974369 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3723c6d6-1e24-4403-bc56-8c27001b0334 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:55.975306 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-3723c6d6-1e24-4403-bc56-8c27001b0334 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:55.976166 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-717d35bb-b555-4721-95e2-7f4b9c9d2116 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:55.977181 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-717d35bb-b555-4721-95e2-7f4b9c9d2116 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:55.985697 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3723c6d6-1e24-4403-bc56-8c27001b0334 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:55.986444 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3723c6d6-1e24-4403-bc56-8c27001b0334 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:55.987573 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-717d35bb-b555-4721-95e2-7f4b9c9d2116 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:55.987901 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3723c6d6-1e24-4403-bc56-8c27001b0334 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:55.988339 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-717d35bb-b555-4721-95e2-7f4b9c9d2116 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:55.988546 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3723c6d6-1e24-4403-bc56-8c27001b0334 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:55.989654 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-717d35bb-b555-4721-95e2-7f4b9c9d2116 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:55.990376 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-717d35bb-b555-4721-95e2-7f4b9c9d2116 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:56.176209 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-3723c6d6-1e24-4403-bc56-8c27001b0334 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:56.179245 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-717d35bb-b555-4721-95e2-7f4b9c9d2116 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:56.184406 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-3723c6d6-1e24-4403-bc56-8c27001b0334 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.217134 May 03 09:16:56.185284 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 953/1736] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:55 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:56.187945 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-717d35bb-b555-4721-95e2-7f4b9c9d2116 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:56.189502 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-717d35bb-b555-4721-95e2-7f4b9c9d2116 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:56.189672 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-94c1caf8-5c78-494a-bd5c-c854e6e293a2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:56.190061 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-94c1caf8-5c78-494a-bd5c-c854e6e293a2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:56.190632 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-717d35bb-b555-4721-95e2-7f4b9c9d2116 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.220993 May 03 09:16:56.194486 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 784/1737] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:16:55 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:16:56.196121 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-94c1caf8-5c78-494a-bd5c-c854e6e293a2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:56.196570 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-94c1caf8-5c78-494a-bd5c-c854e6e293a2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:56.197342 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-94c1caf8-5c78-494a-bd5c-c854e6e293a2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:56.197766 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-94c1caf8-5c78-494a-bd5c-c854e6e293a2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:56.258742 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-94c1caf8-5c78-494a-bd5c-c854e6e293a2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:56.266579 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-94c1caf8-5c78-494a-bd5c-c854e6e293a2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.080585 May 03 09:16:56.267118 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 954/1738] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:56 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:57.204203 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-cc51753f-cabf-4482-a6bd-90a66c642e4f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:57.204998 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-cc51753f-cabf-4482-a6bd-90a66c642e4f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:57.210860 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e4c48d8e-4229-4cf2-8f7d-4c40e8558875 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:57.211922 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e4c48d8e-4229-4cf2-8f7d-4c40e8558875 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:57.215190 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cc51753f-cabf-4482-a6bd-90a66c642e4f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:57.215759 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cc51753f-cabf-4482-a6bd-90a66c642e4f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:57.216768 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cc51753f-cabf-4482-a6bd-90a66c642e4f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:57.217690 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cc51753f-cabf-4482-a6bd-90a66c642e4f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:57.220152 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e4c48d8e-4229-4cf2-8f7d-4c40e8558875 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:57.220717 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e4c48d8e-4229-4cf2-8f7d-4c40e8558875 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:57.221836 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e4c48d8e-4229-4cf2-8f7d-4c40e8558875 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:57.222382 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e4c48d8e-4229-4cf2-8f7d-4c40e8558875 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:57.406292 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-cc51753f-cabf-4482-a6bd-90a66c642e4f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:57.411288 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e4c48d8e-4229-4cf2-8f7d-4c40e8558875 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:57.417005 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-cc51753f-cabf-4482-a6bd-90a66c642e4f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.217747 May 03 09:16:57.417555 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 785/1739] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:57 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:57.421222 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e4c48d8e-4229-4cf2-8f7d-4c40e8558875 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:57.422093 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-8762a986-fbbe-4d1a-81d4-6b2e485cbe30 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:57.422687 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-8762a986-fbbe-4d1a-81d4-6b2e485cbe30 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:57.422826 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e4c48d8e-4229-4cf2-8f7d-4c40e8558875 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:57.423932 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e4c48d8e-4229-4cf2-8f7d-4c40e8558875 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.218258 May 03 09:16:57.424655 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 955/1740] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:16:57 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:16:57.428602 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8762a986-fbbe-4d1a-81d4-6b2e485cbe30 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:57.429050 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8762a986-fbbe-4d1a-81d4-6b2e485cbe30 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:57.429810 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8762a986-fbbe-4d1a-81d4-6b2e485cbe30 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:57.430241 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8762a986-fbbe-4d1a-81d4-6b2e485cbe30 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:57.503224 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-8762a986-fbbe-4d1a-81d4-6b2e485cbe30 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:57.511387 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-8762a986-fbbe-4d1a-81d4-6b2e485cbe30 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.092884 May 03 09:16:57.512003 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 786/1741] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:57 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:58.438500 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-112c87d8-cfee-4463-937a-1442d0551b8b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:58.439473 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-112c87d8-cfee-4463-937a-1442d0551b8b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:58.446393 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d5b8e423-f64c-42e2-91f7-7af2c22d95be tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:58.447580 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d5b8e423-f64c-42e2-91f7-7af2c22d95be tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:58.450201 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-112c87d8-cfee-4463-937a-1442d0551b8b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:58.450988 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-112c87d8-cfee-4463-937a-1442d0551b8b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:58.452324 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-112c87d8-cfee-4463-937a-1442d0551b8b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:58.453038 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-112c87d8-cfee-4463-937a-1442d0551b8b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:58.458056 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d5b8e423-f64c-42e2-91f7-7af2c22d95be tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:58.458818 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d5b8e423-f64c-42e2-91f7-7af2c22d95be tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:58.460144 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d5b8e423-f64c-42e2-91f7-7af2c22d95be tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:58.460877 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d5b8e423-f64c-42e2-91f7-7af2c22d95be tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:58.648856 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-112c87d8-cfee-4463-937a-1442d0551b8b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:58.653195 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d5b8e423-f64c-42e2-91f7-7af2c22d95be tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:58.657353 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-112c87d8-cfee-4463-937a-1442d0551b8b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.225336 May 03 09:16:58.657971 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 956/1742] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:58 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:58.661969 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d5b8e423-f64c-42e2-91f7-7af2c22d95be tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:58.662344 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-37c4df9c-23ea-4ce1-a91f-cbb9cfb47563 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:58.662946 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-37c4df9c-23ea-4ce1-a91f-cbb9cfb47563 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:58.663464 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d5b8e423-f64c-42e2-91f7-7af2c22d95be tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:58.664688 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d5b8e423-f64c-42e2-91f7-7af2c22d95be tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.225137 May 03 09:16:58.665340 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 787/1743] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:16:58 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:16:58.669219 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-37c4df9c-23ea-4ce1-a91f-cbb9cfb47563 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:58.669671 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-37c4df9c-23ea-4ce1-a91f-cbb9cfb47563 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:58.670427 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-37c4df9c-23ea-4ce1-a91f-cbb9cfb47563 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:58.670857 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-37c4df9c-23ea-4ce1-a91f-cbb9cfb47563 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:58.731803 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-37c4df9c-23ea-4ce1-a91f-cbb9cfb47563 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:58.739651 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-37c4df9c-23ea-4ce1-a91f-cbb9cfb47563 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.080756 May 03 09:16:58.740251 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 957/1744] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:58 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:59.678689 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6e1f286c-68de-4190-9e5d-c2a46f6d1e55 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:59.679611 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6e1f286c-68de-4190-9e5d-c2a46f6d1e55 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:59.684479 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-6930f06a-43ed-4f72-9f8b-819f866fe8b1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:59.685035 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-6930f06a-43ed-4f72-9f8b-819f866fe8b1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:59.686987 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6e1f286c-68de-4190-9e5d-c2a46f6d1e55 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:59.687437 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6e1f286c-68de-4190-9e5d-c2a46f6d1e55 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:59.688247 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6e1f286c-68de-4190-9e5d-c2a46f6d1e55 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:59.688684 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6e1f286c-68de-4190-9e5d-c2a46f6d1e55 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:59.691673 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6930f06a-43ed-4f72-9f8b-819f866fe8b1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:59.692135 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6930f06a-43ed-4f72-9f8b-819f866fe8b1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:59.692896 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6930f06a-43ed-4f72-9f8b-819f866fe8b1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:59.693296 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6930f06a-43ed-4f72-9f8b-819f866fe8b1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:59.877074 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6e1f286c-68de-4190-9e5d-c2a46f6d1e55 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:59.880028 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-6930f06a-43ed-4f72-9f8b-819f866fe8b1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:59.886753 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6e1f286c-68de-4190-9e5d-c2a46f6d1e55 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.214618 May 03 09:16:59.887351 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 788/1745] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:59 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:16:59.888907 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-6930f06a-43ed-4f72-9f8b-819f866fe8b1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:59.890442 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-6930f06a-43ed-4f72-9f8b-819f866fe8b1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:59.891699 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-6930f06a-43ed-4f72-9f8b-819f866fe8b1 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.211859 May 03 09:16:59.891904 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f8d90405-5517-4a8e-82d5-55676a55d7a3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:16:59.892682 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f8d90405-5517-4a8e-82d5-55676a55d7a3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:16:59.896591 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 958/1746] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:16:59 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:16:59.902336 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f8d90405-5517-4a8e-82d5-55676a55d7a3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:59.902782 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f8d90405-5517-4a8e-82d5-55676a55d7a3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:59.903535 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f8d90405-5517-4a8e-82d5-55676a55d7a3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:16:59.903998 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f8d90405-5517-4a8e-82d5-55676a55d7a3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:16:59.966902 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f8d90405-5517-4a8e-82d5-55676a55d7a3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:16:59.979130 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f8d90405-5517-4a8e-82d5-55676a55d7a3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.090528 May 03 09:16:59.979909 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 789/1747] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:16:59 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:00.908627 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b8082aa5-622d-4daf-9efd-4a6546530ca5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:00.909682 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b8082aa5-622d-4daf-9efd-4a6546530ca5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:00.914057 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-75687a45-585d-4a16-8173-66d165a09866 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:00.915051 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-75687a45-585d-4a16-8173-66d165a09866 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:00.918465 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b8082aa5-622d-4daf-9efd-4a6546530ca5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:00.918934 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b8082aa5-622d-4daf-9efd-4a6546530ca5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:00.919697 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b8082aa5-622d-4daf-9efd-4a6546530ca5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:00.920237 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b8082aa5-622d-4daf-9efd-4a6546530ca5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:00.921909 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-75687a45-585d-4a16-8173-66d165a09866 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:00.922356 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-75687a45-585d-4a16-8173-66d165a09866 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:00.923114 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-75687a45-585d-4a16-8173-66d165a09866 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:00.923522 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-75687a45-585d-4a16-8173-66d165a09866 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:01.110315 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b8082aa5-622d-4daf-9efd-4a6546530ca5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:01.122427 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b8082aa5-622d-4daf-9efd-4a6546530ca5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.220251 May 03 09:17:01.123288 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 959/1748] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:00 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:01.127935 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f9c5adc1-9ddf-4358-bc0c-2bbdb7e0df22 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:01.128540 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f9c5adc1-9ddf-4358-bc0c-2bbdb7e0df22 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:01.128680 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-75687a45-585d-4a16-8173-66d165a09866 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:01.136931 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f9c5adc1-9ddf-4358-bc0c-2bbdb7e0df22 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:01.137404 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f9c5adc1-9ddf-4358-bc0c-2bbdb7e0df22 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:01.138185 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f9c5adc1-9ddf-4358-bc0c-2bbdb7e0df22 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:01.138605 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f9c5adc1-9ddf-4358-bc0c-2bbdb7e0df22 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:01.138727 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-75687a45-585d-4a16-8173-66d165a09866 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:01.140330 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-75687a45-585d-4a16-8173-66d165a09866 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:01.141547 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-75687a45-585d-4a16-8173-66d165a09866 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.233994 May 03 09:17:01.142087 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 790/1749] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:17:00 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:17:01.211357 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f9c5adc1-9ddf-4358-bc0c-2bbdb7e0df22 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:01.220160 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f9c5adc1-9ddf-4358-bc0c-2bbdb7e0df22 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.095875 May 03 09:17:01.220725 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 960/1750] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:01 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:02.144106 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f7b58141-5c0e-4a05-9809-62cf5f087848 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:02.145163 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f7b58141-5c0e-4a05-9809-62cf5f087848 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:02.153928 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f7b58141-5c0e-4a05-9809-62cf5f087848 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:02.154377 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f7b58141-5c0e-4a05-9809-62cf5f087848 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:02.155236 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f7b58141-5c0e-4a05-9809-62cf5f087848 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:02.155679 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f7b58141-5c0e-4a05-9809-62cf5f087848 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:02.160197 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d60d657a-ed80-4cf3-85fb-3f12cb5b0244 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:02.160854 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d60d657a-ed80-4cf3-85fb-3f12cb5b0244 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:02.167649 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d60d657a-ed80-4cf3-85fb-3f12cb5b0244 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:02.168140 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d60d657a-ed80-4cf3-85fb-3f12cb5b0244 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:02.168902 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d60d657a-ed80-4cf3-85fb-3f12cb5b0244 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:02.169327 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d60d657a-ed80-4cf3-85fb-3f12cb5b0244 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:02.356732 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f7b58141-5c0e-4a05-9809-62cf5f087848 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:02.360735 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d60d657a-ed80-4cf3-85fb-3f12cb5b0244 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:02.365508 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f7b58141-5c0e-4a05-9809-62cf5f087848 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.227756 May 03 09:17:02.371487 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 791/1751] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:02 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:02.372355 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-33c46eb1-6a15-4b60-8f4e-42d7955b6efd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:02.372962 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-33c46eb1-6a15-4b60-8f4e-42d7955b6efd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:02.375066 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d60d657a-ed80-4cf3-85fb-3f12cb5b0244 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:02.376627 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d60d657a-ed80-4cf3-85fb-3f12cb5b0244 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:02.377828 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d60d657a-ed80-4cf3-85fb-3f12cb5b0244 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.221652 May 03 09:17:02.378390 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 961/1752] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:17:02 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:17:02.379105 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-33c46eb1-6a15-4b60-8f4e-42d7955b6efd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:02.379549 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-33c46eb1-6a15-4b60-8f4e-42d7955b6efd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:02.380349 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-33c46eb1-6a15-4b60-8f4e-42d7955b6efd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:02.380774 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-33c46eb1-6a15-4b60-8f4e-42d7955b6efd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:02.444965 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-33c46eb1-6a15-4b60-8f4e-42d7955b6efd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:02.453528 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-33c46eb1-6a15-4b60-8f4e-42d7955b6efd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.086527 May 03 09:17:02.454111 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 792/1753] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:02 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:03.388744 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-4561342e-f6e1-4fc8-b944-7107b629e449 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:03.389710 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-4561342e-f6e1-4fc8-b944-7107b629e449 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:03.400086 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-473936e9-89ad-467d-8766-fb5126cd4823 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:03.400920 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4561342e-f6e1-4fc8-b944-7107b629e449 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:03.401183 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-473936e9-89ad-467d-8766-fb5126cd4823 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:03.401956 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4561342e-f6e1-4fc8-b944-7107b629e449 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:03.403629 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4561342e-f6e1-4fc8-b944-7107b629e449 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:03.404760 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4561342e-f6e1-4fc8-b944-7107b629e449 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:03.411930 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-473936e9-89ad-467d-8766-fb5126cd4823 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:03.412722 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-473936e9-89ad-467d-8766-fb5126cd4823 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:03.414012 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-473936e9-89ad-467d-8766-fb5126cd4823 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:03.414738 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-473936e9-89ad-467d-8766-fb5126cd4823 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:03.595349 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-4561342e-f6e1-4fc8-b944-7107b629e449 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:03.598383 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-473936e9-89ad-467d-8766-fb5126cd4823 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:03.603697 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-4561342e-f6e1-4fc8-b944-7107b629e449 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.221767 May 03 09:17:03.604458 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 962/1754] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:03 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:03.606848 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-473936e9-89ad-467d-8766-fb5126cd4823 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:03.608712 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-473936e9-89ad-467d-8766-fb5126cd4823 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:03.609115 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-0c72db73-d04e-44f6-abc2-203a919aa9e7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:03.609716 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-0c72db73-d04e-44f6-abc2-203a919aa9e7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:03.609867 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-473936e9-89ad-467d-8766-fb5126cd4823 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.216489 May 03 09:17:03.610584 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 793/1755] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:17:03 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:17:03.615476 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0c72db73-d04e-44f6-abc2-203a919aa9e7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:03.615953 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0c72db73-d04e-44f6-abc2-203a919aa9e7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:03.616717 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0c72db73-d04e-44f6-abc2-203a919aa9e7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:03.617138 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0c72db73-d04e-44f6-abc2-203a919aa9e7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:03.679214 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-0c72db73-d04e-44f6-abc2-203a919aa9e7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:03.687058 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-0c72db73-d04e-44f6-abc2-203a919aa9e7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.081672 May 03 09:17:03.687641 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 963/1756] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:03 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:04.625783 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-86ce58c5-880d-4ed6-b433-55442755e1af tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:04.630681 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-86ce58c5-880d-4ed6-b433-55442755e1af tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:04.635172 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-11e2653c-afa0-4073-923c-5d80f40577a7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:04.636419 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-11e2653c-afa0-4073-923c-5d80f40577a7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:04.636886 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-86ce58c5-880d-4ed6-b433-55442755e1af tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:04.637334 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-86ce58c5-880d-4ed6-b433-55442755e1af tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:04.638099 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-86ce58c5-880d-4ed6-b433-55442755e1af tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:04.638526 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-86ce58c5-880d-4ed6-b433-55442755e1af tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:04.643596 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-11e2653c-afa0-4073-923c-5d80f40577a7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:04.644130 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-11e2653c-afa0-4073-923c-5d80f40577a7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:04.644904 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-11e2653c-afa0-4073-923c-5d80f40577a7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:04.645340 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-11e2653c-afa0-4073-923c-5d80f40577a7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:04.806164 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-86ce58c5-880d-4ed6-b433-55442755e1af tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:04.814096 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-86ce58c5-880d-4ed6-b433-55442755e1af tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.195651 May 03 09:17:04.814706 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 794/1757] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:04 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:04.824241 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b3950d32-0e24-4a79-8f64-d20ba7b96a4a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:04.824847 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b3950d32-0e24-4a79-8f64-d20ba7b96a4a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:04.830931 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b3950d32-0e24-4a79-8f64-d20ba7b96a4a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:04.831374 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b3950d32-0e24-4a79-8f64-d20ba7b96a4a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:04.832187 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b3950d32-0e24-4a79-8f64-d20ba7b96a4a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:04.832673 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b3950d32-0e24-4a79-8f64-d20ba7b96a4a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:04.867404 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-11e2653c-afa0-4073-923c-5d80f40577a7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:04.876327 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-11e2653c-afa0-4073-923c-5d80f40577a7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:04.877825 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-11e2653c-afa0-4073-923c-5d80f40577a7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:04.879001 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-11e2653c-afa0-4073-923c-5d80f40577a7 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.250415 May 03 09:17:04.879556 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 964/1758] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:17:04 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:17:04.897780 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b3950d32-0e24-4a79-8f64-d20ba7b96a4a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:04.905967 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b3950d32-0e24-4a79-8f64-d20ba7b96a4a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.090352 May 03 09:17:04.906526 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 795/1759] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:04 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:05.834700 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-1a22a7b9-9329-4920-80cf-45024c96b616 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:05.835736 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-1a22a7b9-9329-4920-80cf-45024c96b616 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:05.844025 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1a22a7b9-9329-4920-80cf-45024c96b616 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:05.844471 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1a22a7b9-9329-4920-80cf-45024c96b616 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:05.845230 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1a22a7b9-9329-4920-80cf-45024c96b616 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:05.845654 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1a22a7b9-9329-4920-80cf-45024c96b616 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:05.896820 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-1602851e-fc53-46c5-a74b-c92a9aeb3bff tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:05.897508 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-1602851e-fc53-46c5-a74b-c92a9aeb3bff tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:05.904452 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1602851e-fc53-46c5-a74b-c92a9aeb3bff tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:05.904973 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1602851e-fc53-46c5-a74b-c92a9aeb3bff tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:05.905848 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1602851e-fc53-46c5-a74b-c92a9aeb3bff tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:05.906257 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1602851e-fc53-46c5-a74b-c92a9aeb3bff tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:06.011432 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-1a22a7b9-9329-4920-80cf-45024c96b616 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:06.020346 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-1a22a7b9-9329-4920-80cf-45024c96b616 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.191733 May 03 09:17:06.021062 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 965/1760] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:05 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:06.025626 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ec2b61d3-d756-4334-8f8a-b3fdf7f4d283 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:06.026340 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ec2b61d3-d756-4334-8f8a-b3fdf7f4d283 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:06.033935 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ec2b61d3-d756-4334-8f8a-b3fdf7f4d283 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:06.034471 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ec2b61d3-d756-4334-8f8a-b3fdf7f4d283 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:06.036028 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ec2b61d3-d756-4334-8f8a-b3fdf7f4d283 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:06.036532 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ec2b61d3-d756-4334-8f8a-b3fdf7f4d283 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:06.057552 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-1602851e-fc53-46c5-a74b-c92a9aeb3bff tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:06.065831 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-1602851e-fc53-46c5-a74b-c92a9aeb3bff tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:06.067323 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-1602851e-fc53-46c5-a74b-c92a9aeb3bff tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:06.068526 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-1602851e-fc53-46c5-a74b-c92a9aeb3bff tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.175720 May 03 09:17:06.069085 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 796/1761] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:17:05 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:17:06.108723 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ec2b61d3-d756-4334-8f8a-b3fdf7f4d283 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:06.120971 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ec2b61d3-d756-4334-8f8a-b3fdf7f4d283 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.098569 May 03 09:17:06.121722 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 966/1762] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:06 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:07.042396 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-42c89094-37cf-4dbe-9eb1-b08291b7a7a7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:07.043459 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-42c89094-37cf-4dbe-9eb1-b08291b7a7a7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:07.054443 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-42c89094-37cf-4dbe-9eb1-b08291b7a7a7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:07.055193 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-42c89094-37cf-4dbe-9eb1-b08291b7a7a7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:07.056518 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-42c89094-37cf-4dbe-9eb1-b08291b7a7a7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:07.057308 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-42c89094-37cf-4dbe-9eb1-b08291b7a7a7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:07.086687 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-80370f36-14f9-44b3-9fc8-1baae91d5340 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:07.087282 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-80370f36-14f9-44b3-9fc8-1baae91d5340 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:07.094384 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-80370f36-14f9-44b3-9fc8-1baae91d5340 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:07.094807 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-80370f36-14f9-44b3-9fc8-1baae91d5340 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:07.095666 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-80370f36-14f9-44b3-9fc8-1baae91d5340 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:07.096213 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-80370f36-14f9-44b3-9fc8-1baae91d5340 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:07.237478 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-42c89094-37cf-4dbe-9eb1-b08291b7a7a7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:07.245954 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-42c89094-37cf-4dbe-9eb1-b08291b7a7a7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.210203 May 03 09:17:07.255978 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 797/1763] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:07 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:07.259392 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-14a240bc-91d1-4579-9497-2e46c18c278b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:07.260032 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-14a240bc-91d1-4579-9497-2e46c18c278b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:07.261068 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-80370f36-14f9-44b3-9fc8-1baae91d5340 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:07.265976 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-14a240bc-91d1-4579-9497-2e46c18c278b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:07.266436 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-14a240bc-91d1-4579-9497-2e46c18c278b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:07.267203 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-14a240bc-91d1-4579-9497-2e46c18c278b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:07.267639 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-14a240bc-91d1-4579-9497-2e46c18c278b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:07.269684 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-80370f36-14f9-44b3-9fc8-1baae91d5340 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:07.271376 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-80370f36-14f9-44b3-9fc8-1baae91d5340 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:07.274526 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-80370f36-14f9-44b3-9fc8-1baae91d5340 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.191819 May 03 09:17:07.283854 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 967/1764] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:17:07 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:17:07.334111 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-14a240bc-91d1-4579-9497-2e46c18c278b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:07.342818 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-14a240bc-91d1-4579-9497-2e46c18c278b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.095300 May 03 09:17:07.343486 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 798/1765] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:07 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:08.262843 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f01c38ef-254a-4f7b-ac16-567c06fc7018 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:08.263414 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f01c38ef-254a-4f7b-ac16-567c06fc7018 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:08.270254 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f01c38ef-254a-4f7b-ac16-567c06fc7018 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:08.270705 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f01c38ef-254a-4f7b-ac16-567c06fc7018 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:08.271459 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f01c38ef-254a-4f7b-ac16-567c06fc7018 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:08.271920 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f01c38ef-254a-4f7b-ac16-567c06fc7018 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:08.293371 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4ae9296f-7014-47c5-a3f4-6cf1e02818e2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:08.293936 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4ae9296f-7014-47c5-a3f4-6cf1e02818e2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:08.300877 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4ae9296f-7014-47c5-a3f4-6cf1e02818e2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:08.301383 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4ae9296f-7014-47c5-a3f4-6cf1e02818e2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:08.302162 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4ae9296f-7014-47c5-a3f4-6cf1e02818e2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:08.302625 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4ae9296f-7014-47c5-a3f4-6cf1e02818e2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:08.472723 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f01c38ef-254a-4f7b-ac16-567c06fc7018 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:08.479401 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-4ae9296f-7014-47c5-a3f4-6cf1e02818e2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:08.481017 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f01c38ef-254a-4f7b-ac16-567c06fc7018 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.222182 May 03 09:17:08.481590 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 968/1766] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:08 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:08.486002 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-0b8add16-7b35-4b2c-9dbe-99fefca5679c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:08.486609 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-0b8add16-7b35-4b2c-9dbe-99fefca5679c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:08.488088 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-4ae9296f-7014-47c5-a3f4-6cf1e02818e2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:08.489601 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-4ae9296f-7014-47c5-a3f4-6cf1e02818e2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:08.490769 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-4ae9296f-7014-47c5-a3f4-6cf1e02818e2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.201515 May 03 09:17:08.491318 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 799/1767] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:17:08 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:17:08.492442 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0b8add16-7b35-4b2c-9dbe-99fefca5679c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:08.492898 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0b8add16-7b35-4b2c-9dbe-99fefca5679c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:08.493672 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0b8add16-7b35-4b2c-9dbe-99fefca5679c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:08.494114 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0b8add16-7b35-4b2c-9dbe-99fefca5679c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:08.554398 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-0b8add16-7b35-4b2c-9dbe-99fefca5679c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:08.562349 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-0b8add16-7b35-4b2c-9dbe-99fefca5679c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.079808 May 03 09:17:08.562891 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 969/1768] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:08 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:09.502192 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-63c06e15-e797-4268-86fb-ae8714ca1785 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:09.503131 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-63c06e15-e797-4268-86fb-ae8714ca1785 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:09.513188 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-036e50f5-24ae-41fa-9b76-9aa33392c29c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:09.514029 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-63c06e15-e797-4268-86fb-ae8714ca1785 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:09.514242 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-036e50f5-24ae-41fa-9b76-9aa33392c29c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:09.514897 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-63c06e15-e797-4268-86fb-ae8714ca1785 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:09.516269 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-63c06e15-e797-4268-86fb-ae8714ca1785 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:09.517059 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-63c06e15-e797-4268-86fb-ae8714ca1785 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:09.524451 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-036e50f5-24ae-41fa-9b76-9aa33392c29c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:09.525208 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-036e50f5-24ae-41fa-9b76-9aa33392c29c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:09.526407 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-036e50f5-24ae-41fa-9b76-9aa33392c29c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:09.526847 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-036e50f5-24ae-41fa-9b76-9aa33392c29c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:09.713265 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-63c06e15-e797-4268-86fb-ae8714ca1785 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:09.716569 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-036e50f5-24ae-41fa-9b76-9aa33392c29c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:09.722177 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-63c06e15-e797-4268-86fb-ae8714ca1785 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.226684 May 03 09:17:09.722840 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 800/1769] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:09 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:09.727430 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-652bb543-0780-4e72-8ca0-fbbe77b294aa tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:09.728161 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-652bb543-0780-4e72-8ca0-fbbe77b294aa tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:09.728830 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-036e50f5-24ae-41fa-9b76-9aa33392c29c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:09.730642 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-036e50f5-24ae-41fa-9b76-9aa33392c29c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:09.732330 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-036e50f5-24ae-41fa-9b76-9aa33392c29c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.225640 May 03 09:17:09.732901 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 970/1770] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:17:09 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:17:09.734356 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-652bb543-0780-4e72-8ca0-fbbe77b294aa tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:09.734813 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-652bb543-0780-4e72-8ca0-fbbe77b294aa tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:09.735596 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-652bb543-0780-4e72-8ca0-fbbe77b294aa tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:09.736071 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-652bb543-0780-4e72-8ca0-fbbe77b294aa tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:09.806959 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-652bb543-0780-4e72-8ca0-fbbe77b294aa tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:09.815313 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-652bb543-0780-4e72-8ca0-fbbe77b294aa tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.091443 May 03 09:17:09.815906 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 801/1771] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:09 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:10.743813 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d4648f01-3510-4a23-92fb-6ed0603e3137 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:10.744817 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d4648f01-3510-4a23-92fb-6ed0603e3137 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:10.755347 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d4648f01-3510-4a23-92fb-6ed0603e3137 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:10.755815 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-489134f6-607a-4ae7-9c51-da75f91e7cc9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:10.756594 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d4648f01-3510-4a23-92fb-6ed0603e3137 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:10.756865 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-489134f6-607a-4ae7-9c51-da75f91e7cc9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:10.757463 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d4648f01-3510-4a23-92fb-6ed0603e3137 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:10.758193 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d4648f01-3510-4a23-92fb-6ed0603e3137 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:10.765828 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-489134f6-607a-4ae7-9c51-da75f91e7cc9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:10.766271 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-489134f6-607a-4ae7-9c51-da75f91e7cc9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:10.767029 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-489134f6-607a-4ae7-9c51-da75f91e7cc9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:10.767455 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-489134f6-607a-4ae7-9c51-da75f91e7cc9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:10.946532 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d4648f01-3510-4a23-92fb-6ed0603e3137 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:10.949521 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-489134f6-607a-4ae7-9c51-da75f91e7cc9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:10.954395 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d4648f01-3510-4a23-92fb-6ed0603e3137 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.217243 May 03 09:17:10.955069 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 971/1772] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:10 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:10.958530 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-489134f6-607a-4ae7-9c51-da75f91e7cc9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:10.959526 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-90b0b165-e8a1-41f6-ba0e-2d62f113c1e0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:10.960124 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-489134f6-607a-4ae7-9c51-da75f91e7cc9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:10.960299 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-90b0b165-e8a1-41f6-ba0e-2d62f113c1e0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:10.961322 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-489134f6-607a-4ae7-9c51-da75f91e7cc9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.212286 May 03 09:17:10.962066 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 802/1773] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:17:10 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:17:10.966557 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-90b0b165-e8a1-41f6-ba0e-2d62f113c1e0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:10.967374 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-90b0b165-e8a1-41f6-ba0e-2d62f113c1e0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:10.968175 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-90b0b165-e8a1-41f6-ba0e-2d62f113c1e0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:10.968612 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-90b0b165-e8a1-41f6-ba0e-2d62f113c1e0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:11.029685 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-90b0b165-e8a1-41f6-ba0e-2d62f113c1e0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:11.037926 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-90b0b165-e8a1-41f6-ba0e-2d62f113c1e0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.081889 May 03 09:17:11.038515 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 972/1774] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:10 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:11.975720 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-35fb6d16-3612-4aec-a7c2-efb2cf0750c4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:11.976795 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-35fb6d16-3612-4aec-a7c2-efb2cf0750c4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:11.983526 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-1a3826e1-c287-40a2-9e5d-9dd2fab10bbd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:11.984132 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-1a3826e1-c287-40a2-9e5d-9dd2fab10bbd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:11.985323 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-35fb6d16-3612-4aec-a7c2-efb2cf0750c4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:11.985778 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-35fb6d16-3612-4aec-a7c2-efb2cf0750c4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:11.986551 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-35fb6d16-3612-4aec-a7c2-efb2cf0750c4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:11.986983 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-35fb6d16-3612-4aec-a7c2-efb2cf0750c4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:11.990359 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1a3826e1-c287-40a2-9e5d-9dd2fab10bbd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:11.990802 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1a3826e1-c287-40a2-9e5d-9dd2fab10bbd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:11.991565 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1a3826e1-c287-40a2-9e5d-9dd2fab10bbd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:11.992008 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1a3826e1-c287-40a2-9e5d-9dd2fab10bbd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:12.171966 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-35fb6d16-3612-4aec-a7c2-efb2cf0750c4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:12.175341 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-1a3826e1-c287-40a2-9e5d-9dd2fab10bbd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:12.180177 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-35fb6d16-3612-4aec-a7c2-efb2cf0750c4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.210903 May 03 09:17:12.180750 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 803/1775] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:11 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:12.183991 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-1a3826e1-c287-40a2-9e5d-9dd2fab10bbd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:12.185121 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-923782a9-a232-44c5-8c42-fca9ce6a784c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:12.185504 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-1a3826e1-c287-40a2-9e5d-9dd2fab10bbd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:12.185743 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-923782a9-a232-44c5-8c42-fca9ce6a784c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:12.186685 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-1a3826e1-c287-40a2-9e5d-9dd2fab10bbd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.208559 May 03 09:17:12.187440 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 973/1776] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:17:11 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:17:12.191508 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-923782a9-a232-44c5-8c42-fca9ce6a784c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:12.191952 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-923782a9-a232-44c5-8c42-fca9ce6a784c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:12.192710 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-923782a9-a232-44c5-8c42-fca9ce6a784c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:12.193137 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-923782a9-a232-44c5-8c42-fca9ce6a784c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:12.253783 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-923782a9-a232-44c5-8c42-fca9ce6a784c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:12.261623 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-923782a9-a232-44c5-8c42-fca9ce6a784c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.079949 May 03 09:17:12.262194 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 804/1777] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:12 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:13.200642 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b41e0bf8-5cdb-4306-8ab3-c3158d04ba95 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:13.201380 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b41e0bf8-5cdb-4306-8ab3-c3158d04ba95 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:13.207230 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6ef948af-9c98-46f0-96c3-63a47fc38655 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:13.208013 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6ef948af-9c98-46f0-96c3-63a47fc38655 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:13.208744 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b41e0bf8-5cdb-4306-8ab3-c3158d04ba95 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:13.209197 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b41e0bf8-5cdb-4306-8ab3-c3158d04ba95 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:13.209972 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b41e0bf8-5cdb-4306-8ab3-c3158d04ba95 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:13.210405 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b41e0bf8-5cdb-4306-8ab3-c3158d04ba95 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:13.214758 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6ef948af-9c98-46f0-96c3-63a47fc38655 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:13.215155 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6ef948af-9c98-46f0-96c3-63a47fc38655 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:13.216181 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6ef948af-9c98-46f0-96c3-63a47fc38655 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:13.216625 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6ef948af-9c98-46f0-96c3-63a47fc38655 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:13.672729 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b41e0bf8-5cdb-4306-8ab3-c3158d04ba95 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:13.676740 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6ef948af-9c98-46f0-96c3-63a47fc38655 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:13.681436 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b41e0bf8-5cdb-4306-8ab3-c3158d04ba95 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.486880 May 03 09:17:13.681997 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 974/1778] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:13 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:13.685686 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6ef948af-9c98-46f0-96c3-63a47fc38655 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:13.686462 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-7892d9ee-308c-41cf-b6b0-f4b8cf11fd2d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:13.687068 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-7892d9ee-308c-41cf-b6b0-f4b8cf11fd2d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:13.687187 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6ef948af-9c98-46f0-96c3-63a47fc38655 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:13.688368 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6ef948af-9c98-46f0-96c3-63a47fc38655 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.486714 May 03 09:17:13.689261 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 805/1779] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:17:13 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:17:13.693338 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7892d9ee-308c-41cf-b6b0-f4b8cf11fd2d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:13.693780 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7892d9ee-308c-41cf-b6b0-f4b8cf11fd2d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:13.694557 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7892d9ee-308c-41cf-b6b0-f4b8cf11fd2d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:13.694985 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7892d9ee-308c-41cf-b6b0-f4b8cf11fd2d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:13.760127 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7892d9ee-308c-41cf-b6b0-f4b8cf11fd2d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:13.768186 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-7892d9ee-308c-41cf-b6b0-f4b8cf11fd2d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.085200 May 03 09:17:13.768757 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 975/1780] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:13 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:14.704926 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a7f3d12d-5288-4ded-8a2d-7f7e19f0ea58 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:14.706558 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a7f3d12d-5288-4ded-8a2d-7f7e19f0ea58 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:14.710896 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a50bae83-a99e-43f4-bb93-3c69ff42aa70 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:14.711999 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a50bae83-a99e-43f4-bb93-3c69ff42aa70 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:14.717289 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a7f3d12d-5288-4ded-8a2d-7f7e19f0ea58 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:14.717734 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a7f3d12d-5288-4ded-8a2d-7f7e19f0ea58 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:14.718518 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a7f3d12d-5288-4ded-8a2d-7f7e19f0ea58 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:14.718953 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a7f3d12d-5288-4ded-8a2d-7f7e19f0ea58 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:14.721773 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a50bae83-a99e-43f4-bb93-3c69ff42aa70 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:14.722298 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a50bae83-a99e-43f4-bb93-3c69ff42aa70 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:14.723253 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a50bae83-a99e-43f4-bb93-3c69ff42aa70 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:14.724057 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a50bae83-a99e-43f4-bb93-3c69ff42aa70 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:14.911063 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a7f3d12d-5288-4ded-8a2d-7f7e19f0ea58 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:14.913997 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a50bae83-a99e-43f4-bb93-3c69ff42aa70 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:14.919158 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a7f3d12d-5288-4ded-8a2d-7f7e19f0ea58 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.222753 May 03 09:17:14.919847 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 806/1781] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:14 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:14.922620 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a50bae83-a99e-43f4-bb93-3c69ff42aa70 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:14.924176 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a50bae83-a99e-43f4-bb93-3c69ff42aa70 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:14.924543 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-fc7bfd65-3049-46d2-99d9-e1c37006be09 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:14.925216 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-fc7bfd65-3049-46d2-99d9-e1c37006be09 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:14.925373 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a50bae83-a99e-43f4-bb93-3c69ff42aa70 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.221675 May 03 09:17:14.926082 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 976/1782] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:17:14 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:17:14.931287 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fc7bfd65-3049-46d2-99d9-e1c37006be09 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:14.931852 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fc7bfd65-3049-46d2-99d9-e1c37006be09 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:14.932683 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fc7bfd65-3049-46d2-99d9-e1c37006be09 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:14.933179 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fc7bfd65-3049-46d2-99d9-e1c37006be09 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:14.996762 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-fc7bfd65-3049-46d2-99d9-e1c37006be09 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:15.004914 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-fc7bfd65-3049-46d2-99d9-e1c37006be09 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.084018 May 03 09:17:15.005480 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 807/1783] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:14 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:15.941058 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-0df6ff81-7a78-40bf-b60f-540e35f96427 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:15.942018 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-0df6ff81-7a78-40bf-b60f-540e35f96427 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:15.947366 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f9186c26-db90-4be8-95a5-9d1906f7fbff tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:15.948436 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f9186c26-db90-4be8-95a5-9d1906f7fbff tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:15.951794 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0df6ff81-7a78-40bf-b60f-540e35f96427 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:15.952244 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0df6ff81-7a78-40bf-b60f-540e35f96427 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:15.953017 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0df6ff81-7a78-40bf-b60f-540e35f96427 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:15.953444 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0df6ff81-7a78-40bf-b60f-540e35f96427 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:15.955583 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f9186c26-db90-4be8-95a5-9d1906f7fbff tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:15.956101 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f9186c26-db90-4be8-95a5-9d1906f7fbff tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:15.956858 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f9186c26-db90-4be8-95a5-9d1906f7fbff tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:15.957297 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f9186c26-db90-4be8-95a5-9d1906f7fbff tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:16.140279 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-0df6ff81-7a78-40bf-b60f-540e35f96427 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:16.143476 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f9186c26-db90-4be8-95a5-9d1906f7fbff tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:16.148536 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-0df6ff81-7a78-40bf-b60f-540e35f96427 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.214367 May 03 09:17:16.149317 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 977/1784] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:15 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:16.153638 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-8c6fbadd-1472-4338-8531-98f684bdc10f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:16.154277 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-8c6fbadd-1472-4338-8531-98f684bdc10f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:16.156862 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f9186c26-db90-4be8-95a5-9d1906f7fbff tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:16.158371 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f9186c26-db90-4be8-95a5-9d1906f7fbff tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:16.159543 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f9186c26-db90-4be8-95a5-9d1906f7fbff tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.218705 May 03 09:17:16.160173 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 808/1785] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:17:15 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:17:16.160418 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8c6fbadd-1472-4338-8531-98f684bdc10f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:16.160899 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8c6fbadd-1472-4338-8531-98f684bdc10f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:16.161645 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8c6fbadd-1472-4338-8531-98f684bdc10f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:16.162071 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8c6fbadd-1472-4338-8531-98f684bdc10f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:16.222462 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-8c6fbadd-1472-4338-8531-98f684bdc10f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:16.230422 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-8c6fbadd-1472-4338-8531-98f684bdc10f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.080356 May 03 09:17:16.230959 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 978/1786] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:16 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:17.170298 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a9a40c83-1709-47e6-a563-a0258421c8f0 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:17.170958 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a9a40c83-1709-47e6-a563-a0258421c8f0 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:17.177280 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e275959a-b791-4da5-9113-9a246c308c72 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:17.177777 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a9a40c83-1709-47e6-a563-a0258421c8f0 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:17.177889 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e275959a-b791-4da5-9113-9a246c308c72 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:17.178114 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a9a40c83-1709-47e6-a563-a0258421c8f0 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:17.178880 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a9a40c83-1709-47e6-a563-a0258421c8f0 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:17.179315 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a9a40c83-1709-47e6-a563-a0258421c8f0 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:17.184596 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e275959a-b791-4da5-9113-9a246c308c72 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:17.185049 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e275959a-b791-4da5-9113-9a246c308c72 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:17.185816 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e275959a-b791-4da5-9113-9a246c308c72 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:17.186248 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e275959a-b791-4da5-9113-9a246c308c72 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:17.374003 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a9a40c83-1709-47e6-a563-a0258421c8f0 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:17.378356 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e275959a-b791-4da5-9113-9a246c308c72 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:17.386476 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a9a40c83-1709-47e6-a563-a0258421c8f0 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.222668 May 03 09:17:17.387314 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 809/1787] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:17 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:17.390005 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e275959a-b791-4da5-9113-9a246c308c72 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:17.391507 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e275959a-b791-4da5-9113-9a246c308c72 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:17.391848 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ec206f3d-41e9-443c-8866-124372a503e9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:17.392484 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ec206f3d-41e9-443c-8866-124372a503e9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:17.392790 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e275959a-b791-4da5-9113-9a246c308c72 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.219584 May 03 09:17:17.393518 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 979/1788] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:17:17 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:17:17.398465 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ec206f3d-41e9-443c-8866-124372a503e9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:17.398903 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ec206f3d-41e9-443c-8866-124372a503e9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:17.399679 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ec206f3d-41e9-443c-8866-124372a503e9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:17.400140 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ec206f3d-41e9-443c-8866-124372a503e9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:17.460180 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ec206f3d-41e9-443c-8866-124372a503e9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:17.468546 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ec206f3d-41e9-443c-8866-124372a503e9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.080259 May 03 09:17:17.469120 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 810/1789] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:17 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:18.408663 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b718de7c-ba0f-4a91-b20e-a01e00ee1d20 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:18.409936 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b718de7c-ba0f-4a91-b20e-a01e00ee1d20 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:18.414662 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e7957997-ac5a-4d9f-a2cb-52a1b81e9152 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:18.415669 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e7957997-ac5a-4d9f-a2cb-52a1b81e9152 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:18.420980 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b718de7c-ba0f-4a91-b20e-a01e00ee1d20 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:18.421758 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b718de7c-ba0f-4a91-b20e-a01e00ee1d20 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:18.423028 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b718de7c-ba0f-4a91-b20e-a01e00ee1d20 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:18.423739 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b718de7c-ba0f-4a91-b20e-a01e00ee1d20 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:18.425503 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e7957997-ac5a-4d9f-a2cb-52a1b81e9152 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:18.426248 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e7957997-ac5a-4d9f-a2cb-52a1b81e9152 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:18.427635 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e7957997-ac5a-4d9f-a2cb-52a1b81e9152 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:18.428443 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e7957997-ac5a-4d9f-a2cb-52a1b81e9152 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:18.616385 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b718de7c-ba0f-4a91-b20e-a01e00ee1d20 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:18.621262 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e7957997-ac5a-4d9f-a2cb-52a1b81e9152 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:18.628326 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b718de7c-ba0f-4a91-b20e-a01e00ee1d20 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.226264 May 03 09:17:18.628952 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 980/1790] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:18 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:18.630735 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e7957997-ac5a-4d9f-a2cb-52a1b81e9152 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:18.632320 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e7957997-ac5a-4d9f-a2cb-52a1b81e9152 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:18.633499 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e7957997-ac5a-4d9f-a2cb-52a1b81e9152 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.225356 May 03 09:17:18.633649 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-2a0ada64-bbd8-4b74-bfcd-2231caa3231b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:18.641059 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 811/1791] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:17:18 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:17:18.641225 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-2a0ada64-bbd8-4b74-bfcd-2231caa3231b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:18.641225 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2a0ada64-bbd8-4b74-bfcd-2231caa3231b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:18.641225 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2a0ada64-bbd8-4b74-bfcd-2231caa3231b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:18.641756 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2a0ada64-bbd8-4b74-bfcd-2231caa3231b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:18.642188 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2a0ada64-bbd8-4b74-bfcd-2231caa3231b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:18.712359 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-2a0ada64-bbd8-4b74-bfcd-2231caa3231b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:18.720748 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-2a0ada64-bbd8-4b74-bfcd-2231caa3231b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.090874 May 03 09:17:18.721318 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 981/1792] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:18 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:19.650198 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a5e18003-6556-4399-8d40-8f0e9c39bd17 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:19.651419 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a5e18003-6556-4399-8d40-8f0e9c39bd17 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:19.654690 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a640ca88-e47d-41e2-9971-4ce5dd6c7901 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:19.655724 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a640ca88-e47d-41e2-9971-4ce5dd6c7901 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:19.662250 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a5e18003-6556-4399-8d40-8f0e9c39bd17 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:19.662999 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a5e18003-6556-4399-8d40-8f0e9c39bd17 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:19.664298 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a5e18003-6556-4399-8d40-8f0e9c39bd17 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:19.665068 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a5e18003-6556-4399-8d40-8f0e9c39bd17 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:19.666278 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a640ca88-e47d-41e2-9971-4ce5dd6c7901 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:19.667067 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a640ca88-e47d-41e2-9971-4ce5dd6c7901 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:19.668353 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a640ca88-e47d-41e2-9971-4ce5dd6c7901 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:19.669073 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a640ca88-e47d-41e2-9971-4ce5dd6c7901 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:19.855268 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a5e18003-6556-4399-8d40-8f0e9c39bd17 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:19.859170 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a640ca88-e47d-41e2-9971-4ce5dd6c7901 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:19.863279 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a5e18003-6556-4399-8d40-8f0e9c39bd17 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.219698 May 03 09:17:19.864099 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 812/1793] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:19 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:19.868119 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a640ca88-e47d-41e2-9971-4ce5dd6c7901 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:19.868389 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-93a4f458-d9e6-4d0c-9e53-d270c38e8f6d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:19.868975 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-93a4f458-d9e6-4d0c-9e53-d270c38e8f6d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:19.869623 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a640ca88-e47d-41e2-9971-4ce5dd6c7901 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:19.870798 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a640ca88-e47d-41e2-9971-4ce5dd6c7901 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.222592 May 03 09:17:19.881400 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 982/1794] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:17:19 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:17:19.881579 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-93a4f458-d9e6-4d0c-9e53-d270c38e8f6d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:19.881579 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-93a4f458-d9e6-4d0c-9e53-d270c38e8f6d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:19.881579 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-93a4f458-d9e6-4d0c-9e53-d270c38e8f6d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:19.881579 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-93a4f458-d9e6-4d0c-9e53-d270c38e8f6d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:19.936662 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-93a4f458-d9e6-4d0c-9e53-d270c38e8f6d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:19.944343 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-93a4f458-d9e6-4d0c-9e53-d270c38e8f6d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.079459 May 03 09:17:19.945028 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 813/1795] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:19 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:20.884892 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9874bc23-e857-4486-8564-8e21cb61378c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:20.885747 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9874bc23-e857-4486-8564-8e21cb61378c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:20.893150 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f62cffed-8edf-41d9-97bf-fb7d7b0106a6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:20.894168 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f62cffed-8edf-41d9-97bf-fb7d7b0106a6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:20.896436 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9874bc23-e857-4486-8564-8e21cb61378c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:20.897209 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9874bc23-e857-4486-8564-8e21cb61378c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:20.898433 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9874bc23-e857-4486-8564-8e21cb61378c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:20.899137 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9874bc23-e857-4486-8564-8e21cb61378c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:20.904793 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f62cffed-8edf-41d9-97bf-fb7d7b0106a6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:20.905249 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f62cffed-8edf-41d9-97bf-fb7d7b0106a6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:20.906021 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f62cffed-8edf-41d9-97bf-fb7d7b0106a6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:20.906457 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f62cffed-8edf-41d9-97bf-fb7d7b0106a6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:21.096399 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9874bc23-e857-4486-8564-8e21cb61378c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:21.100765 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f62cffed-8edf-41d9-97bf-fb7d7b0106a6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:21.108560 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9874bc23-e857-4486-8564-8e21cb61378c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.230310 May 03 09:17:21.109446 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 983/1796] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:20 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:21.111930 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f62cffed-8edf-41d9-97bf-fb7d7b0106a6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:21.113494 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f62cffed-8edf-41d9-97bf-fb7d7b0106a6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:21.114676 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f62cffed-8edf-41d9-97bf-fb7d7b0106a6 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.228221 May 03 09:17:21.115412 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 814/1797] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:17:20 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:17:21.115796 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-520e451c-c7d4-46dd-8531-37079ae10470 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:21.116472 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-520e451c-c7d4-46dd-8531-37079ae10470 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:21.122799 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-520e451c-c7d4-46dd-8531-37079ae10470 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:21.123259 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-520e451c-c7d4-46dd-8531-37079ae10470 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:21.124068 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-520e451c-c7d4-46dd-8531-37079ae10470 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:21.124513 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-520e451c-c7d4-46dd-8531-37079ae10470 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:21.185212 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-520e451c-c7d4-46dd-8531-37079ae10470 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:21.193333 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-520e451c-c7d4-46dd-8531-37079ae10470 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.082662 May 03 09:17:21.193918 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 984/1798] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:21 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:22.130158 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-99782069-7a39-4f18-899e-864d130ca698 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:22.131110 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-99782069-7a39-4f18-899e-864d130ca698 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:22.136657 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-30de5834-009c-406d-bc0c-032780a54985 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:22.137755 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-30de5834-009c-406d-bc0c-032780a54985 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:22.142018 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-99782069-7a39-4f18-899e-864d130ca698 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:22.142813 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-99782069-7a39-4f18-899e-864d130ca698 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:22.144151 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-99782069-7a39-4f18-899e-864d130ca698 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:22.144890 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-99782069-7a39-4f18-899e-864d130ca698 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:22.147572 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-30de5834-009c-406d-bc0c-032780a54985 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:22.148356 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-30de5834-009c-406d-bc0c-032780a54985 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:22.149603 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-30de5834-009c-406d-bc0c-032780a54985 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:22.150306 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-30de5834-009c-406d-bc0c-032780a54985 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:22.337727 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-99782069-7a39-4f18-899e-864d130ca698 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:22.340864 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-30de5834-009c-406d-bc0c-032780a54985 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:22.346357 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-99782069-7a39-4f18-899e-864d130ca698 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.222944 May 03 09:17:22.346959 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 815/1799] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:22 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:22.349696 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-30de5834-009c-406d-bc0c-032780a54985 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:22.351188 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-30de5834-009c-406d-bc0c-032780a54985 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:22.351384 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-82682d6e-ed1a-4cf8-8f2f-7a5c6ff10c1f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:22.351988 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-82682d6e-ed1a-4cf8-8f2f-7a5c6ff10c1f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:22.352451 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-30de5834-009c-406d-bc0c-032780a54985 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.222263 May 03 09:17:22.353123 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 985/1800] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:17:22 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:17:22.357686 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-82682d6e-ed1a-4cf8-8f2f-7a5c6ff10c1f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:22.358134 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-82682d6e-ed1a-4cf8-8f2f-7a5c6ff10c1f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:22.358897 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-82682d6e-ed1a-4cf8-8f2f-7a5c6ff10c1f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:22.359328 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-82682d6e-ed1a-4cf8-8f2f-7a5c6ff10c1f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:22.424880 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-82682d6e-ed1a-4cf8-8f2f-7a5c6ff10c1f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:22.435096 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-82682d6e-ed1a-4cf8-8f2f-7a5c6ff10c1f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.087154 May 03 09:17:22.435933 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 816/1801] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:22 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:23.364348 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-41ea418b-c3b2-40db-8f56-1bfbc9f332af tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:23.364952 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-41ea418b-c3b2-40db-8f56-1bfbc9f332af tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:23.370674 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7142de4e-4068-4cc4-97ee-08ec710feeda tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:23.371307 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7142de4e-4068-4cc4-97ee-08ec710feeda tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:23.371802 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-41ea418b-c3b2-40db-8f56-1bfbc9f332af tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:23.372352 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-41ea418b-c3b2-40db-8f56-1bfbc9f332af tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:23.373139 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-41ea418b-c3b2-40db-8f56-1bfbc9f332af tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:23.376090 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-41ea418b-c3b2-40db-8f56-1bfbc9f332af tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:23.377975 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7142de4e-4068-4cc4-97ee-08ec710feeda tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:23.378462 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7142de4e-4068-4cc4-97ee-08ec710feeda tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:23.379239 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7142de4e-4068-4cc4-97ee-08ec710feeda tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:23.379691 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7142de4e-4068-4cc4-97ee-08ec710feeda tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:23.566600 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-41ea418b-c3b2-40db-8f56-1bfbc9f332af tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:23.569513 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7142de4e-4068-4cc4-97ee-08ec710feeda tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:23.574550 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-41ea418b-c3b2-40db-8f56-1bfbc9f332af tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.214435 May 03 09:17:23.575182 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 986/1802] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:23 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:23.577938 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7142de4e-4068-4cc4-97ee-08ec710feeda tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:23.579460 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7142de4e-4068-4cc4-97ee-08ec710feeda tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:23.579962 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-26b0a279-966d-42c2-9773-4bf9e2cde980 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:23.580623 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-26b0a279-966d-42c2-9773-4bf9e2cde980 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:23.580767 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7142de4e-4068-4cc4-97ee-08ec710feeda tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.214234 May 03 09:17:23.581373 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 817/1803] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:17:23 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:17:23.586925 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-26b0a279-966d-42c2-9773-4bf9e2cde980 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:23.587373 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-26b0a279-966d-42c2-9773-4bf9e2cde980 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:23.588158 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-26b0a279-966d-42c2-9773-4bf9e2cde980 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:23.588588 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-26b0a279-966d-42c2-9773-4bf9e2cde980 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:23.649660 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-26b0a279-966d-42c2-9773-4bf9e2cde980 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:23.658022 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-26b0a279-966d-42c2-9773-4bf9e2cde980 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.081815 May 03 09:17:23.658634 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 987/1804] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:23 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:24.595137 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f5e6d345-5e7d-4e24-994b-f6432261ad0b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:24.595953 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f5e6d345-5e7d-4e24-994b-f6432261ad0b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:24.599258 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-7e18d967-9ff2-407d-a00e-a24322b3fa55 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:24.599924 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-7e18d967-9ff2-407d-a00e-a24322b3fa55 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:24.602790 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f5e6d345-5e7d-4e24-994b-f6432261ad0b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:24.603264 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f5e6d345-5e7d-4e24-994b-f6432261ad0b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:24.604173 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f5e6d345-5e7d-4e24-994b-f6432261ad0b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:24.604660 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f5e6d345-5e7d-4e24-994b-f6432261ad0b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:24.606808 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7e18d967-9ff2-407d-a00e-a24322b3fa55 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:24.607286 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7e18d967-9ff2-407d-a00e-a24322b3fa55 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:24.608108 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7e18d967-9ff2-407d-a00e-a24322b3fa55 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:24.608560 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7e18d967-9ff2-407d-a00e-a24322b3fa55 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:24.794633 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f5e6d345-5e7d-4e24-994b-f6432261ad0b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:24.798131 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7e18d967-9ff2-407d-a00e-a24322b3fa55 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:24.803468 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f5e6d345-5e7d-4e24-994b-f6432261ad0b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.213806 May 03 09:17:24.804237 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 818/1805] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:24 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:24.808830 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c2a05754-370d-4db4-9129-754bfb8ac71d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:24.808980 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7e18d967-9ff2-407d-a00e-a24322b3fa55 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:24.809443 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c2a05754-370d-4db4-9129-754bfb8ac71d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:24.810375 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7e18d967-9ff2-407d-a00e-a24322b3fa55 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:24.811707 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-7e18d967-9ff2-407d-a00e-a24322b3fa55 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.216614 May 03 09:17:24.812401 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 988/1806] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:17:24 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:17:24.815660 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c2a05754-370d-4db4-9129-754bfb8ac71d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:24.816278 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c2a05754-370d-4db4-9129-754bfb8ac71d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:24.817063 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c2a05754-370d-4db4-9129-754bfb8ac71d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:24.817537 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c2a05754-370d-4db4-9129-754bfb8ac71d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:24.880182 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c2a05754-370d-4db4-9129-754bfb8ac71d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:24.888018 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c2a05754-370d-4db4-9129-754bfb8ac71d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.082780 May 03 09:17:24.888549 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 819/1807] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:24 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:25.825598 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-1181bc8d-67a4-4285-99a0-9f6a4b2058e6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:25.826686 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-1181bc8d-67a4-4285-99a0-9f6a4b2058e6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:25.833814 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d59afb8f-0996-4391-a4b3-6703d310e4b0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:25.834822 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d59afb8f-0996-4391-a4b3-6703d310e4b0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:25.837049 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1181bc8d-67a4-4285-99a0-9f6a4b2058e6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:25.837807 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1181bc8d-67a4-4285-99a0-9f6a4b2058e6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:25.839066 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1181bc8d-67a4-4285-99a0-9f6a4b2058e6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:25.839821 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1181bc8d-67a4-4285-99a0-9f6a4b2058e6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:25.844480 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d59afb8f-0996-4391-a4b3-6703d310e4b0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:25.844960 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d59afb8f-0996-4391-a4b3-6703d310e4b0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:25.845727 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d59afb8f-0996-4391-a4b3-6703d310e4b0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:25.846147 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d59afb8f-0996-4391-a4b3-6703d310e4b0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:26.022907 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-1181bc8d-67a4-4285-99a0-9f6a4b2058e6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:26.029777 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d59afb8f-0996-4391-a4b3-6703d310e4b0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:26.030964 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-1181bc8d-67a4-4285-99a0-9f6a4b2058e6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.212241 May 03 09:17:26.031846 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 989/1808] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:25 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:26.036087 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-003bdd16-6b98-4e34-905f-ef9eb83c536e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:26.036696 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-003bdd16-6b98-4e34-905f-ef9eb83c536e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:26.042568 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-003bdd16-6b98-4e34-905f-ef9eb83c536e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:26.042734 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d59afb8f-0996-4391-a4b3-6703d310e4b0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:26.043019 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-003bdd16-6b98-4e34-905f-ef9eb83c536e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:26.043799 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-003bdd16-6b98-4e34-905f-ef9eb83c536e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:26.044149 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d59afb8f-0996-4391-a4b3-6703d310e4b0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:26.044277 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-003bdd16-6b98-4e34-905f-ef9eb83c536e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:26.045341 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d59afb8f-0996-4391-a4b3-6703d310e4b0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.218082 May 03 09:17:26.045932 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 820/1809] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:17:25 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:17:26.104033 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-003bdd16-6b98-4e34-905f-ef9eb83c536e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:26.112370 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-003bdd16-6b98-4e34-905f-ef9eb83c536e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.079799 May 03 09:17:26.112944 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 990/1810] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:26 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:27.052464 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-8f8e359f-28b2-4dac-a7bd-5448a88b5ce0 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:27.053497 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-8f8e359f-28b2-4dac-a7bd-5448a88b5ce0 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:27.064335 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8f8e359f-28b2-4dac-a7bd-5448a88b5ce0 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:27.065055 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8f8e359f-28b2-4dac-a7bd-5448a88b5ce0 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:27.066320 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8f8e359f-28b2-4dac-a7bd-5448a88b5ce0 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:27.067040 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8f8e359f-28b2-4dac-a7bd-5448a88b5ce0 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:27.067536 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ab3bc7fd-5844-4858-adcc-cf75291e4ef3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:27.068616 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ab3bc7fd-5844-4858-adcc-cf75291e4ef3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:27.078398 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ab3bc7fd-5844-4858-adcc-cf75291e4ef3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:27.078842 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ab3bc7fd-5844-4858-adcc-cf75291e4ef3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:27.079654 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ab3bc7fd-5844-4858-adcc-cf75291e4ef3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:27.080122 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ab3bc7fd-5844-4858-adcc-cf75291e4ef3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:27.265759 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-8f8e359f-28b2-4dac-a7bd-5448a88b5ce0 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:27.269025 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ab3bc7fd-5844-4858-adcc-cf75291e4ef3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:27.274086 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-8f8e359f-28b2-4dac-a7bd-5448a88b5ce0 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.228158 May 03 09:17:27.274722 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 821/1811] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:27 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:27.278003 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ab3bc7fd-5844-4858-adcc-cf75291e4ef3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:27.279150 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-727c25c3-2f79-421b-b7dc-bc69a8dec389 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:27.279837 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ab3bc7fd-5844-4858-adcc-cf75291e4ef3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:27.279963 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-727c25c3-2f79-421b-b7dc-bc69a8dec389 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:27.281886 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ab3bc7fd-5844-4858-adcc-cf75291e4ef3 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.220648 May 03 09:17:27.282923 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 991/1812] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:17:27 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:17:27.286013 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-727c25c3-2f79-421b-b7dc-bc69a8dec389 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:27.286460 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-727c25c3-2f79-421b-b7dc-bc69a8dec389 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:27.287212 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-727c25c3-2f79-421b-b7dc-bc69a8dec389 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:27.287644 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-727c25c3-2f79-421b-b7dc-bc69a8dec389 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:27.362465 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-727c25c3-2f79-421b-b7dc-bc69a8dec389 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:27.370316 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-727c25c3-2f79-421b-b7dc-bc69a8dec389 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.094681 May 03 09:17:27.370877 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 822/1813] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:27 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:28.292853 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d70aea08-01f7-41e9-afb9-50759ea36873 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:28.293663 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d70aea08-01f7-41e9-afb9-50759ea36873 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:28.302399 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d70aea08-01f7-41e9-afb9-50759ea36873 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:28.303164 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d70aea08-01f7-41e9-afb9-50759ea36873 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:28.304075 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d70aea08-01f7-41e9-afb9-50759ea36873 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:28.304529 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7f0e4d18-0e1b-4ff1-b7f7-0fff9d37c87e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:28.305116 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d70aea08-01f7-41e9-afb9-50759ea36873 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:28.305385 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7f0e4d18-0e1b-4ff1-b7f7-0fff9d37c87e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:28.313978 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7f0e4d18-0e1b-4ff1-b7f7-0fff9d37c87e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:28.314432 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7f0e4d18-0e1b-4ff1-b7f7-0fff9d37c87e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:28.315200 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7f0e4d18-0e1b-4ff1-b7f7-0fff9d37c87e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:28.315635 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7f0e4d18-0e1b-4ff1-b7f7-0fff9d37c87e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:28.493326 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d70aea08-01f7-41e9-afb9-50759ea36873 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:28.501240 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7f0e4d18-0e1b-4ff1-b7f7-0fff9d37c87e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:28.504039 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d70aea08-01f7-41e9-afb9-50759ea36873 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.216245 May 03 09:17:28.504833 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 992/1814] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:28 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:28.509771 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-50e024dc-f64c-4b95-a995-8356871fc425 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:28.510382 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-50e024dc-f64c-4b95-a995-8356871fc425 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:28.510994 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7f0e4d18-0e1b-4ff1-b7f7-0fff9d37c87e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:28.512534 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7f0e4d18-0e1b-4ff1-b7f7-0fff9d37c87e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:28.513738 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7f0e4d18-0e1b-4ff1-b7f7-0fff9d37c87e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.214567 May 03 09:17:28.514294 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 823/1815] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:17:28 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:17:28.516741 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-50e024dc-f64c-4b95-a995-8356871fc425 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:28.517192 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-50e024dc-f64c-4b95-a995-8356871fc425 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:28.518013 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-50e024dc-f64c-4b95-a995-8356871fc425 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:28.518441 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-50e024dc-f64c-4b95-a995-8356871fc425 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:28.589783 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-50e024dc-f64c-4b95-a995-8356871fc425 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:28.602109 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-50e024dc-f64c-4b95-a995-8356871fc425 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.096072 May 03 09:17:28.602809 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 993/1816] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:28 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:29.526335 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-efd7003e-8b21-48a3-98a2-7d5db23089a4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:29.527228 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-efd7003e-8b21-48a3-98a2-7d5db23089a4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:29.535619 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-8d2e51ab-dee6-4310-b609-1515d471616e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:29.536541 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-efd7003e-8b21-48a3-98a2-7d5db23089a4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:29.536999 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-efd7003e-8b21-48a3-98a2-7d5db23089a4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:29.537157 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-8d2e51ab-dee6-4310-b609-1515d471616e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:29.537764 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-efd7003e-8b21-48a3-98a2-7d5db23089a4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:29.538198 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-efd7003e-8b21-48a3-98a2-7d5db23089a4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:29.543552 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8d2e51ab-dee6-4310-b609-1515d471616e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:29.544210 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8d2e51ab-dee6-4310-b609-1515d471616e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:29.545118 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8d2e51ab-dee6-4310-b609-1515d471616e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:29.545742 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8d2e51ab-dee6-4310-b609-1515d471616e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:29.728224 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-efd7003e-8b21-48a3-98a2-7d5db23089a4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:29.733510 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-8d2e51ab-dee6-4310-b609-1515d471616e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:29.738782 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-efd7003e-8b21-48a3-98a2-7d5db23089a4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.219357 May 03 09:17:29.739372 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 824/1817] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:29 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:29.743624 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-8d2e51ab-dee6-4310-b609-1515d471616e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:29.743921 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-3dc53169-2bd8-4a79-8655-b08918f2c8d9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:29.744560 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-3dc53169-2bd8-4a79-8655-b08918f2c8d9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:29.745151 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-8d2e51ab-dee6-4310-b609-1515d471616e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:29.746321 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-8d2e51ab-dee6-4310-b609-1515d471616e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.217110 May 03 09:17:29.747096 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 994/1818] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:17:29 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:17:29.755375 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3dc53169-2bd8-4a79-8655-b08918f2c8d9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:29.755826 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3dc53169-2bd8-4a79-8655-b08918f2c8d9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:29.756681 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3dc53169-2bd8-4a79-8655-b08918f2c8d9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:29.757120 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3dc53169-2bd8-4a79-8655-b08918f2c8d9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:29.818881 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-3dc53169-2bd8-4a79-8655-b08918f2c8d9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:29.826957 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-3dc53169-2bd8-4a79-8655-b08918f2c8d9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.086621 May 03 09:17:29.827527 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 825/1819] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:29 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:30.761108 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-066e8106-4172-40f8-845c-53f65200551c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:30.762225 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-066e8106-4172-40f8-845c-53f65200551c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:30.769695 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-fcb7e452-966c-4ac1-97eb-e031de1b9e4a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:30.770398 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-fcb7e452-966c-4ac1-97eb-e031de1b9e4a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:30.770982 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-066e8106-4172-40f8-845c-53f65200551c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:30.771429 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-066e8106-4172-40f8-845c-53f65200551c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:30.772222 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-066e8106-4172-40f8-845c-53f65200551c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:30.772646 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-066e8106-4172-40f8-845c-53f65200551c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:30.776978 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fcb7e452-966c-4ac1-97eb-e031de1b9e4a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:30.777426 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fcb7e452-966c-4ac1-97eb-e031de1b9e4a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:30.778194 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fcb7e452-966c-4ac1-97eb-e031de1b9e4a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:30.778625 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fcb7e452-966c-4ac1-97eb-e031de1b9e4a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:30.964197 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-066e8106-4172-40f8-845c-53f65200551c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:30.967828 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-fcb7e452-966c-4ac1-97eb-e031de1b9e4a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:30.972772 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-066e8106-4172-40f8-845c-53f65200551c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.218195 May 03 09:17:30.973347 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 995/1820] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:30 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:30.977332 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-fcb7e452-966c-4ac1-97eb-e031de1b9e4a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:30.978078 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-76952423-d36b-4610-a29f-02c957c1bfab tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:30.978816 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-76952423-d36b-4610-a29f-02c957c1bfab tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:30.979105 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-fcb7e452-966c-4ac1-97eb-e031de1b9e4a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:30.980333 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-fcb7e452-966c-4ac1-97eb-e031de1b9e4a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.216229 May 03 09:17:30.981027 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 826/1821] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:17:30 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:17:30.984906 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-76952423-d36b-4610-a29f-02c957c1bfab tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:30.985354 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-76952423-d36b-4610-a29f-02c957c1bfab tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:30.986129 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-76952423-d36b-4610-a29f-02c957c1bfab tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:30.986635 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-76952423-d36b-4610-a29f-02c957c1bfab tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:31.050698 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-76952423-d36b-4610-a29f-02c957c1bfab tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:31.058599 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-76952423-d36b-4610-a29f-02c957c1bfab tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.084324 May 03 09:17:31.059162 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 996/1822] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:30 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:31.994349 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-014ca690-c309-4668-8dae-c0455594b2bc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:31.995279 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-014ca690-c309-4668-8dae-c0455594b2bc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:32.002756 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9d492407-9179-487f-b9c6-be64db74b48f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:32.003376 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9d492407-9179-487f-b9c6-be64db74b48f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:32.004600 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-014ca690-c309-4668-8dae-c0455594b2bc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:32.005051 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-014ca690-c309-4668-8dae-c0455594b2bc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:32.005813 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-014ca690-c309-4668-8dae-c0455594b2bc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:32.006240 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-014ca690-c309-4668-8dae-c0455594b2bc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:32.009963 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9d492407-9179-487f-b9c6-be64db74b48f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:32.010548 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9d492407-9179-487f-b9c6-be64db74b48f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:32.011351 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9d492407-9179-487f-b9c6-be64db74b48f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:32.011792 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9d492407-9179-487f-b9c6-be64db74b48f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:32.192480 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-014ca690-c309-4668-8dae-c0455594b2bc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:32.195561 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9d492407-9179-487f-b9c6-be64db74b48f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:32.200673 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-014ca690-c309-4668-8dae-c0455594b2bc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.212974 May 03 09:17:32.201572 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 827/1823] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:31 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:32.204421 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9d492407-9179-487f-b9c6-be64db74b48f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:32.206010 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9d492407-9179-487f-b9c6-be64db74b48f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:32.207216 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9d492407-9179-487f-b9c6-be64db74b48f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.211223 May 03 09:17:32.207985 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 997/1824] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:17:31 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:17:32.215236 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-499bbd26-7a33-4396-9af8-f16c05afc29c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:32.215964 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-499bbd26-7a33-4396-9af8-f16c05afc29c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:32.222534 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-499bbd26-7a33-4396-9af8-f16c05afc29c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:32.223058 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-499bbd26-7a33-4396-9af8-f16c05afc29c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:32.223849 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-499bbd26-7a33-4396-9af8-f16c05afc29c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:32.224297 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-499bbd26-7a33-4396-9af8-f16c05afc29c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:32.283918 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-499bbd26-7a33-4396-9af8-f16c05afc29c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:32.291930 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-499bbd26-7a33-4396-9af8-f16c05afc29c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.080488 May 03 09:17:32.292512 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 828/1825] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:32 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:33.222811 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-48b75c30-1423-486c-b974-a6d294a94771 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:33.223846 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-48b75c30-1423-486c-b974-a6d294a94771 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:33.228594 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-fc6f36ad-3b14-4a21-94d9-d4a05011be3b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:33.229402 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-fc6f36ad-3b14-4a21-94d9-d4a05011be3b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:33.232140 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-48b75c30-1423-486c-b974-a6d294a94771 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:33.232565 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-48b75c30-1423-486c-b974-a6d294a94771 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:33.233361 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-48b75c30-1423-486c-b974-a6d294a94771 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:33.233788 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-48b75c30-1423-486c-b974-a6d294a94771 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:33.237132 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fc6f36ad-3b14-4a21-94d9-d4a05011be3b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:33.237586 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fc6f36ad-3b14-4a21-94d9-d4a05011be3b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:33.238367 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fc6f36ad-3b14-4a21-94d9-d4a05011be3b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:33.238795 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fc6f36ad-3b14-4a21-94d9-d4a05011be3b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:33.424857 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-48b75c30-1423-486c-b974-a6d294a94771 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:33.433613 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-fc6f36ad-3b14-4a21-94d9-d4a05011be3b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:33.434669 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-48b75c30-1423-486c-b974-a6d294a94771 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.218902 May 03 09:17:33.435246 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 998/1826] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:33 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:33.441119 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9987ada0-38ae-40b2-8060-03a0e25610b6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:33.441119 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9987ada0-38ae-40b2-8060-03a0e25610b6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:33.446612 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9987ada0-38ae-40b2-8060-03a0e25610b6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:33.447110 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9987ada0-38ae-40b2-8060-03a0e25610b6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:33.448254 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9987ada0-38ae-40b2-8060-03a0e25610b6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:33.448431 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-fc6f36ad-3b14-4a21-94d9-d4a05011be3b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:33.448631 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9987ada0-38ae-40b2-8060-03a0e25610b6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:33.449808 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-fc6f36ad-3b14-4a21-94d9-d4a05011be3b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:33.450981 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-fc6f36ad-3b14-4a21-94d9-d4a05011be3b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.228735 May 03 09:17:33.451507 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 829/1827] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:17:33 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:17:33.511942 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9987ada0-38ae-40b2-8060-03a0e25610b6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:33.519939 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9987ada0-38ae-40b2-8060-03a0e25610b6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.083712 May 03 09:17:33.520507 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 999/1828] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:33 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:34.455830 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-dcddbcf9-7aed-48b2-a315-5d88220dad85 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:34.456805 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-dcddbcf9-7aed-48b2-a315-5d88220dad85 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:34.467929 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dcddbcf9-7aed-48b2-a315-5d88220dad85 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:34.468695 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dcddbcf9-7aed-48b2-a315-5d88220dad85 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:34.469952 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dcddbcf9-7aed-48b2-a315-5d88220dad85 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:34.470663 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dcddbcf9-7aed-48b2-a315-5d88220dad85 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:34.473522 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-911140e3-84d6-4406-b929-dbb25fe311b8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:34.474542 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-911140e3-84d6-4406-b929-dbb25fe311b8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:34.485211 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-911140e3-84d6-4406-b929-dbb25fe311b8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:34.485966 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-911140e3-84d6-4406-b929-dbb25fe311b8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:34.487222 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-911140e3-84d6-4406-b929-dbb25fe311b8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:34.487684 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-911140e3-84d6-4406-b929-dbb25fe311b8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:34.666679 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-dcddbcf9-7aed-48b2-a315-5d88220dad85 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:34.670149 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-911140e3-84d6-4406-b929-dbb25fe311b8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:34.675106 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-dcddbcf9-7aed-48b2-a315-5d88220dad85 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.225927 May 03 09:17:34.675689 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 830/1829] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:34 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:34.680179 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4c217868-ecdf-48ac-863e-5b0b67d50c43 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:34.681000 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4c217868-ecdf-48ac-863e-5b0b67d50c43 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:34.683054 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-911140e3-84d6-4406-b929-dbb25fe311b8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:34.684630 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-911140e3-84d6-4406-b929-dbb25fe311b8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:34.685819 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-911140e3-84d6-4406-b929-dbb25fe311b8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.219230 May 03 09:17:34.686353 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1000/1830] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:17:34 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:17:34.686891 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4c217868-ecdf-48ac-863e-5b0b67d50c43 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:34.687369 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4c217868-ecdf-48ac-863e-5b0b67d50c43 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:34.688150 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4c217868-ecdf-48ac-863e-5b0b67d50c43 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:34.688582 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4c217868-ecdf-48ac-863e-5b0b67d50c43 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:34.755655 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-4c217868-ecdf-48ac-863e-5b0b67d50c43 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:34.763996 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-4c217868-ecdf-48ac-863e-5b0b67d50c43 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.087309 May 03 09:17:34.764566 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 831/1831] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:34 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:35.694742 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b7ffd9c6-e0c7-4856-be0a-670e458d377d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:35.695439 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b7ffd9c6-e0c7-4856-be0a-670e458d377d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:35.703236 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b7ffd9c6-e0c7-4856-be0a-670e458d377d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:35.703789 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b7ffd9c6-e0c7-4856-be0a-670e458d377d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:35.704694 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b7ffd9c6-e0c7-4856-be0a-670e458d377d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:35.705203 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b7ffd9c6-e0c7-4856-be0a-670e458d377d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:35.705369 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-169cd43c-0083-477c-95ef-39f8ae90bcb2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:35.705942 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-169cd43c-0083-477c-95ef-39f8ae90bcb2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:35.713682 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-169cd43c-0083-477c-95ef-39f8ae90bcb2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:35.714207 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-169cd43c-0083-477c-95ef-39f8ae90bcb2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:35.715105 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-169cd43c-0083-477c-95ef-39f8ae90bcb2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:35.715620 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-169cd43c-0083-477c-95ef-39f8ae90bcb2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:35.891884 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-169cd43c-0083-477c-95ef-39f8ae90bcb2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:35.894981 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b7ffd9c6-e0c7-4856-be0a-670e458d377d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:35.901073 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-169cd43c-0083-477c-95ef-39f8ae90bcb2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:35.902593 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-169cd43c-0083-477c-95ef-39f8ae90bcb2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:35.903358 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b7ffd9c6-e0c7-4856-be0a-670e458d377d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.213562 May 03 09:17:35.903756 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-169cd43c-0083-477c-95ef-39f8ae90bcb2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.203086 May 03 09:17:35.903933 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1001/1832] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:35 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:35.905173 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 832/1833] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:17:35 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:17:35.909244 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9a83599f-e2c6-4912-b527-e074ab5fcb36 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:35.909923 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9a83599f-e2c6-4912-b527-e074ab5fcb36 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:35.917116 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9a83599f-e2c6-4912-b527-e074ab5fcb36 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:35.917778 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9a83599f-e2c6-4912-b527-e074ab5fcb36 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:35.918933 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9a83599f-e2c6-4912-b527-e074ab5fcb36 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:35.919597 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9a83599f-e2c6-4912-b527-e074ab5fcb36 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:35.984298 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9a83599f-e2c6-4912-b527-e074ab5fcb36 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:35.992482 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9a83599f-e2c6-4912-b527-e074ab5fcb36 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.087569 May 03 09:17:35.993055 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1002/1834] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:35 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:36.925069 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-3b340ec5-63ff-40e1-a255-9c933344bed6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:36.926009 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-44e66c50-ab69-4044-aa2a-731a7660705e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:36.926648 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-3b340ec5-63ff-40e1-a255-9c933344bed6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:36.926823 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-44e66c50-ab69-4044-aa2a-731a7660705e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:36.936987 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3b340ec5-63ff-40e1-a255-9c933344bed6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:36.937623 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-44e66c50-ab69-4044-aa2a-731a7660705e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:36.937893 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3b340ec5-63ff-40e1-a255-9c933344bed6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:36.938391 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-44e66c50-ab69-4044-aa2a-731a7660705e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:36.939015 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3b340ec5-63ff-40e1-a255-9c933344bed6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:36.939671 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-44e66c50-ab69-4044-aa2a-731a7660705e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:36.939995 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3b340ec5-63ff-40e1-a255-9c933344bed6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:36.940335 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-44e66c50-ab69-4044-aa2a-731a7660705e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:37.136667 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-3b340ec5-63ff-40e1-a255-9c933344bed6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:37.139844 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-44e66c50-ab69-4044-aa2a-731a7660705e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:37.145119 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-3b340ec5-63ff-40e1-a255-9c933344bed6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.226682 May 03 09:17:37.145717 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 833/1835] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:36 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:37.148921 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-44e66c50-ab69-4044-aa2a-731a7660705e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:37.150101 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-1a49f9d4-9145-4159-90ae-e25c94f8363b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:37.150570 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-44e66c50-ab69-4044-aa2a-731a7660705e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:37.150739 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-1a49f9d4-9145-4159-90ae-e25c94f8363b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:37.151840 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-44e66c50-ab69-4044-aa2a-731a7660705e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.232672 May 03 09:17:37.152574 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1003/1836] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:17:36 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:17:37.157600 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1a49f9d4-9145-4159-90ae-e25c94f8363b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:37.158050 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1a49f9d4-9145-4159-90ae-e25c94f8363b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:37.158877 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1a49f9d4-9145-4159-90ae-e25c94f8363b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:37.159305 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1a49f9d4-9145-4159-90ae-e25c94f8363b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:37.218996 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-1a49f9d4-9145-4159-90ae-e25c94f8363b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:37.227018 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-1a49f9d4-9145-4159-90ae-e25c94f8363b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.080376 May 03 09:17:37.227555 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 834/1837] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:37 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:38.166735 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-58ba2759-2615-4a6d-9712-c8a640f8efea tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:38.167742 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-58ba2759-2615-4a6d-9712-c8a640f8efea tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:38.173262 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6b31d785-341a-4326-bbe0-668e0e72a1eb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:38.174252 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6b31d785-341a-4326-bbe0-668e0e72a1eb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:38.177390 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-58ba2759-2615-4a6d-9712-c8a640f8efea tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:38.177851 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-58ba2759-2615-4a6d-9712-c8a640f8efea tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:38.178620 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-58ba2759-2615-4a6d-9712-c8a640f8efea tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:38.179050 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-58ba2759-2615-4a6d-9712-c8a640f8efea tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:38.181522 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6b31d785-341a-4326-bbe0-668e0e72a1eb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:38.182017 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6b31d785-341a-4326-bbe0-668e0e72a1eb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:38.182742 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6b31d785-341a-4326-bbe0-668e0e72a1eb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:38.183187 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6b31d785-341a-4326-bbe0-668e0e72a1eb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:38.365123 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-58ba2759-2615-4a6d-9712-c8a640f8efea tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:38.371677 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6b31d785-341a-4326-bbe0-668e0e72a1eb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:38.373379 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-58ba2759-2615-4a6d-9712-c8a640f8efea tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.213103 May 03 09:17:38.373961 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1004/1838] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:38 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:38.378357 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-6bde15b4-cdbe-404d-b0f1-7d9819c0896f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:38.379071 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-6bde15b4-cdbe-404d-b0f1-7d9819c0896f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:38.380770 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6b31d785-341a-4326-bbe0-668e0e72a1eb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:38.382258 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6b31d785-341a-4326-bbe0-668e0e72a1eb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:38.383507 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6b31d785-341a-4326-bbe0-668e0e72a1eb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.216756 May 03 09:17:38.384095 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 835/1839] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:17:38 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:17:38.385087 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6bde15b4-cdbe-404d-b0f1-7d9819c0896f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:38.385534 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6bde15b4-cdbe-404d-b0f1-7d9819c0896f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:38.386299 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6bde15b4-cdbe-404d-b0f1-7d9819c0896f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:38.386747 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6bde15b4-cdbe-404d-b0f1-7d9819c0896f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:38.447186 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-6bde15b4-cdbe-404d-b0f1-7d9819c0896f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:38.455161 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-6bde15b4-cdbe-404d-b0f1-7d9819c0896f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.080272 May 03 09:17:38.455735 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1005/1840] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:38 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:39.397304 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e1582993-b5b0-450e-8d26-046d61b897de tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:39.398380 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e1582993-b5b0-450e-8d26-046d61b897de tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:39.405172 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-28ed3bb2-ef36-482c-b43a-03474fef9e14 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:39.406167 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-28ed3bb2-ef36-482c-b43a-03474fef9e14 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:39.409315 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e1582993-b5b0-450e-8d26-046d61b897de tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:39.410142 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e1582993-b5b0-450e-8d26-046d61b897de tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:39.410944 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e1582993-b5b0-450e-8d26-046d61b897de tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:39.411356 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e1582993-b5b0-450e-8d26-046d61b897de tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:39.414296 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-28ed3bb2-ef36-482c-b43a-03474fef9e14 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:39.414763 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-28ed3bb2-ef36-482c-b43a-03474fef9e14 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:39.415513 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-28ed3bb2-ef36-482c-b43a-03474fef9e14 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:39.415986 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-28ed3bb2-ef36-482c-b43a-03474fef9e14 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:39.596450 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e1582993-b5b0-450e-8d26-046d61b897de tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:39.599466 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-28ed3bb2-ef36-482c-b43a-03474fef9e14 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:39.605136 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e1582993-b5b0-450e-8d26-046d61b897de tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.216961 May 03 09:17:39.605714 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 836/1841] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:39 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:39.608004 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-28ed3bb2-ef36-482c-b43a-03474fef9e14 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:39.609644 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-28ed3bb2-ef36-482c-b43a-03474fef9e14 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:39.610099 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-97514f63-66cf-4501-8f67-1191261d6475 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:39.610696 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-97514f63-66cf-4501-8f67-1191261d6475 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:39.610966 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-28ed3bb2-ef36-482c-b43a-03474fef9e14 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.212278 May 03 09:17:39.614908 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1006/1842] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:17:39 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:17:39.616477 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-97514f63-66cf-4501-8f67-1191261d6475 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:39.616920 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-97514f63-66cf-4501-8f67-1191261d6475 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:39.617682 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-97514f63-66cf-4501-8f67-1191261d6475 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:39.618085 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-97514f63-66cf-4501-8f67-1191261d6475 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:39.686235 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-97514f63-66cf-4501-8f67-1191261d6475 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:39.694424 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-97514f63-66cf-4501-8f67-1191261d6475 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.087779 May 03 09:17:39.695017 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 837/1843] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:39 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:40.625968 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3c0b2652-eb97-4a2d-8d72-0fde54815d61 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:40.626953 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-3c0b2652-eb97-4a2d-8d72-0fde54815d61 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:40.631533 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-91c60c09-28aa-4593-aeb4-e8fd64643788 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:40.632162 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-91c60c09-28aa-4593-aeb4-e8fd64643788 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:40.634399 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3c0b2652-eb97-4a2d-8d72-0fde54815d61 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:40.634844 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3c0b2652-eb97-4a2d-8d72-0fde54815d61 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:40.635607 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3c0b2652-eb97-4a2d-8d72-0fde54815d61 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:40.636136 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3c0b2652-eb97-4a2d-8d72-0fde54815d61 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:40.638906 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-91c60c09-28aa-4593-aeb4-e8fd64643788 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:40.639362 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-91c60c09-28aa-4593-aeb4-e8fd64643788 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:40.640158 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-91c60c09-28aa-4593-aeb4-e8fd64643788 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:40.640590 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-91c60c09-28aa-4593-aeb4-e8fd64643788 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:40.823576 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-3c0b2652-eb97-4a2d-8d72-0fde54815d61 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:40.826836 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-91c60c09-28aa-4593-aeb4-e8fd64643788 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:40.832002 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-3c0b2652-eb97-4a2d-8d72-0fde54815d61 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.212520 May 03 09:17:40.832634 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1007/1844] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:40 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:40.835503 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-91c60c09-28aa-4593-aeb4-e8fd64643788 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:40.837030 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-91c60c09-28aa-4593-aeb4-e8fd64643788 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:40.837173 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-eb096cba-1d11-4c5c-b3f0-1fffbebd6f15 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:40.837804 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-eb096cba-1d11-4c5c-b3f0-1fffbebd6f15 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:40.838196 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-91c60c09-28aa-4593-aeb4-e8fd64643788 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.211428 May 03 09:17:40.838742 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 838/1845] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:17:40 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:17:40.844420 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-eb096cba-1d11-4c5c-b3f0-1fffbebd6f15 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:40.844867 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-eb096cba-1d11-4c5c-b3f0-1fffbebd6f15 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:40.845632 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-eb096cba-1d11-4c5c-b3f0-1fffbebd6f15 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:40.846060 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-eb096cba-1d11-4c5c-b3f0-1fffbebd6f15 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:40.920322 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-eb096cba-1d11-4c5c-b3f0-1fffbebd6f15 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:40.933005 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-eb096cba-1d11-4c5c-b3f0-1fffbebd6f15 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.099032 May 03 09:17:40.933782 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1008/1846] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:40 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:41.854080 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-89c778c0-1836-4d62-a937-d4f9cf710fa7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:41.855080 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-89c778c0-1836-4d62-a937-d4f9cf710fa7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:41.860858 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9b3ff1e6-7433-4a13-aa7b-d62f0f34265b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:41.861859 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9b3ff1e6-7433-4a13-aa7b-d62f0f34265b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:41.864924 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-89c778c0-1836-4d62-a937-d4f9cf710fa7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:41.865379 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-89c778c0-1836-4d62-a937-d4f9cf710fa7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:41.866164 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-89c778c0-1836-4d62-a937-d4f9cf710fa7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:41.866601 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-89c778c0-1836-4d62-a937-d4f9cf710fa7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:41.869096 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9b3ff1e6-7433-4a13-aa7b-d62f0f34265b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:41.869542 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9b3ff1e6-7433-4a13-aa7b-d62f0f34265b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:41.870299 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9b3ff1e6-7433-4a13-aa7b-d62f0f34265b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:41.870723 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9b3ff1e6-7433-4a13-aa7b-d62f0f34265b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:42.058888 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-89c778c0-1836-4d62-a937-d4f9cf710fa7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:42.062078 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9b3ff1e6-7433-4a13-aa7b-d62f0f34265b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:42.066911 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-89c778c0-1836-4d62-a937-d4f9cf710fa7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.219344 May 03 09:17:42.067554 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 839/1847] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:41 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:42.070264 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9b3ff1e6-7433-4a13-aa7b-d62f0f34265b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:42.072066 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9b3ff1e6-7433-4a13-aa7b-d62f0f34265b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:42.072242 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-505809eb-827a-450a-8661-47127bf551ac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:42.072851 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-505809eb-827a-450a-8661-47127bf551ac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:42.073205 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9b3ff1e6-7433-4a13-aa7b-d62f0f34265b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.218884 May 03 09:17:42.073966 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1009/1848] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:17:41 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:17:42.078860 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-505809eb-827a-450a-8661-47127bf551ac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:42.079302 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-505809eb-827a-450a-8661-47127bf551ac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:42.080079 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-505809eb-827a-450a-8661-47127bf551ac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:42.080523 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-505809eb-827a-450a-8661-47127bf551ac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:42.147653 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-505809eb-827a-450a-8661-47127bf551ac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:42.159561 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-505809eb-827a-450a-8661-47127bf551ac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.090704 May 03 09:17:42.160322 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 840/1849] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:42 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:43.097727 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-63d35bbd-3749-4ffb-9d82-2d798a455d88 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:43.098311 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-13d08eb8-de82-4fe8-9f28-c911ce5fc7fb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:43.098715 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-63d35bbd-3749-4ffb-9d82-2d798a455d88 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:43.098823 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-13d08eb8-de82-4fe8-9f28-c911ce5fc7fb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:43.105067 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-63d35bbd-3749-4ffb-9d82-2d798a455d88 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:43.105479 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-13d08eb8-de82-4fe8-9f28-c911ce5fc7fb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:43.105636 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-63d35bbd-3749-4ffb-9d82-2d798a455d88 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:43.105925 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-13d08eb8-de82-4fe8-9f28-c911ce5fc7fb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:43.106271 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-63d35bbd-3749-4ffb-9d82-2d798a455d88 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:43.106701 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-13d08eb8-de82-4fe8-9f28-c911ce5fc7fb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:43.106845 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-63d35bbd-3749-4ffb-9d82-2d798a455d88 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:43.107119 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-13d08eb8-de82-4fe8-9f28-c911ce5fc7fb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:43.292819 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-13d08eb8-de82-4fe8-9f28-c911ce5fc7fb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:43.296830 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-63d35bbd-3749-4ffb-9d82-2d798a455d88 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:43.301362 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-13d08eb8-de82-4fe8-9f28-c911ce5fc7fb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.209078 May 03 09:17:43.301930 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 841/1850] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:43 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:43.305587 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-63d35bbd-3749-4ffb-9d82-2d798a455d88 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:43.306547 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6ee49f55-9246-47dd-b927-7152e1db917f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:43.307078 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-63d35bbd-3749-4ffb-9d82-2d798a455d88 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:43.307220 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6ee49f55-9246-47dd-b927-7152e1db917f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:43.308277 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-63d35bbd-3749-4ffb-9d82-2d798a455d88 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.217378 May 03 09:17:43.308821 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1010/1851] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:17:43 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:17:43.313394 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6ee49f55-9246-47dd-b927-7152e1db917f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:43.313842 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6ee49f55-9246-47dd-b927-7152e1db917f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:43.314620 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6ee49f55-9246-47dd-b927-7152e1db917f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:43.315056 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6ee49f55-9246-47dd-b927-7152e1db917f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:43.376870 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6ee49f55-9246-47dd-b927-7152e1db917f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:43.385086 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6ee49f55-9246-47dd-b927-7152e1db917f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.082187 May 03 09:17:43.385657 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 842/1852] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:43 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:44.322652 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-07e03bf4-5f80-4241-9f82-c0bf5b8f6a9a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:44.323580 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-07e03bf4-5f80-4241-9f82-c0bf5b8f6a9a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:44.330405 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f7572325-f14f-483b-9a9a-61aa17401653 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:44.331551 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f7572325-f14f-483b-9a9a-61aa17401653 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:44.333237 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-07e03bf4-5f80-4241-9f82-c0bf5b8f6a9a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:44.333681 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-07e03bf4-5f80-4241-9f82-c0bf5b8f6a9a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:44.334442 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-07e03bf4-5f80-4241-9f82-c0bf5b8f6a9a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:44.334875 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-07e03bf4-5f80-4241-9f82-c0bf5b8f6a9a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:44.338262 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f7572325-f14f-483b-9a9a-61aa17401653 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:44.338701 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f7572325-f14f-483b-9a9a-61aa17401653 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:44.339464 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f7572325-f14f-483b-9a9a-61aa17401653 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:44.339938 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f7572325-f14f-483b-9a9a-61aa17401653 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:44.523688 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-07e03bf4-5f80-4241-9f82-c0bf5b8f6a9a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:44.526523 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f7572325-f14f-483b-9a9a-61aa17401653 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:44.532225 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-07e03bf4-5f80-4241-9f82-c0bf5b8f6a9a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.216006 May 03 09:17:44.532813 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1011/1853] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:44 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:44.535615 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f7572325-f14f-483b-9a9a-61aa17401653 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:44.537302 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f7572325-f14f-483b-9a9a-61aa17401653 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:44.537477 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-bec2660d-09d9-4de3-8676-21c3288cc1df tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:44.537925 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-bec2660d-09d9-4de3-8676-21c3288cc1df tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:44.538487 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f7572325-f14f-483b-9a9a-61aa17401653 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.214771 May 03 09:17:44.539208 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 843/1854] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:17:44 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:17:44.544035 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bec2660d-09d9-4de3-8676-21c3288cc1df tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:44.544505 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bec2660d-09d9-4de3-8676-21c3288cc1df tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:44.545260 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bec2660d-09d9-4de3-8676-21c3288cc1df tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:44.545704 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bec2660d-09d9-4de3-8676-21c3288cc1df tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:44.606795 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-bec2660d-09d9-4de3-8676-21c3288cc1df tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:44.614864 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-bec2660d-09d9-4de3-8676-21c3288cc1df tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.081119 May 03 09:17:44.615474 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1012/1855] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:44 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:45.550306 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0ba458ef-f93b-424a-bd03-15dac5f83059 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:45.550872 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0ba458ef-f93b-424a-bd03-15dac5f83059 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:45.556760 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-487c54e2-71b7-4101-9f16-e9db8b5b967f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:45.557396 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-487c54e2-71b7-4101-9f16-e9db8b5b967f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:45.557944 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0ba458ef-f93b-424a-bd03-15dac5f83059 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:45.558390 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0ba458ef-f93b-424a-bd03-15dac5f83059 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:45.559162 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0ba458ef-f93b-424a-bd03-15dac5f83059 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:45.559594 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0ba458ef-f93b-424a-bd03-15dac5f83059 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:45.564071 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-487c54e2-71b7-4101-9f16-e9db8b5b967f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:45.564520 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-487c54e2-71b7-4101-9f16-e9db8b5b967f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:45.565293 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-487c54e2-71b7-4101-9f16-e9db8b5b967f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:45.565698 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-487c54e2-71b7-4101-9f16-e9db8b5b967f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:45.746125 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0ba458ef-f93b-424a-bd03-15dac5f83059 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:45.750428 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-487c54e2-71b7-4101-9f16-e9db8b5b967f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:45.757867 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0ba458ef-f93b-424a-bd03-15dac5f83059 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.211461 May 03 09:17:45.758691 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 844/1856] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:45 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:45.761516 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-487c54e2-71b7-4101-9f16-e9db8b5b967f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:45.763019 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-487c54e2-71b7-4101-9f16-e9db8b5b967f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:45.763153 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-fe1d6e89-e089-4b79-8876-1490d6fec779 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:45.763630 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-fe1d6e89-e089-4b79-8876-1490d6fec779 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:45.764435 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-487c54e2-71b7-4101-9f16-e9db8b5b967f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.211734 May 03 09:17:45.765436 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1013/1857] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:17:45 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:17:45.769941 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fe1d6e89-e089-4b79-8876-1490d6fec779 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:45.770394 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fe1d6e89-e089-4b79-8876-1490d6fec779 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:45.771162 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fe1d6e89-e089-4b79-8876-1490d6fec779 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:45.771598 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fe1d6e89-e089-4b79-8876-1490d6fec779 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:45.837465 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-fe1d6e89-e089-4b79-8876-1490d6fec779 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:45.849092 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-fe1d6e89-e089-4b79-8876-1490d6fec779 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.089497 May 03 09:17:45.849959 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 845/1858] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:45 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:46.779533 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b5d18392-08c9-4f48-bfc7-b8ae7fb840ac tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:46.780767 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b5d18392-08c9-4f48-bfc7-b8ae7fb840ac tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:46.785857 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-75a0c202-b04e-46b3-a64c-687dcd4dba99 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:46.786515 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-75a0c202-b04e-46b3-a64c-687dcd4dba99 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:46.788874 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b5d18392-08c9-4f48-bfc7-b8ae7fb840ac tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:46.789318 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b5d18392-08c9-4f48-bfc7-b8ae7fb840ac tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:46.790092 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b5d18392-08c9-4f48-bfc7-b8ae7fb840ac tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:46.790525 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b5d18392-08c9-4f48-bfc7-b8ae7fb840ac tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:46.793103 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-75a0c202-b04e-46b3-a64c-687dcd4dba99 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:46.793548 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-75a0c202-b04e-46b3-a64c-687dcd4dba99 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:46.794334 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-75a0c202-b04e-46b3-a64c-687dcd4dba99 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:46.794768 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-75a0c202-b04e-46b3-a64c-687dcd4dba99 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:46.976201 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b5d18392-08c9-4f48-bfc7-b8ae7fb840ac tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:46.980805 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-75a0c202-b04e-46b3-a64c-687dcd4dba99 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:46.986683 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b5d18392-08c9-4f48-bfc7-b8ae7fb840ac tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.213643 May 03 09:17:46.987542 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1014/1859] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:46 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:46.990108 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-75a0c202-b04e-46b3-a64c-687dcd4dba99 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:46.991637 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-75a0c202-b04e-46b3-a64c-687dcd4dba99 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:46.991923 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-cf407d37-5630-4c19-bca0-bbdd67a5a4d2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:46.992670 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-cf407d37-5630-4c19-bca0-bbdd67a5a4d2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:46.992900 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-75a0c202-b04e-46b3-a64c-687dcd4dba99 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.213072 May 03 09:17:46.993624 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 846/1860] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:17:46 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:17:46.998592 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cf407d37-5630-4c19-bca0-bbdd67a5a4d2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:46.999073 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cf407d37-5630-4c19-bca0-bbdd67a5a4d2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:46.999874 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cf407d37-5630-4c19-bca0-bbdd67a5a4d2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:47.000299 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cf407d37-5630-4c19-bca0-bbdd67a5a4d2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:47.062252 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-cf407d37-5630-4c19-bca0-bbdd67a5a4d2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:47.070202 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-cf407d37-5630-4c19-bca0-bbdd67a5a4d2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.081878 May 03 09:17:47.070754 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1015/1861] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:46 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:48.008346 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-411d913e-7d9f-4ecc-b90c-1c517b52a475 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:48.009364 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-411d913e-7d9f-4ecc-b90c-1c517b52a475 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:48.014765 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b8b80353-6fe6-4892-aad4-913f5f8c4e9a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:48.015761 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b8b80353-6fe6-4892-aad4-913f5f8c4e9a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:48.019899 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-411d913e-7d9f-4ecc-b90c-1c517b52a475 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:48.020337 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-411d913e-7d9f-4ecc-b90c-1c517b52a475 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:48.021122 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-411d913e-7d9f-4ecc-b90c-1c517b52a475 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:48.021553 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-411d913e-7d9f-4ecc-b90c-1c517b52a475 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:48.024062 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b8b80353-6fe6-4892-aad4-913f5f8c4e9a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:48.024518 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b8b80353-6fe6-4892-aad4-913f5f8c4e9a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:48.025306 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b8b80353-6fe6-4892-aad4-913f5f8c4e9a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:48.025737 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b8b80353-6fe6-4892-aad4-913f5f8c4e9a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:48.214118 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-411d913e-7d9f-4ecc-b90c-1c517b52a475 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:48.217513 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b8b80353-6fe6-4892-aad4-913f5f8c4e9a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:48.222657 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-411d913e-7d9f-4ecc-b90c-1c517b52a475 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.220858 May 03 09:17:48.223315 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 847/1862] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:48 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:48.226048 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b8b80353-6fe6-4892-aad4-913f5f8c4e9a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:48.227543 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b8b80353-6fe6-4892-aad4-913f5f8c4e9a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:48.228114 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d75f2f1a-a35f-4bef-8f20-801f42426d04 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:48.228730 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b8b80353-6fe6-4892-aad4-913f5f8c4e9a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.220759 May 03 09:17:48.228858 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d75f2f1a-a35f-4bef-8f20-801f42426d04 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:48.229478 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1016/1863] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:17:48 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:17:48.234702 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d75f2f1a-a35f-4bef-8f20-801f42426d04 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:48.235158 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d75f2f1a-a35f-4bef-8f20-801f42426d04 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:48.235962 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d75f2f1a-a35f-4bef-8f20-801f42426d04 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:48.236403 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d75f2f1a-a35f-4bef-8f20-801f42426d04 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:48.298731 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d75f2f1a-a35f-4bef-8f20-801f42426d04 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:48.306869 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d75f2f1a-a35f-4bef-8f20-801f42426d04 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.082354 May 03 09:17:48.307443 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 848/1864] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:48 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:49.240282 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-4b863ce9-093a-47a2-87c2-900cc9fca2bb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:49.240893 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-4b863ce9-093a-47a2-87c2-900cc9fca2bb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:49.246566 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c3d089a6-7e4b-4ddf-b698-494b64c31c73 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:49.247183 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c3d089a6-7e4b-4ddf-b698-494b64c31c73 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:49.247652 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4b863ce9-093a-47a2-87c2-900cc9fca2bb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:49.248177 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4b863ce9-093a-47a2-87c2-900cc9fca2bb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:49.248941 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4b863ce9-093a-47a2-87c2-900cc9fca2bb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:49.249367 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4b863ce9-093a-47a2-87c2-900cc9fca2bb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:49.253866 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c3d089a6-7e4b-4ddf-b698-494b64c31c73 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:49.254323 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c3d089a6-7e4b-4ddf-b698-494b64c31c73 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:49.255101 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c3d089a6-7e4b-4ddf-b698-494b64c31c73 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:49.255539 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c3d089a6-7e4b-4ddf-b698-494b64c31c73 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:49.438271 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-4b863ce9-093a-47a2-87c2-900cc9fca2bb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:49.442212 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c3d089a6-7e4b-4ddf-b698-494b64c31c73 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:49.446492 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-4b863ce9-093a-47a2-87c2-900cc9fca2bb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.210132 May 03 09:17:49.447093 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1017/1865] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:49 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:49.451018 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c3d089a6-7e4b-4ddf-b698-494b64c31c73 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:49.451449 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b7ff1ab2-1655-43c7-bc9c-0d2b67949262 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:49.452094 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b7ff1ab2-1655-43c7-bc9c-0d2b67949262 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:49.452593 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c3d089a6-7e4b-4ddf-b698-494b64c31c73 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:49.453751 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c3d089a6-7e4b-4ddf-b698-494b64c31c73 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.211202 May 03 09:17:49.454436 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 849/1866] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:17:49 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:17:49.458023 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b7ff1ab2-1655-43c7-bc9c-0d2b67949262 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:49.458509 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b7ff1ab2-1655-43c7-bc9c-0d2b67949262 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:49.459563 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b7ff1ab2-1655-43c7-bc9c-0d2b67949262 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:49.460344 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b7ff1ab2-1655-43c7-bc9c-0d2b67949262 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:49.531316 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b7ff1ab2-1655-43c7-bc9c-0d2b67949262 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:49.539128 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b7ff1ab2-1655-43c7-bc9c-0d2b67949262 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.091116 May 03 09:17:49.539700 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1018/1867] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:49 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:50.468614 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-bfe8c385-24be-47f8-8110-e2ade6173297 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:50.469442 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-bfe8c385-24be-47f8-8110-e2ade6173297 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:50.474527 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a6639748-a329-425e-85df-7b6c8dd8a8cd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:50.475164 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a6639748-a329-425e-85df-7b6c8dd8a8cd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:50.477088 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bfe8c385-24be-47f8-8110-e2ade6173297 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:50.477535 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bfe8c385-24be-47f8-8110-e2ade6173297 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:50.478298 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bfe8c385-24be-47f8-8110-e2ade6173297 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:50.478725 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bfe8c385-24be-47f8-8110-e2ade6173297 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:50.482026 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a6639748-a329-425e-85df-7b6c8dd8a8cd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:50.482479 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a6639748-a329-425e-85df-7b6c8dd8a8cd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:50.483247 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a6639748-a329-425e-85df-7b6c8dd8a8cd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:50.483678 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a6639748-a329-425e-85df-7b6c8dd8a8cd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:50.663435 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-bfe8c385-24be-47f8-8110-e2ade6173297 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:50.668992 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a6639748-a329-425e-85df-7b6c8dd8a8cd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:50.676146 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-bfe8c385-24be-47f8-8110-e2ade6173297 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.214223 May 03 09:17:50.677028 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 850/1868] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:50 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:50.680860 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a6639748-a329-425e-85df-7b6c8dd8a8cd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:50.681570 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7425af39-b36c-458b-baf6-d8a650f84ee1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:50.682246 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7425af39-b36c-458b-baf6-d8a650f84ee1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:50.682365 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a6639748-a329-425e-85df-7b6c8dd8a8cd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:50.683719 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a6639748-a329-425e-85df-7b6c8dd8a8cd tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.214303 May 03 09:17:50.684439 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1019/1869] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:17:50 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:17:50.689568 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7425af39-b36c-458b-baf6-d8a650f84ee1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:50.690332 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7425af39-b36c-458b-baf6-d8a650f84ee1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:50.691269 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7425af39-b36c-458b-baf6-d8a650f84ee1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:50.691701 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7425af39-b36c-458b-baf6-d8a650f84ee1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:50.751759 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7425af39-b36c-458b-baf6-d8a650f84ee1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:50.760149 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7425af39-b36c-458b-baf6-d8a650f84ee1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.082112 May 03 09:17:50.760715 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 851/1870] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:50 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:51.693846 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-046fbab5-542a-470c-9463-5bf5fb1fdcfe tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:51.694444 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-046fbab5-542a-470c-9463-5bf5fb1fdcfe tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:51.701240 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-046fbab5-542a-470c-9463-5bf5fb1fdcfe tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:51.701684 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-046fbab5-542a-470c-9463-5bf5fb1fdcfe tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:51.702458 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-046fbab5-542a-470c-9463-5bf5fb1fdcfe tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:51.702894 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-046fbab5-542a-470c-9463-5bf5fb1fdcfe tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:51.704240 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a01bc90d-e295-44a1-9d6f-677aa9dc3333 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:51.704986 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a01bc90d-e295-44a1-9d6f-677aa9dc3333 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:51.712072 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a01bc90d-e295-44a1-9d6f-677aa9dc3333 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:51.712548 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a01bc90d-e295-44a1-9d6f-677aa9dc3333 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:51.713343 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a01bc90d-e295-44a1-9d6f-677aa9dc3333 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:51.714040 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a01bc90d-e295-44a1-9d6f-677aa9dc3333 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:51.977240 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-046fbab5-542a-470c-9463-5bf5fb1fdcfe tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:51.985521 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-046fbab5-542a-470c-9463-5bf5fb1fdcfe tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.295686 May 03 09:17:51.986114 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1020/1871] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:51 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:51.991135 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5bd936b7-5ed3-4385-9512-3e27941222b2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:51.992235 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5bd936b7-5ed3-4385-9512-3e27941222b2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:52.000177 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5bd936b7-5ed3-4385-9512-3e27941222b2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:52.000647 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5bd936b7-5ed3-4385-9512-3e27941222b2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:52.001539 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5bd936b7-5ed3-4385-9512-3e27941222b2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:52.002327 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5bd936b7-5ed3-4385-9512-3e27941222b2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:52.003541 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a01bc90d-e295-44a1-9d6f-677aa9dc3333 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:52.016631 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a01bc90d-e295-44a1-9d6f-677aa9dc3333 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:52.018320 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a01bc90d-e295-44a1-9d6f-677aa9dc3333 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:52.019907 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a01bc90d-e295-44a1-9d6f-677aa9dc3333 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.319912 May 03 09:17:52.021644 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 852/1872] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:17:51 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:17:52.313740 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5bd936b7-5ed3-4385-9512-3e27941222b2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:52.324270 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5bd936b7-5ed3-4385-9512-3e27941222b2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.337037 May 03 09:17:52.325353 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1021/1873] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:51 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:53.009972 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9d7ba2ec-5c61-4be1-943f-950f2ceb8102 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:53.010585 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9d7ba2ec-5c61-4be1-943f-950f2ceb8102 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:53.019488 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9d7ba2ec-5c61-4be1-943f-950f2ceb8102 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:53.019986 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9d7ba2ec-5c61-4be1-943f-950f2ceb8102 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:53.020765 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9d7ba2ec-5c61-4be1-943f-950f2ceb8102 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:53.021200 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9d7ba2ec-5c61-4be1-943f-950f2ceb8102 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:53.038697 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-01819c86-4d85-4bdc-b2df-5fa4d4017742 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:53.039403 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-01819c86-4d85-4bdc-b2df-5fa4d4017742 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:53.046108 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-01819c86-4d85-4bdc-b2df-5fa4d4017742 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:53.046530 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-01819c86-4d85-4bdc-b2df-5fa4d4017742 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:53.047330 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-01819c86-4d85-4bdc-b2df-5fa4d4017742 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:53.047855 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-01819c86-4d85-4bdc-b2df-5fa4d4017742 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:53.207922 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9d7ba2ec-5c61-4be1-943f-950f2ceb8102 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:53.217106 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9d7ba2ec-5c61-4be1-943f-950f2ceb8102 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.213749 May 03 09:17:53.217671 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 853/1874] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:53 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:53.219656 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-01819c86-4d85-4bdc-b2df-5fa4d4017742 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:53.228341 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-01819c86-4d85-4bdc-b2df-5fa4d4017742 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:53.229851 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-01819c86-4d85-4bdc-b2df-5fa4d4017742 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:53.231070 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-01819c86-4d85-4bdc-b2df-5fa4d4017742 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.196301 May 03 09:17:53.231668 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1022/1875] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:17:53 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:17:53.348091 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-93f42602-5473-4406-89a1-1df6c2c5aac1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:53.348788 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-93f42602-5473-4406-89a1-1df6c2c5aac1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:53.355011 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-93f42602-5473-4406-89a1-1df6c2c5aac1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:53.355462 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-93f42602-5473-4406-89a1-1df6c2c5aac1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:53.356272 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-93f42602-5473-4406-89a1-1df6c2c5aac1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:53.356711 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-93f42602-5473-4406-89a1-1df6c2c5aac1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:53.429559 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-93f42602-5473-4406-89a1-1df6c2c5aac1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:53.437936 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-93f42602-5473-4406-89a1-1df6c2c5aac1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.096856 May 03 09:17:53.438478 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 854/1876] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:53 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:54.234784 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c1319cab-5939-4999-8316-bbc98f44aec3 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:54.235408 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c1319cab-5939-4999-8316-bbc98f44aec3 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:54.241953 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c1319cab-5939-4999-8316-bbc98f44aec3 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:54.242405 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c1319cab-5939-4999-8316-bbc98f44aec3 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:54.243205 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c1319cab-5939-4999-8316-bbc98f44aec3 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:54.243647 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c1319cab-5939-4999-8316-bbc98f44aec3 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:54.249536 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d7ac8610-4c47-4acb-a90e-e7bb71061c62 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:54.250144 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d7ac8610-4c47-4acb-a90e-e7bb71061c62 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:54.256583 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d7ac8610-4c47-4acb-a90e-e7bb71061c62 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:54.257032 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d7ac8610-4c47-4acb-a90e-e7bb71061c62 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:54.257796 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d7ac8610-4c47-4acb-a90e-e7bb71061c62 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:54.258228 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d7ac8610-4c47-4acb-a90e-e7bb71061c62 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:54.439052 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c1319cab-5939-4999-8316-bbc98f44aec3 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:54.443540 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d7ac8610-4c47-4acb-a90e-e7bb71061c62 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:54.447864 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c1319cab-5939-4999-8316-bbc98f44aec3 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.216963 May 03 09:17:54.448480 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1023/1877] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:54 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:54.453889 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d7ac8610-4c47-4acb-a90e-e7bb71061c62 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:54.454940 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-cf5ba2f5-c315-4ceb-86a0-11548457be7c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:54.455416 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d7ac8610-4c47-4acb-a90e-e7bb71061c62 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:54.456127 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-cf5ba2f5-c315-4ceb-86a0-11548457be7c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:54.456637 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d7ac8610-4c47-4acb-a90e-e7bb71061c62 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.211145 May 03 09:17:54.457184 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 855/1878] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:17:54 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 09:17:54.463026 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cf5ba2f5-c315-4ceb-86a0-11548457be7c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:54.463551 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cf5ba2f5-c315-4ceb-86a0-11548457be7c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:54.464411 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cf5ba2f5-c315-4ceb-86a0-11548457be7c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:54.464913 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cf5ba2f5-c315-4ceb-86a0-11548457be7c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:54.524802 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-cf5ba2f5-c315-4ceb-86a0-11548457be7c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:54.532829 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-cf5ba2f5-c315-4ceb-86a0-11548457be7c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.082162 May 03 09:17:54.533409 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1024/1879] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:54 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:17:55.473775 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0480ee0f-7e43-4de1-8106-5370f7e8d0ec tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:55.475553 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0480ee0f-7e43-4de1-8106-5370f7e8d0ec tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:55.478973 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-7fba6dd1-0f90-4161-b0d6-c3ad81cb1d3b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:55.480307 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-7fba6dd1-0f90-4161-b0d6-c3ad81cb1d3b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:55.487268 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0480ee0f-7e43-4de1-8106-5370f7e8d0ec tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:55.488062 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0480ee0f-7e43-4de1-8106-5370f7e8d0ec tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:55.489320 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0480ee0f-7e43-4de1-8106-5370f7e8d0ec tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:55.489754 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0480ee0f-7e43-4de1-8106-5370f7e8d0ec tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:55.490175 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7fba6dd1-0f90-4161-b0d6-c3ad81cb1d3b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:55.490624 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7fba6dd1-0f90-4161-b0d6-c3ad81cb1d3b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:55.491392 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7fba6dd1-0f90-4161-b0d6-c3ad81cb1d3b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:55.491878 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7fba6dd1-0f90-4161-b0d6-c3ad81cb1d3b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:55.689145 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0480ee0f-7e43-4de1-8106-5370f7e8d0ec tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:55.693826 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7fba6dd1-0f90-4161-b0d6-c3ad81cb1d3b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:55.698920 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0480ee0f-7e43-4de1-8106-5370f7e8d0ec tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.236274 May 03 09:17:55.699638 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 856/1880] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:55 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:55.704016 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-618671dc-9e10-49c9-ade9-5b51607a0733 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:55.704618 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-618671dc-9e10-49c9-ade9-5b51607a0733 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:55.706891 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7fba6dd1-0f90-4161-b0d6-c3ad81cb1d3b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:55.708498 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7fba6dd1-0f90-4161-b0d6-c3ad81cb1d3b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:55.709677 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-7fba6dd1-0f90-4161-b0d6-c3ad81cb1d3b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.237775 May 03 09:17:55.710239 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1025/1881] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:17:55 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:17:55.710593 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-618671dc-9e10-49c9-ade9-5b51607a0733 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:55.711055 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-618671dc-9e10-49c9-ade9-5b51607a0733 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:55.711804 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-618671dc-9e10-49c9-ade9-5b51607a0733 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:55.712265 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-618671dc-9e10-49c9-ade9-5b51607a0733 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:55.780993 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-618671dc-9e10-49c9-ade9-5b51607a0733 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:55.789748 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-618671dc-9e10-49c9-ade9-5b51607a0733 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.089236 May 03 09:17:55.790317 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 857/1882] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:55 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:56.717020 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b4e72abd-e102-4643-8b4c-5334d92ece58 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:56.717615 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b4e72abd-e102-4643-8b4c-5334d92ece58 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:56.724485 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b4e72abd-e102-4643-8b4c-5334d92ece58 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:56.724930 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b4e72abd-e102-4643-8b4c-5334d92ece58 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:56.725687 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b4e72abd-e102-4643-8b4c-5334d92ece58 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:56.726113 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b4e72abd-e102-4643-8b4c-5334d92ece58 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:56.728119 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6a2e3cf9-54ff-4e1a-9868-7dccd13934aa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:56.728706 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6a2e3cf9-54ff-4e1a-9868-7dccd13934aa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:56.735399 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6a2e3cf9-54ff-4e1a-9868-7dccd13934aa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:56.735874 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6a2e3cf9-54ff-4e1a-9868-7dccd13934aa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:56.736647 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6a2e3cf9-54ff-4e1a-9868-7dccd13934aa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:56.737087 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6a2e3cf9-54ff-4e1a-9868-7dccd13934aa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:56.921668 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b4e72abd-e102-4643-8b4c-5334d92ece58 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:56.924093 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6a2e3cf9-54ff-4e1a-9868-7dccd13934aa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:56.930242 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b4e72abd-e102-4643-8b4c-5334d92ece58 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.217466 May 03 09:17:56.930851 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1026/1883] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:56 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:56.933461 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6a2e3cf9-54ff-4e1a-9868-7dccd13934aa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:56.934991 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6a2e3cf9-54ff-4e1a-9868-7dccd13934aa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:56.935438 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-cbf7fac2-f529-4847-ab8e-51291d871d4d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:56.936061 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-cbf7fac2-f529-4847-ab8e-51291d871d4d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:56.936266 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6a2e3cf9-54ff-4e1a-9868-7dccd13934aa tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.212169 May 03 09:17:56.936973 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 858/1884] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:17:56 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:17:56.942174 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cbf7fac2-f529-4847-ab8e-51291d871d4d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:56.942615 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cbf7fac2-f529-4847-ab8e-51291d871d4d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:56.943370 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cbf7fac2-f529-4847-ab8e-51291d871d4d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:56.943809 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cbf7fac2-f529-4847-ab8e-51291d871d4d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:57.007827 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-cbf7fac2-f529-4847-ab8e-51291d871d4d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:57.020081 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-cbf7fac2-f529-4847-ab8e-51291d871d4d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.087940 May 03 09:17:57.020758 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1027/1885] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:56 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:57.951009 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-be42ff12-9250-433f-a94d-a84ebfcc16b6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:57.952070 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-be42ff12-9250-433f-a94d-a84ebfcc16b6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:57.958522 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ec3449e7-3b3c-407c-b11e-13b35ae28a30 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:57.959528 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ec3449e7-3b3c-407c-b11e-13b35ae28a30 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:57.962687 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-be42ff12-9250-433f-a94d-a84ebfcc16b6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:57.963477 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-be42ff12-9250-433f-a94d-a84ebfcc16b6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:57.964797 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-be42ff12-9250-433f-a94d-a84ebfcc16b6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:57.965524 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-be42ff12-9250-433f-a94d-a84ebfcc16b6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:57.970433 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ec3449e7-3b3c-407c-b11e-13b35ae28a30 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:57.971177 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ec3449e7-3b3c-407c-b11e-13b35ae28a30 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:57.974054 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ec3449e7-3b3c-407c-b11e-13b35ae28a30 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:57.974054 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ec3449e7-3b3c-407c-b11e-13b35ae28a30 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:58.156141 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-be42ff12-9250-433f-a94d-a84ebfcc16b6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:58.159214 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ec3449e7-3b3c-407c-b11e-13b35ae28a30 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:58.164410 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-be42ff12-9250-433f-a94d-a84ebfcc16b6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.220082 May 03 09:17:58.165076 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 859/1886] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:57 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:58.168329 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ec3449e7-3b3c-407c-b11e-13b35ae28a30 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:58.169830 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b39bb569-d82f-4530-91f2-cc8f16d82554 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:58.169959 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ec3449e7-3b3c-407c-b11e-13b35ae28a30 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:58.170559 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b39bb569-d82f-4530-91f2-cc8f16d82554 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:58.171259 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ec3449e7-3b3c-407c-b11e-13b35ae28a30 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.219496 May 03 09:17:58.171873 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1028/1887] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:17:57 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:17:58.176995 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b39bb569-d82f-4530-91f2-cc8f16d82554 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:58.177409 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b39bb569-d82f-4530-91f2-cc8f16d82554 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:58.178210 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b39bb569-d82f-4530-91f2-cc8f16d82554 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:58.178634 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b39bb569-d82f-4530-91f2-cc8f16d82554 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:58.243254 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b39bb569-d82f-4530-91f2-cc8f16d82554 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:58.251437 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b39bb569-d82f-4530-91f2-cc8f16d82554 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.085365 May 03 09:17:58.252043 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 860/1888] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:58 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:59.182545 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-371eaee8-07e6-4873-8ca8-d54f20eecf1f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:59.183130 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-371eaee8-07e6-4873-8ca8-d54f20eecf1f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:59.189482 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-eff45049-8359-4ae9-bcaf-6195cd359bc0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:59.189967 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-371eaee8-07e6-4873-8ca8-d54f20eecf1f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:59.190203 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-371eaee8-07e6-4873-8ca8-d54f20eecf1f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:59.190776 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-eff45049-8359-4ae9-bcaf-6195cd359bc0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:59.190933 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-371eaee8-07e6-4873-8ca8-d54f20eecf1f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:59.191387 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-371eaee8-07e6-4873-8ca8-d54f20eecf1f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:59.197698 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-eff45049-8359-4ae9-bcaf-6195cd359bc0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:59.198128 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-eff45049-8359-4ae9-bcaf-6195cd359bc0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:59.198879 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-eff45049-8359-4ae9-bcaf-6195cd359bc0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:59.199300 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-eff45049-8359-4ae9-bcaf-6195cd359bc0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:59.352774 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-eff45049-8359-4ae9-bcaf-6195cd359bc0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:59.362787 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-eff45049-8359-4ae9-bcaf-6195cd359bc0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:59.364836 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-eff45049-8359-4ae9-bcaf-6195cd359bc0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:59.366275 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-eff45049-8359-4ae9-bcaf-6195cd359bc0 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.180746 May 03 09:17:59.367578 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 861/1889] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:17:59 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:17:59.372493 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7eae286b-0a30-4a80-8542-342a725c647f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:17:59.373304 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7eae286b-0a30-4a80-8542-342a725c647f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:17:59.380114 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7eae286b-0a30-4a80-8542-342a725c647f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:59.380820 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7eae286b-0a30-4a80-8542-342a725c647f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:59.381790 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7eae286b-0a30-4a80-8542-342a725c647f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:17:59.382384 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7eae286b-0a30-4a80-8542-342a725c647f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:17:59.467802 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7eae286b-0a30-4a80-8542-342a725c647f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:59.477411 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7eae286b-0a30-4a80-8542-342a725c647f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.108639 May 03 09:17:59.486667 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 862/1890] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:59 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:17:59.527644 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-371eaee8-07e6-4873-8ca8-d54f20eecf1f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:17:59.535419 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-371eaee8-07e6-4873-8ca8-d54f20eecf1f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.356797 May 03 09:17:59.536059 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1029/1891] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:17:59 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:00.389291 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9fe73137-0650-46f1-a580-e45c704e0ed9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:00.390235 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9fe73137-0650-46f1-a580-e45c704e0ed9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:00.400201 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9fe73137-0650-46f1-a580-e45c704e0ed9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:00.400646 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9fe73137-0650-46f1-a580-e45c704e0ed9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:00.401404 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9fe73137-0650-46f1-a580-e45c704e0ed9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:00.401833 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9fe73137-0650-46f1-a580-e45c704e0ed9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:00.494696 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-64206665-d6e3-4af9-a256-bd4c13913e29 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:00.495310 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-64206665-d6e3-4af9-a256-bd4c13913e29 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:00.501987 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-64206665-d6e3-4af9-a256-bd4c13913e29 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:00.502450 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-64206665-d6e3-4af9-a256-bd4c13913e29 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:00.503225 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-64206665-d6e3-4af9-a256-bd4c13913e29 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:00.503656 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-64206665-d6e3-4af9-a256-bd4c13913e29 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:00.554907 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9fe73137-0650-46f1-a580-e45c704e0ed9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:00.563464 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9fe73137-0650-46f1-a580-e45c704e0ed9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:00.565012 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9fe73137-0650-46f1-a580-e45c704e0ed9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:00.566202 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9fe73137-0650-46f1-a580-e45c704e0ed9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.183593 May 03 09:18:00.566763 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 863/1892] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:18:00 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:18:00.570380 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-64206665-d6e3-4af9-a256-bd4c13913e29 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:00.571177 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c3a15271-7715-430e-8262-3f2ab82a6283 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:00.571836 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c3a15271-7715-430e-8262-3f2ab82a6283 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:00.577694 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c3a15271-7715-430e-8262-3f2ab82a6283 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:00.578152 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c3a15271-7715-430e-8262-3f2ab82a6283 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:00.578934 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c3a15271-7715-430e-8262-3f2ab82a6283 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:00.579376 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c3a15271-7715-430e-8262-3f2ab82a6283 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:00.580180 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-64206665-d6e3-4af9-a256-bd4c13913e29 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.089479 May 03 09:18:00.581190 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1030/1893] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:00 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:00.724639 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c3a15271-7715-430e-8262-3f2ab82a6283 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:00.737885 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c3a15271-7715-430e-8262-3f2ab82a6283 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.169849 May 03 09:18:00.738782 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 864/1894] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:00 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:01.588615 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e392ebbf-01a0-4f19-a6bc-b0c4d6767196 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:01.589564 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e392ebbf-01a0-4f19-a6bc-b0c4d6767196 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:01.600504 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e392ebbf-01a0-4f19-a6bc-b0c4d6767196 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:01.600950 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-78ff6f35-8915-4dfb-bdd1-489611bcf480 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:01.601738 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e392ebbf-01a0-4f19-a6bc-b0c4d6767196 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:01.602147 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-78ff6f35-8915-4dfb-bdd1-489611bcf480 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:01.602407 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e392ebbf-01a0-4f19-a6bc-b0c4d6767196 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:01.602840 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e392ebbf-01a0-4f19-a6bc-b0c4d6767196 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:01.608857 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-78ff6f35-8915-4dfb-bdd1-489611bcf480 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:01.609301 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-78ff6f35-8915-4dfb-bdd1-489611bcf480 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:01.610064 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-78ff6f35-8915-4dfb-bdd1-489611bcf480 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:01.610493 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-78ff6f35-8915-4dfb-bdd1-489611bcf480 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:01.691597 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-78ff6f35-8915-4dfb-bdd1-489611bcf480 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:01.700178 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-78ff6f35-8915-4dfb-bdd1-489611bcf480 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.105896 May 03 09:18:01.700981 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 865/1895] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:01 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:01.752897 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e392ebbf-01a0-4f19-a6bc-b0c4d6767196 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:01.757612 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-53110a93-2729-48dc-ba95-06b64e831e4e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:01.758351 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-53110a93-2729-48dc-ba95-06b64e831e4e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:01.762043 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e392ebbf-01a0-4f19-a6bc-b0c4d6767196 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:01.763557 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e392ebbf-01a0-4f19-a6bc-b0c4d6767196 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:01.764365 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-53110a93-2729-48dc-ba95-06b64e831e4e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:01.764756 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e392ebbf-01a0-4f19-a6bc-b0c4d6767196 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.182909 May 03 09:18:01.764875 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-53110a93-2729-48dc-ba95-06b64e831e4e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:01.765277 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1031/1896] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:18:01 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:18:01.765568 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-53110a93-2729-48dc-ba95-06b64e831e4e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:01.766102 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-53110a93-2729-48dc-ba95-06b64e831e4e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:01.903728 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-53110a93-2729-48dc-ba95-06b64e831e4e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:01.916002 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-53110a93-2729-48dc-ba95-06b64e831e4e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.162181 May 03 09:18:01.916773 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 866/1897] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:01 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:02.722105 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-cac59b67-ec4e-491b-9868-83398f7385af tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:02.723124 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-cac59b67-ec4e-491b-9868-83398f7385af tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:02.735377 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cac59b67-ec4e-491b-9868-83398f7385af tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:02.736774 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cac59b67-ec4e-491b-9868-83398f7385af tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:02.738334 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cac59b67-ec4e-491b-9868-83398f7385af tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:02.739063 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cac59b67-ec4e-491b-9868-83398f7385af tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:02.782817 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ea449f04-00ef-4b02-839f-2107b1156312 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:02.783424 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ea449f04-00ef-4b02-839f-2107b1156312 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:02.791071 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ea449f04-00ef-4b02-839f-2107b1156312 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:02.791507 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ea449f04-00ef-4b02-839f-2107b1156312 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:02.792295 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ea449f04-00ef-4b02-839f-2107b1156312 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:02.792729 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ea449f04-00ef-4b02-839f-2107b1156312 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:02.812141 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-cac59b67-ec4e-491b-9868-83398f7385af tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:02.822942 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-cac59b67-ec4e-491b-9868-83398f7385af tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.107421 May 03 09:18:02.823913 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1032/1898] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:02 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:02.932516 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ea449f04-00ef-4b02-839f-2107b1156312 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:02.938372 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-7013f4a3-c34f-4f51-94ea-bacb907af2b5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:02.938998 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-7013f4a3-c34f-4f51-94ea-bacb907af2b5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:02.941451 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ea449f04-00ef-4b02-839f-2107b1156312 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:02.943562 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ea449f04-00ef-4b02-839f-2107b1156312 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:02.944793 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ea449f04-00ef-4b02-839f-2107b1156312 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.165909 May 03 09:18:02.945344 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 867/1899] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:18:02 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 09:18:02.945535 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7013f4a3-c34f-4f51-94ea-bacb907af2b5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:02.945830 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7013f4a3-c34f-4f51-94ea-bacb907af2b5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:02.946617 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7013f4a3-c34f-4f51-94ea-bacb907af2b5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:02.947046 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7013f4a3-c34f-4f51-94ea-bacb907af2b5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:03.092136 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7013f4a3-c34f-4f51-94ea-bacb907af2b5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:03.100418 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-7013f4a3-c34f-4f51-94ea-bacb907af2b5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.165910 May 03 09:18:03.100986 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1033/1900] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:02 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:18:03.845190 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c2a82654-a91b-4acd-9d0d-9034516cf7e6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:03.846204 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c2a82654-a91b-4acd-9d0d-9034516cf7e6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:03.856739 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c2a82654-a91b-4acd-9d0d-9034516cf7e6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:03.857382 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c2a82654-a91b-4acd-9d0d-9034516cf7e6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:03.858572 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c2a82654-a91b-4acd-9d0d-9034516cf7e6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:03.859174 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c2a82654-a91b-4acd-9d0d-9034516cf7e6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:03.937747 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c2a82654-a91b-4acd-9d0d-9034516cf7e6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:03.946316 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c2a82654-a91b-4acd-9d0d-9034516cf7e6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.108132 May 03 09:18:03.946933 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 868/1901] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:03 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:03.963519 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-8a756f51-68da-4958-8fa6-ffc137387db9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:03.964167 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-8a756f51-68da-4958-8fa6-ffc137387db9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:03.970938 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8a756f51-68da-4958-8fa6-ffc137387db9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:03.971381 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8a756f51-68da-4958-8fa6-ffc137387db9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:03.972169 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8a756f51-68da-4958-8fa6-ffc137387db9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:03.972602 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8a756f51-68da-4958-8fa6-ffc137387db9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:04.097539 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-8a756f51-68da-4958-8fa6-ffc137387db9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:04.105825 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-8a756f51-68da-4958-8fa6-ffc137387db9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:04.107300 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-8a756f51-68da-4958-8fa6-ffc137387db9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:04.108501 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-8a756f51-68da-4958-8fa6-ffc137387db9 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1800 microversion: 2.20 time: 0.148953 May 03 09:18:04.109050 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1034/1902] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:18:03 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1800 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:18:04.117777 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-83025cc7-330a-4670-b563-ffa15e94d82f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:04.118466 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-83025cc7-330a-4670-b563-ffa15e94d82f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:04.124452 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-83025cc7-330a-4670-b563-ffa15e94d82f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:04.124917 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-83025cc7-330a-4670-b563-ffa15e94d82f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:04.125673 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-83025cc7-330a-4670-b563-ffa15e94d82f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:04.126106 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-83025cc7-330a-4670-b563-ffa15e94d82f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:04.127253 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-400b6163-c697-4863-9dde-86f34434c336 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '.version_select at 0x7f09d34fdca0>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:04.150130 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-400b6163-c697-4863-9dde-86f34434c336 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-682169449" status: 204 len: 0 microversion: 2.20 time: 0.026497 May 03 09:18:04.150700 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1035/1903] 10.222.0.11 () {60 vars in 1258 bytes} [Tue May 3 09:18:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-682169449 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 03 09:18:04.262511 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-83025cc7-330a-4670-b563-ffa15e94d82f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:04.270595 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-83025cc7-330a-4670-b563-ffa15e94d82f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.156762 May 03 09:18:04.271252 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 869/1904] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:04 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:04.963658 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-98404613-dc8d-47a0-b217-f58755ca618b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:04.964306 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-98404613-dc8d-47a0-b217-f58755ca618b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:04.970798 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-98404613-dc8d-47a0-b217-f58755ca618b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:04.971243 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-98404613-dc8d-47a0-b217-f58755ca618b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:04.972048 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-98404613-dc8d-47a0-b217-f58755ca618b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:04.972484 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-98404613-dc8d-47a0-b217-f58755ca618b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:05.035881 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-98404613-dc8d-47a0-b217-f58755ca618b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:05.045718 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-98404613-dc8d-47a0-b217-f58755ca618b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.086151 May 03 09:18:05.046401 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1036/1905] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:04 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:18:05.186079 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-9b1d8dc7-c0d8-429b-b341-9c5f784cda72 req-97c29123-0479-40c3-879d-3a5b250f2a52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b68d79a3-e9c5-46b6-b8c0-a9d6017f388f", "tag": "c0a78137-d132-441d-8bd5-1d74354f3e67"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:18:05.197247 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-9b1d8dc7-c0d8-429b-b341-9c5f784cda72 req-97c29123-0479-40c3-879d-3a5b250f2a52 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:05.199471 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-9b1d8dc7-c0d8-429b-b341-9c5f784cda72 req-97c29123-0479-40c3-879d-3a5b250f2a52 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:05.222177 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-9b1d8dc7-c0d8-429b-b341-9c5f784cda72 req-97c29123-0479-40c3-879d-3a5b250f2a52 service nova] Creating event network-changed:c0a78137-d132-441d-8bd5-1d74354f3e67 for instance b68d79a3-e9c5-46b6-b8c0-a9d6017f388f on hv-cinder-84027 May 03 09:18:05.228269 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-9b1d8dc7-c0d8-429b-b341-9c5f784cda72 req-97c29123-0479-40c3-879d-3a5b250f2a52 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118989 May 03 09:18:05.228889 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 870/1906] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 09:18:05.289450 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-1b1ea689-d4b9-46c6-8ee0-91868d24dc28 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:05.290091 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-1b1ea689-d4b9-46c6-8ee0-91868d24dc28 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:05.299458 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-42fe3200-db3d-4e53-98ae-69f3a8d58f02 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Action: 'create', calling method: .version_select at 0x7f09cddbde50>, body: {"keypair": {"name": "tempest-keypair-3140678"}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:18:05.313470 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1b1ea689-d4b9-46c6-8ee0-91868d24dc28 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:05.316201 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-42fe3200-db3d-4e53-98ae-69f3a8d58f02 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Getting quotas for project fe13f4f312b145cbb904daebc75026d2. Resources: {'key_pairs'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 03 09:18:05.316791 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1b1ea689-d4b9-46c6-8ee0-91868d24dc28 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:05.318889 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1b1ea689-d4b9-46c6-8ee0-91868d24dc28 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:05.320614 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1b1ea689-d4b9-46c6-8ee0-91868d24dc28 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:05.321751 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-42fe3200-db3d-4e53-98ae-69f3a8d58f02 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Getting quotas for user 65620fcd12544f7094440d60b094cfb1 and project fe13f4f312b145cbb904daebc75026d2. Resources: {'key_pairs'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 03 09:18:05.624598 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-1b1ea689-d4b9-46c6-8ee0-91868d24dc28 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:05.636090 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-1b1ea689-d4b9-46c6-8ee0-91868d24dc28 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.351623 May 03 09:18:05.638003 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1037/1907] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:05 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:05.760419 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-42fe3200-db3d-4e53-98ae-69f3a8d58f02 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Getting quotas for project fe13f4f312b145cbb904daebc75026d2. Resources: {'key_pairs'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 03 09:18:05.764942 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-42fe3200-db3d-4e53-98ae-69f3a8d58f02 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Getting quotas for user 65620fcd12544f7094440d60b094cfb1 and project fe13f4f312b145cbb904daebc75026d2. Resources: {'key_pairs'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 03 09:18:05.780515 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-42fe3200-db3d-4e53-98ae-69f3a8d58f02 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "POST /compute/v2.1/os-keypairs" status: 201 len: 2313 microversion: 2.20 time: 0.485747 May 03 09:18:05.786131 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 871/1908] 10.222.0.11 () {62 vars in 1198 bytes} [Tue May 3 09:18:05 2022] POST /compute/v2.1/os-keypairs => generated 2313 bytes in 487 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) May 03 09:18:06.062611 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c00a703c-a774-49ef-9119-d40841f8699e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:06.063299 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c00a703c-a774-49ef-9119-d40841f8699e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:06.070249 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c00a703c-a774-49ef-9119-d40841f8699e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:06.071069 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c00a703c-a774-49ef-9119-d40841f8699e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:06.071950 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c00a703c-a774-49ef-9119-d40841f8699e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:06.072404 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c00a703c-a774-49ef-9119-d40841f8699e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:06.154814 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c00a703c-a774-49ef-9119-d40841f8699e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:06.167711 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c00a703c-a774-49ef-9119-d40841f8699e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.109003 May 03 09:18:06.168429 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1038/1909] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:06 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:06.656735 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6f272baf-1ed2-4146-a645-ebd8d3613eb5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:06.658259 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6f272baf-1ed2-4146-a645-ebd8d3613eb5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:06.664999 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6f272baf-1ed2-4146-a645-ebd8d3613eb5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:06.665834 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6f272baf-1ed2-4146-a645-ebd8d3613eb5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:06.666692 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6f272baf-1ed2-4146-a645-ebd8d3613eb5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:06.667196 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6f272baf-1ed2-4146-a645-ebd8d3613eb5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:06.858850 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6f272baf-1ed2-4146-a645-ebd8d3613eb5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:06.867998 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6f272baf-1ed2-4146-a645-ebd8d3613eb5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.215801 May 03 09:18:06.868704 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 872/1910] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:06 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:07.186381 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-2ed47550-5535-4adf-8b51-10595fb5804e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:07.187089 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-2ed47550-5535-4adf-8b51-10595fb5804e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:07.195037 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2ed47550-5535-4adf-8b51-10595fb5804e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:07.195622 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2ed47550-5535-4adf-8b51-10595fb5804e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:07.196758 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2ed47550-5535-4adf-8b51-10595fb5804e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:07.197282 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2ed47550-5535-4adf-8b51-10595fb5804e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:07.243825 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-1e3336f6-043e-4e79-a88b-17a5b77fd8f4 req-a6cca329-990c-464a-b621-f98a7bc542c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b68d79a3-e9c5-46b6-b8c0-a9d6017f388f", "name": "network-vif-deleted", "tag": "c0a78137-d132-441d-8bd5-1d74354f3e67"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:18:07.252826 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-1e3336f6-043e-4e79-a88b-17a5b77fd8f4 req-a6cca329-990c-464a-b621-f98a7bc542c5 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:07.253266 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-1e3336f6-043e-4e79-a88b-17a5b77fd8f4 req-a6cca329-990c-464a-b621-f98a7bc542c5 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:07.264559 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-1e3336f6-043e-4e79-a88b-17a5b77fd8f4 req-a6cca329-990c-464a-b621-f98a7bc542c5 service nova] Creating event network-vif-deleted:c0a78137-d132-441d-8bd5-1d74354f3e67 for instance b68d79a3-e9c5-46b6-b8c0-a9d6017f388f on hv-cinder-84027 May 03 09:18:07.269814 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-1e3336f6-043e-4e79-a88b-17a5b77fd8f4 req-a6cca329-990c-464a-b621-f98a7bc542c5 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029736 May 03 09:18:07.270435 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 873/1911] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:18:07.300826 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-2ed47550-5535-4adf-8b51-10595fb5804e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:07.312622 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-2ed47550-5535-4adf-8b51-10595fb5804e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.130824 May 03 09:18:07.313509 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1039/1912] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:07 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:07.490583 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-553e6538-2d25-4df4-9fc2-e5407a588b2d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-697287245", "imageRef": "bd46d67a-108d-4c0c-9f0b-cb6d41c82a32", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fde0bcc1-b261-4b01-8a8d-d9324b6fc096"}], "security_groups": [{"name": "tempest-securitygroup--1989235633"}], "key_name": "tempest-keypair-3140678", "user_data": "}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:18:07.603349 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.network.neutron [None req-553e6538-2d25-4df4-9fc2-e5407a588b2d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] validate_networks() for [('fde0bcc1-b261-4b01-8a8d-d9324b6fc096', None, None, None, None, None)] {{(pid=123392) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 03 09:18:07.885529 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-75098bc6-7fde-4675-9e38-d30eee834cc0 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:07.886150 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-75098bc6-7fde-4675-9e38-d30eee834cc0 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:07.892604 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-75098bc6-7fde-4675-9e38-d30eee834cc0 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:07.893060 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-75098bc6-7fde-4675-9e38-d30eee834cc0 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:07.893832 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-75098bc6-7fde-4675-9e38-d30eee834cc0 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:07.894273 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-75098bc6-7fde-4675-9e38-d30eee834cc0 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:08.099411 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-553e6538-2d25-4df4-9fc2-e5407a588b2d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Flavor limits 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 03 09:18:08.099855 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-553e6538-2d25-4df4-9fc2-e5407a588b2d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Image limits 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 03 09:18:08.100327 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-553e6538-2d25-4df4-9fc2-e5407a588b2d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Flavor pref 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 03 09:18:08.100728 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-553e6538-2d25-4df4-9fc2-e5407a588b2d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Image pref 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 03 09:18:08.101133 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-553e6538-2d25-4df4-9fc2-e5407a588b2d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 03 09:18:08.103214 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-75098bc6-7fde-4675-9e38-d30eee834cc0 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:08.109786 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-553e6538-2d25-4df4-9fc2-e5407a588b2d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:08.110237 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-553e6538-2d25-4df4-9fc2-e5407a588b2d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:08.111019 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-553e6538-2d25-4df4-9fc2-e5407a588b2d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:08.111144 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-75098bc6-7fde-4675-9e38-d30eee834cc0 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.229612 May 03 09:18:08.111447 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-553e6538-2d25-4df4-9fc2-e5407a588b2d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:08.111694 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1040/1913] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:07 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:08.127472 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-553e6538-2d25-4df4-9fc2-e5407a588b2d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Getting quotas for project fe13f4f312b145cbb904daebc75026d2. Resources: {'cores', 'ram', 'instances'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 03 09:18:08.131229 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-553e6538-2d25-4df4-9fc2-e5407a588b2d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Getting quotas for user 65620fcd12544f7094440d60b094cfb1 and project fe13f4f312b145cbb904daebc75026d2. Resources: {'cores', 'ram', 'instances'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 03 09:18:08.141939 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-553e6538-2d25-4df4-9fc2-e5407a588b2d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Going to run 1 instances... {{(pid=123392) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 03 09:18:08.144366 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-553e6538-2d25-4df4-9fc2-e5407a588b2d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: 2dbd7241-ce49-4617-9aad-57a39f136403] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd46d67a-108d-4c0c-9f0b-cb6d41c82a32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 03 09:18:08.193500 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-553e6538-2d25-4df4-9fc2-e5407a588b2d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.710687 May 03 09:18:08.194130 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 874/1914] 10.222.0.11 () {62 vars in 1187 bytes} [Tue May 3 09:18:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 03 09:18:08.204325 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-28140c42-1b90-4d05-814e-b90b0cbe556f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:08.204917 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-28140c42-1b90-4d05-814e-b90b0cbe556f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: 2dbd7241-ce49-4617-9aad-57a39f136403] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:08.261907 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-28140c42-1b90-4d05-814e-b90b0cbe556f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:08.269932 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-28140c42-1b90-4d05-814e-b90b0cbe556f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:08.272797 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-28140c42-1b90-4d05-814e-b90b0cbe556f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:08.274176 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-28140c42-1b90-4d05-814e-b90b0cbe556f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/2dbd7241-ce49-4617-9aad-57a39f136403" status: 200 len: 1278 microversion: 2.20 time: 0.073856 May 03 09:18:08.274889 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1041/1915] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:18:08 2022] GET /compute/v2.1/servers/2dbd7241-ce49-4617-9aad-57a39f136403 => generated 1278 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:18:08.329981 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ccd8e07b-3a6e-4cc2-b13f-14a19ceaaf47 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:08.330735 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ccd8e07b-3a6e-4cc2-b13f-14a19ceaaf47 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:08.337486 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ccd8e07b-3a6e-4cc2-b13f-14a19ceaaf47 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:08.338015 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ccd8e07b-3a6e-4cc2-b13f-14a19ceaaf47 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:08.338694 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ccd8e07b-3a6e-4cc2-b13f-14a19ceaaf47 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:08.339132 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ccd8e07b-3a6e-4cc2-b13f-14a19ceaaf47 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:08.405537 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ccd8e07b-3a6e-4cc2-b13f-14a19ceaaf47 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:08.413830 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ccd8e07b-3a6e-4cc2-b13f-14a19ceaaf47 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.087862 May 03 09:18:08.414500 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 875/1916] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:08 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:09.128931 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-dcabc0f8-472e-44be-8817-367bd8c2f594 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:09.129602 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-dcabc0f8-472e-44be-8817-367bd8c2f594 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:09.138083 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dcabc0f8-472e-44be-8817-367bd8c2f594 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:09.138665 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dcabc0f8-472e-44be-8817-367bd8c2f594 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:09.140030 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dcabc0f8-472e-44be-8817-367bd8c2f594 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:09.140798 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dcabc0f8-472e-44be-8817-367bd8c2f594 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:09.292635 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-dcabc0f8-472e-44be-8817-367bd8c2f594 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:09.293944 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-46f79cf2-b65a-49d9-b697-5fd105453b7f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:09.295049 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-46f79cf2-b65a-49d9-b697-5fd105453b7f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: 2dbd7241-ce49-4617-9aad-57a39f136403] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:09.301582 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-46f79cf2-b65a-49d9-b697-5fd105453b7f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:09.302268 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-46f79cf2-b65a-49d9-b697-5fd105453b7f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:09.303222 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-46f79cf2-b65a-49d9-b697-5fd105453b7f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:09.303850 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-46f79cf2-b65a-49d9-b697-5fd105453b7f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:09.304121 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-dcabc0f8-472e-44be-8817-367bd8c2f594 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.179171 May 03 09:18:09.305104 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1042/1917] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:09 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:09.369574 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-46f79cf2-b65a-49d9-b697-5fd105453b7f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:09.379203 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-46f79cf2-b65a-49d9-b697-5fd105453b7f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:09.380825 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-46f79cf2-b65a-49d9-b697-5fd105453b7f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:09.381949 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-46f79cf2-b65a-49d9-b697-5fd105453b7f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/2dbd7241-ce49-4617-9aad-57a39f136403" status: 200 len: 1348 microversion: 2.20 time: 0.092518 May 03 09:18:09.382474 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 876/1918] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:18:09 2022] GET /compute/v2.1/servers/2dbd7241-ce49-4617-9aad-57a39f136403 => generated 1348 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 09:18:09.434608 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-19d71658-c635-4599-8585-d677eb5e66d1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:09.435337 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-19d71658-c635-4599-8585-d677eb5e66d1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:09.442657 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-19d71658-c635-4599-8585-d677eb5e66d1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:09.443168 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-19d71658-c635-4599-8585-d677eb5e66d1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:09.444091 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-19d71658-c635-4599-8585-d677eb5e66d1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:09.444594 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-19d71658-c635-4599-8585-d677eb5e66d1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:09.521278 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-19d71658-c635-4599-8585-d677eb5e66d1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:09.529498 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-19d71658-c635-4599-8585-d677eb5e66d1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.099919 May 03 09:18:09.530095 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1043/1919] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:09 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:10.321660 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-518683fe-aec6-4e94-871b-4d7fc45339a6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:10.322274 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-518683fe-aec6-4e94-871b-4d7fc45339a6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:10.328974 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-518683fe-aec6-4e94-871b-4d7fc45339a6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:10.329440 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-518683fe-aec6-4e94-871b-4d7fc45339a6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:10.330198 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-518683fe-aec6-4e94-871b-4d7fc45339a6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:10.330620 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-518683fe-aec6-4e94-871b-4d7fc45339a6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:10.405205 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e6a599fe-48f7-4124-9e2c-db519731fa83 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:10.405830 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e6a599fe-48f7-4124-9e2c-db519731fa83 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: 2dbd7241-ce49-4617-9aad-57a39f136403] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:10.412696 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e6a599fe-48f7-4124-9e2c-db519731fa83 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:10.412696 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e6a599fe-48f7-4124-9e2c-db519731fa83 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:10.413469 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e6a599fe-48f7-4124-9e2c-db519731fa83 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:10.413891 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e6a599fe-48f7-4124-9e2c-db519731fa83 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:10.497752 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-518683fe-aec6-4e94-871b-4d7fc45339a6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:10.515729 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-518683fe-aec6-4e94-871b-4d7fc45339a6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.197948 May 03 09:18:10.517170 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 877/1920] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:10 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:10.548780 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-070c32d6-1b72-4adc-b3de-a61d183db983 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:10.549403 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-070c32d6-1b72-4adc-b3de-a61d183db983 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:10.557182 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-070c32d6-1b72-4adc-b3de-a61d183db983 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:10.557636 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-070c32d6-1b72-4adc-b3de-a61d183db983 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:10.558420 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-070c32d6-1b72-4adc-b3de-a61d183db983 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:10.558855 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-070c32d6-1b72-4adc-b3de-a61d183db983 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:10.596009 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e6a599fe-48f7-4124-9e2c-db519731fa83 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:10.605277 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e6a599fe-48f7-4124-9e2c-db519731fa83 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:10.609911 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e6a599fe-48f7-4124-9e2c-db519731fa83 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:10.611089 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e6a599fe-48f7-4124-9e2c-db519731fa83 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/2dbd7241-ce49-4617-9aad-57a39f136403" status: 200 len: 1404 microversion: 2.20 time: 0.210526 May 03 09:18:10.611661 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1044/1921] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:18:10 2022] GET /compute/v2.1/servers/2dbd7241-ce49-4617-9aad-57a39f136403 => generated 1404 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:18:10.654619 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-070c32d6-1b72-4adc-b3de-a61d183db983 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:10.662902 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-070c32d6-1b72-4adc-b3de-a61d183db983 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.119867 May 03 09:18:10.663488 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 878/1922] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:10 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:10.729401 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [req-5e29f738-632b-4fbd-8cb5-23ccd2384bcc req-20383322-b563-42cc-872e-fc0fb04e293e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dbd7241-ce49-4617-9aad-57a39f136403", "tag": "3390c222-09ae-4629-b4d7-4e4001985505"}]} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:18:10.738384 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-5e29f738-632b-4fbd-8cb5-23ccd2384bcc req-20383322-b563-42cc-872e-fc0fb04e293e service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:10.738832 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-5e29f738-632b-4fbd-8cb5-23ccd2384bcc req-20383322-b563-42cc-872e-fc0fb04e293e service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:10.751384 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.compute.server_external_events [req-5e29f738-632b-4fbd-8cb5-23ccd2384bcc req-20383322-b563-42cc-872e-fc0fb04e293e service nova] Creating event network-changed:3390c222-09ae-4629-b4d7-4e4001985505 for instance 2dbd7241-ce49-4617-9aad-57a39f136403 on hv-cinder-84027 May 03 09:18:10.762774 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [req-5e29f738-632b-4fbd-8cb5-23ccd2384bcc req-20383322-b563-42cc-872e-fc0fb04e293e service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037020 May 03 09:18:10.763592 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1045/1923] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:18:11.537587 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-53b57288-980b-4f84-923c-5eaedc545743 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:11.538550 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-53b57288-980b-4f84-923c-5eaedc545743 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:11.546104 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-53b57288-980b-4f84-923c-5eaedc545743 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:11.546551 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-53b57288-980b-4f84-923c-5eaedc545743 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:11.547314 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-53b57288-980b-4f84-923c-5eaedc545743 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:11.547743 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-53b57288-980b-4f84-923c-5eaedc545743 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:11.629319 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-78377f87-cf54-40f2-965f-54a92d42264f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:11.630348 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-78377f87-cf54-40f2-965f-54a92d42264f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: 2dbd7241-ce49-4617-9aad-57a39f136403] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:11.636999 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-78377f87-cf54-40f2-965f-54a92d42264f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:11.637447 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-78377f87-cf54-40f2-965f-54a92d42264f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:11.638218 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-78377f87-cf54-40f2-965f-54a92d42264f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:11.638647 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-78377f87-cf54-40f2-965f-54a92d42264f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:11.690799 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-53b57288-980b-4f84-923c-5eaedc545743 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:11.699365 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-53b57288-980b-4f84-923c-5eaedc545743 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.168362 May 03 09:18:11.699967 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 879/1924] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:11 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:11.704633 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9e4967f1-f21f-4391-b055-196e2cbd5599 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:11.705414 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9e4967f1-f21f-4391-b055-196e2cbd5599 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:11.711677 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9e4967f1-f21f-4391-b055-196e2cbd5599 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:11.712287 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9e4967f1-f21f-4391-b055-196e2cbd5599 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:11.713059 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9e4967f1-f21f-4391-b055-196e2cbd5599 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:11.713492 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9e4967f1-f21f-4391-b055-196e2cbd5599 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:11.780577 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9e4967f1-f21f-4391-b055-196e2cbd5599 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:11.788978 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9e4967f1-f21f-4391-b055-196e2cbd5599 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.087747 May 03 09:18:11.789481 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 880/1925] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:11 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:11.795597 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-78377f87-cf54-40f2-965f-54a92d42264f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:11.807105 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-78377f87-cf54-40f2-965f-54a92d42264f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:11.808669 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-78377f87-cf54-40f2-965f-54a92d42264f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:11.809791 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-78377f87-cf54-40f2-965f-54a92d42264f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/2dbd7241-ce49-4617-9aad-57a39f136403" status: 200 len: 1404 microversion: 2.20 time: 0.184802 May 03 09:18:11.810343 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1046/1926] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:18:11 2022] GET /compute/v2.1/servers/2dbd7241-ce49-4617-9aad-57a39f136403 => generated 1404 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:18:12.721501 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a92deea1-0408-4ec7-9ebb-258fecb51f4c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:12.722507 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a92deea1-0408-4ec7-9ebb-258fecb51f4c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:12.731151 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a92deea1-0408-4ec7-9ebb-258fecb51f4c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:12.731595 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a92deea1-0408-4ec7-9ebb-258fecb51f4c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:12.732397 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a92deea1-0408-4ec7-9ebb-258fecb51f4c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:12.732814 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a92deea1-0408-4ec7-9ebb-258fecb51f4c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:12.809256 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-7996a915-3c66-40c4-8739-ec75509c31ef tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:12.809873 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-7996a915-3c66-40c4-8739-ec75509c31ef tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:12.816897 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7996a915-3c66-40c4-8739-ec75509c31ef tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:12.817362 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7996a915-3c66-40c4-8739-ec75509c31ef tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:12.818163 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7996a915-3c66-40c4-8739-ec75509c31ef tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:12.818599 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7996a915-3c66-40c4-8739-ec75509c31ef tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:12.888664 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7996a915-3c66-40c4-8739-ec75509c31ef tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:12.894912 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a92deea1-0408-4ec7-9ebb-258fecb51f4c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:12.899455 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-7996a915-3c66-40c4-8739-ec75509c31ef tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.093971 May 03 09:18:12.900175 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1047/1927] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:12 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:12.904661 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5f30786c-c607-4d4a-ab4e-d53eb748f09b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:12.905266 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5f30786c-c607-4d4a-ab4e-d53eb748f09b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: 2dbd7241-ce49-4617-9aad-57a39f136403] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:12.905403 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a92deea1-0408-4ec7-9ebb-258fecb51f4c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.190885 May 03 09:18:12.905919 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 881/1928] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:12 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:12.911143 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5f30786c-c607-4d4a-ab4e-d53eb748f09b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:12.911601 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5f30786c-c607-4d4a-ab4e-d53eb748f09b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:12.912380 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5f30786c-c607-4d4a-ab4e-d53eb748f09b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:12.912817 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5f30786c-c607-4d4a-ab4e-d53eb748f09b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:13.040706 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5f30786c-c607-4d4a-ab4e-d53eb748f09b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:13.049018 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5f30786c-c607-4d4a-ab4e-d53eb748f09b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:13.050509 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5f30786c-c607-4d4a-ab4e-d53eb748f09b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:13.051742 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5f30786c-c607-4d4a-ab4e-d53eb748f09b tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/2dbd7241-ce49-4617-9aad-57a39f136403" status: 200 len: 1404 microversion: 2.20 time: 0.150545 May 03 09:18:13.052342 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1048/1929] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:18:12 2022] GET /compute/v2.1/servers/2dbd7241-ce49-4617-9aad-57a39f136403 => generated 1404 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:18:13.920102 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5837e77d-bc51-4d7c-aa75-658f6ad81cbb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:13.921118 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5837e77d-bc51-4d7c-aa75-658f6ad81cbb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:13.926552 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d8bd936d-e9be-4b68-a5b2-eefb288504f9 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:13.927590 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d8bd936d-e9be-4b68-a5b2-eefb288504f9 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:13.931472 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5837e77d-bc51-4d7c-aa75-658f6ad81cbb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:13.931952 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5837e77d-bc51-4d7c-aa75-658f6ad81cbb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:13.932716 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5837e77d-bc51-4d7c-aa75-658f6ad81cbb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:13.933138 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5837e77d-bc51-4d7c-aa75-658f6ad81cbb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:13.935442 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d8bd936d-e9be-4b68-a5b2-eefb288504f9 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:13.935925 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d8bd936d-e9be-4b68-a5b2-eefb288504f9 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:13.936699 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d8bd936d-e9be-4b68-a5b2-eefb288504f9 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:13.937136 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d8bd936d-e9be-4b68-a5b2-eefb288504f9 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:14.000186 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5837e77d-bc51-4d7c-aa75-658f6ad81cbb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:14.008546 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5837e77d-bc51-4d7c-aa75-658f6ad81cbb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.094982 May 03 09:18:14.009125 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 882/1930] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:13 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:14.069828 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-249204ee-9fd0-4a91-9e8c-cf7dd2788e1f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:14.070454 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-249204ee-9fd0-4a91-9e8c-cf7dd2788e1f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: 2dbd7241-ce49-4617-9aad-57a39f136403] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:14.076520 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-249204ee-9fd0-4a91-9e8c-cf7dd2788e1f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:14.077005 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-249204ee-9fd0-4a91-9e8c-cf7dd2788e1f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:14.077805 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-249204ee-9fd0-4a91-9e8c-cf7dd2788e1f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:14.078247 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-249204ee-9fd0-4a91-9e8c-cf7dd2788e1f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:14.085459 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d8bd936d-e9be-4b68-a5b2-eefb288504f9 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:14.094151 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d8bd936d-e9be-4b68-a5b2-eefb288504f9 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.174240 May 03 09:18:14.094741 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1049/1931] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:13 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:14.208157 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-249204ee-9fd0-4a91-9e8c-cf7dd2788e1f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:14.218136 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-249204ee-9fd0-4a91-9e8c-cf7dd2788e1f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:14.219646 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-249204ee-9fd0-4a91-9e8c-cf7dd2788e1f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:14.220854 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-249204ee-9fd0-4a91-9e8c-cf7dd2788e1f tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/2dbd7241-ce49-4617-9aad-57a39f136403" status: 200 len: 1404 microversion: 2.20 time: 0.155024 May 03 09:18:14.221428 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 883/1932] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:18:14 2022] GET /compute/v2.1/servers/2dbd7241-ce49-4617-9aad-57a39f136403 => generated 1404 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:18:15.028799 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-32849e2c-038a-40b4-860c-5f9fd077c9f0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:15.029721 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-32849e2c-038a-40b4-860c-5f9fd077c9f0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:15.038281 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-32849e2c-038a-40b4-860c-5f9fd077c9f0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:15.038740 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-32849e2c-038a-40b4-860c-5f9fd077c9f0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:15.039513 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-32849e2c-038a-40b4-860c-5f9fd077c9f0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:15.040103 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-32849e2c-038a-40b4-860c-5f9fd077c9f0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:15.110525 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-72912eb2-6235-40fa-83c4-22e5285be7e3 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:15.111211 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-72912eb2-6235-40fa-83c4-22e5285be7e3 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:15.115126 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-32849e2c-038a-40b4-860c-5f9fd077c9f0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:15.118088 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-72912eb2-6235-40fa-83c4-22e5285be7e3 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:15.118651 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-72912eb2-6235-40fa-83c4-22e5285be7e3 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:15.119570 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-72912eb2-6235-40fa-83c4-22e5285be7e3 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:15.120114 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-72912eb2-6235-40fa-83c4-22e5285be7e3 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:15.123577 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-32849e2c-038a-40b4-860c-5f9fd077c9f0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.100960 May 03 09:18:15.124677 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1050/1933] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:15 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:15.240124 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f0b82848-6f55-4f25-a6eb-82d81f925432 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:15.241005 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f0b82848-6f55-4f25-a6eb-82d81f925432 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: 2dbd7241-ce49-4617-9aad-57a39f136403] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:15.247253 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f0b82848-6f55-4f25-a6eb-82d81f925432 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:15.247808 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f0b82848-6f55-4f25-a6eb-82d81f925432 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:15.248585 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f0b82848-6f55-4f25-a6eb-82d81f925432 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:15.249018 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f0b82848-6f55-4f25-a6eb-82d81f925432 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:15.259082 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-72912eb2-6235-40fa-83c4-22e5285be7e3 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:15.267089 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-72912eb2-6235-40fa-83c4-22e5285be7e3 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.160451 May 03 09:18:15.267675 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 884/1934] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:15 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:18:15.388892 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f0b82848-6f55-4f25-a6eb-82d81f925432 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:15.397343 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f0b82848-6f55-4f25-a6eb-82d81f925432 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:15.398840 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f0b82848-6f55-4f25-a6eb-82d81f925432 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:15.400028 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f0b82848-6f55-4f25-a6eb-82d81f925432 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/2dbd7241-ce49-4617-9aad-57a39f136403" status: 200 len: 1404 microversion: 2.20 time: 0.163879 May 03 09:18:15.400592 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1051/1935] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:18:15 2022] GET /compute/v2.1/servers/2dbd7241-ce49-4617-9aad-57a39f136403 => generated 1404 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 09:18:16.142333 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e2919876-64ca-49d9-a25e-ad3f248383b5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:16.143252 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e2919876-64ca-49d9-a25e-ad3f248383b5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:16.151163 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e2919876-64ca-49d9-a25e-ad3f248383b5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:16.151622 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e2919876-64ca-49d9-a25e-ad3f248383b5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:16.152773 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e2919876-64ca-49d9-a25e-ad3f248383b5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:16.152940 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e2919876-64ca-49d9-a25e-ad3f248383b5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:16.227463 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e2919876-64ca-49d9-a25e-ad3f248383b5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:16.241298 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e2919876-64ca-49d9-a25e-ad3f248383b5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.103071 May 03 09:18:16.242279 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 885/1936] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:16 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:16.284874 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-635d7318-ef4a-45c1-9789-b0f75bbac9bf tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:16.285444 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-635d7318-ef4a-45c1-9789-b0f75bbac9bf tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:16.293748 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-635d7318-ef4a-45c1-9789-b0f75bbac9bf tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:16.294189 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-635d7318-ef4a-45c1-9789-b0f75bbac9bf tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:16.294957 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-635d7318-ef4a-45c1-9789-b0f75bbac9bf tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:16.295608 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-635d7318-ef4a-45c1-9789-b0f75bbac9bf tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:16.421885 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-934a9fa4-111d-4951-8c76-596957ac1dca tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:16.422404 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-934a9fa4-111d-4951-8c76-596957ac1dca tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: 2dbd7241-ce49-4617-9aad-57a39f136403] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:16.428458 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-934a9fa4-111d-4951-8c76-596957ac1dca tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:16.428899 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-934a9fa4-111d-4951-8c76-596957ac1dca tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:16.429663 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-934a9fa4-111d-4951-8c76-596957ac1dca tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:16.430096 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-934a9fa4-111d-4951-8c76-596957ac1dca tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:16.434392 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-635d7318-ef4a-45c1-9789-b0f75bbac9bf tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:16.442542 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-635d7318-ef4a-45c1-9789-b0f75bbac9bf tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.161581 May 03 09:18:16.443138 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1052/1937] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:16 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:16.565550 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-934a9fa4-111d-4951-8c76-596957ac1dca tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:16.573711 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-934a9fa4-111d-4951-8c76-596957ac1dca tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:16.575204 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-934a9fa4-111d-4951-8c76-596957ac1dca tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:16.576427 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-934a9fa4-111d-4951-8c76-596957ac1dca tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/2dbd7241-ce49-4617-9aad-57a39f136403" status: 200 len: 1404 microversion: 2.20 time: 0.158704 May 03 09:18:16.577024 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 886/1938] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:18:16 2022] GET /compute/v2.1/servers/2dbd7241-ce49-4617-9aad-57a39f136403 => generated 1404 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 09:18:16.837443 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [req-a1f22421-706a-4489-8c06-bc5574805274 req-efbd1d55-39c0-4430-92a9-6902c469237e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dbd7241-ce49-4617-9aad-57a39f136403", "name": "network-vif-plugged", "status": "completed", "tag": "3390c222-09ae-4629-b4d7-4e4001985505"}]} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:18:16.845738 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-a1f22421-706a-4489-8c06-bc5574805274 req-efbd1d55-39c0-4430-92a9-6902c469237e service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:16.846176 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-a1f22421-706a-4489-8c06-bc5574805274 req-efbd1d55-39c0-4430-92a9-6902c469237e service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:16.857285 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.compute.server_external_events [req-a1f22421-706a-4489-8c06-bc5574805274 req-efbd1d55-39c0-4430-92a9-6902c469237e service nova] Creating event network-vif-plugged:3390c222-09ae-4629-b4d7-4e4001985505 for instance 2dbd7241-ce49-4617-9aad-57a39f136403 on hv-cinder-84027 May 03 09:18:16.862288 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [req-a1f22421-706a-4489-8c06-bc5574805274 req-efbd1d55-39c0-4430-92a9-6902c469237e service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085560 May 03 09:18:16.862881 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1053/1939] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:18:17.261198 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b9508232-dfd8-4cb4-ad6d-3ed1e2e88621 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:17.261778 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b9508232-dfd8-4cb4-ad6d-3ed1e2e88621 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:17.268652 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b9508232-dfd8-4cb4-ad6d-3ed1e2e88621 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:17.269104 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b9508232-dfd8-4cb4-ad6d-3ed1e2e88621 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:17.269877 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b9508232-dfd8-4cb4-ad6d-3ed1e2e88621 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:17.270314 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b9508232-dfd8-4cb4-ad6d-3ed1e2e88621 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:17.330578 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b9508232-dfd8-4cb4-ad6d-3ed1e2e88621 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:17.339028 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b9508232-dfd8-4cb4-ad6d-3ed1e2e88621 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.081903 May 03 09:18:17.339603 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 887/1940] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:17 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:18:17.461230 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-7653ee01-1fcd-4e0b-926a-98c1bd52262a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:17.461909 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-7653ee01-1fcd-4e0b-926a-98c1bd52262a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:17.469025 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7653ee01-1fcd-4e0b-926a-98c1bd52262a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:17.469474 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7653ee01-1fcd-4e0b-926a-98c1bd52262a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:17.470243 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7653ee01-1fcd-4e0b-926a-98c1bd52262a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:17.471172 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7653ee01-1fcd-4e0b-926a-98c1bd52262a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:17.595029 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-20634bf2-5d68-4884-8c0f-7a3531ba9b49 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:17.595561 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-20634bf2-5d68-4884-8c0f-7a3531ba9b49 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: 2dbd7241-ce49-4617-9aad-57a39f136403] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:17.601515 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-20634bf2-5d68-4884-8c0f-7a3531ba9b49 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:17.601964 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-20634bf2-5d68-4884-8c0f-7a3531ba9b49 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:17.602787 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-20634bf2-5d68-4884-8c0f-7a3531ba9b49 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:17.602931 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7653ee01-1fcd-4e0b-926a-98c1bd52262a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:17.603221 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-20634bf2-5d68-4884-8c0f-7a3531ba9b49 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:17.610938 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-7653ee01-1fcd-4e0b-926a-98c1bd52262a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.154404 May 03 09:18:17.611516 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1054/1941] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:17 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:17.764320 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-20634bf2-5d68-4884-8c0f-7a3531ba9b49 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:17.774428 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-20634bf2-5d68-4884-8c0f-7a3531ba9b49 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:17.775962 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-20634bf2-5d68-4884-8c0f-7a3531ba9b49 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:17.777083 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-20634bf2-5d68-4884-8c0f-7a3531ba9b49 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/2dbd7241-ce49-4617-9aad-57a39f136403" status: 200 len: 1404 microversion: 2.20 time: 0.186517 May 03 09:18:17.777628 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 888/1942] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:18:17 2022] GET /compute/v2.1/servers/2dbd7241-ce49-4617-9aad-57a39f136403 => generated 1404 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 09:18:18.357108 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-173fdef1-5c70-4f99-b95c-164d708ca0d1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:18.357752 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-173fdef1-5c70-4f99-b95c-164d708ca0d1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:18.364462 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-173fdef1-5c70-4f99-b95c-164d708ca0d1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:18.364932 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-173fdef1-5c70-4f99-b95c-164d708ca0d1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:18.365715 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-173fdef1-5c70-4f99-b95c-164d708ca0d1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:18.366173 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-173fdef1-5c70-4f99-b95c-164d708ca0d1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:18.440136 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-173fdef1-5c70-4f99-b95c-164d708ca0d1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:18.451617 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-173fdef1-5c70-4f99-b95c-164d708ca0d1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.098399 May 03 09:18:18.452371 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1055/1943] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:18 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:18.627781 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-65ae58b4-06f8-4ac8-9870-ef8bd96115c3 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:18.628413 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-65ae58b4-06f8-4ac8-9870-ef8bd96115c3 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:18.634932 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-65ae58b4-06f8-4ac8-9870-ef8bd96115c3 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:18.635375 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-65ae58b4-06f8-4ac8-9870-ef8bd96115c3 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:18.636169 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-65ae58b4-06f8-4ac8-9870-ef8bd96115c3 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:18.636601 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-65ae58b4-06f8-4ac8-9870-ef8bd96115c3 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:18.776917 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-65ae58b4-06f8-4ac8-9870-ef8bd96115c3 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:18.785773 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-65ae58b4-06f8-4ac8-9870-ef8bd96115c3 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.161808 May 03 09:18:18.786381 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 889/1944] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:18 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:18.796348 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d7300a12-6426-4046-a5f7-8da56534897c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:18.797132 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d7300a12-6426-4046-a5f7-8da56534897c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: 2dbd7241-ce49-4617-9aad-57a39f136403] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:18.805268 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d7300a12-6426-4046-a5f7-8da56534897c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:18.805751 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d7300a12-6426-4046-a5f7-8da56534897c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:18.806598 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d7300a12-6426-4046-a5f7-8da56534897c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:18.807040 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d7300a12-6426-4046-a5f7-8da56534897c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:18.954917 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d7300a12-6426-4046-a5f7-8da56534897c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:18.965856 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d7300a12-6426-4046-a5f7-8da56534897c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:18.968010 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d7300a12-6426-4046-a5f7-8da56534897c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:18.969715 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d7300a12-6426-4046-a5f7-8da56534897c tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/2dbd7241-ce49-4617-9aad-57a39f136403" status: 200 len: 1597 microversion: 2.20 time: 0.177844 May 03 09:18:18.970561 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1056/1945] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:18:18 2022] GET /compute/v2.1/servers/2dbd7241-ce49-4617-9aad-57a39f136403 => generated 1597 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:18:18.990170 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-519ee7fe-3250-44bf-a0d8-30635cb2a4d8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:18.990667 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-519ee7fe-3250-44bf-a0d8-30635cb2a4d8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: 2dbd7241-ce49-4617-9aad-57a39f136403] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:18.997379 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-519ee7fe-3250-44bf-a0d8-30635cb2a4d8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:18.997831 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-519ee7fe-3250-44bf-a0d8-30635cb2a4d8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:18.998604 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-519ee7fe-3250-44bf-a0d8-30635cb2a4d8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:18.999041 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-519ee7fe-3250-44bf-a0d8-30635cb2a4d8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:19.074189 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-519ee7fe-3250-44bf-a0d8-30635cb2a4d8 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/2dbd7241-ce49-4617-9aad-57a39f136403/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.087947 May 03 09:18:19.074798 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 890/1946] 10.222.0.11 () {60 vars in 1315 bytes} [Tue May 3 09:18:18 2022] GET /compute/v2.1/servers/2dbd7241-ce49-4617-9aad-57a39f136403/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:18:19.471405 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f49c913d-7eb9-4864-973e-73fa8236d300 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:19.471989 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f49c913d-7eb9-4864-973e-73fa8236d300 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:19.478580 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f49c913d-7eb9-4864-973e-73fa8236d300 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:19.479036 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f49c913d-7eb9-4864-973e-73fa8236d300 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:19.480009 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f49c913d-7eb9-4864-973e-73fa8236d300 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:19.480303 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f49c913d-7eb9-4864-973e-73fa8236d300 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:19.762451 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f49c913d-7eb9-4864-973e-73fa8236d300 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:19.770347 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f49c913d-7eb9-4864-973e-73fa8236d300 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.302915 May 03 09:18:19.771114 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1057/1947] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:19 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:19.804415 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-1a96ae31-3aa3-4c2c-ac60-740dc06989d7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:19.805699 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-1a96ae31-3aa3-4c2c-ac60-740dc06989d7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:19.813010 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1a96ae31-3aa3-4c2c-ac60-740dc06989d7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:19.813578 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1a96ae31-3aa3-4c2c-ac60-740dc06989d7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:19.814339 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1a96ae31-3aa3-4c2c-ac60-740dc06989d7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:19.814778 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1a96ae31-3aa3-4c2c-ac60-740dc06989d7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:20.026657 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-1a96ae31-3aa3-4c2c-ac60-740dc06989d7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:20.035093 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-1a96ae31-3aa3-4c2c-ac60-740dc06989d7 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.235175 May 03 09:18:20.035939 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 891/1948] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:19 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:20.421498 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [req-d40cac67-0a8b-4af0-ae18-9f9a54384540 req-541bd470-2346-42a4-9da0-b47f82392ed9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dbd7241-ce49-4617-9aad-57a39f136403", "tag": "3390c222-09ae-4629-b4d7-4e4001985505"}]} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:18:20.438570 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-d40cac67-0a8b-4af0-ae18-9f9a54384540 req-541bd470-2346-42a4-9da0-b47f82392ed9 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:20.439143 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-d40cac67-0a8b-4af0-ae18-9f9a54384540 req-541bd470-2346-42a4-9da0-b47f82392ed9 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:20.455049 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.compute.server_external_events [req-d40cac67-0a8b-4af0-ae18-9f9a54384540 req-541bd470-2346-42a4-9da0-b47f82392ed9 service nova] Creating event network-changed:3390c222-09ae-4629-b4d7-4e4001985505 for instance 2dbd7241-ce49-4617-9aad-57a39f136403 on hv-cinder-84027 May 03 09:18:20.461824 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [req-d40cac67-0a8b-4af0-ae18-9f9a54384540 req-541bd470-2346-42a4-9da0-b47f82392ed9 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047979 May 03 09:18:20.462560 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1058/1949] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 09:18:20.790984 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d6da9f7d-45a3-466e-943f-77307bf3ea23 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:20.792070 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d6da9f7d-45a3-466e-943f-77307bf3ea23 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:20.800786 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d6da9f7d-45a3-466e-943f-77307bf3ea23 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:20.801419 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d6da9f7d-45a3-466e-943f-77307bf3ea23 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:20.802483 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d6da9f7d-45a3-466e-943f-77307bf3ea23 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:20.803088 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d6da9f7d-45a3-466e-943f-77307bf3ea23 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:20.892421 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d6da9f7d-45a3-466e-943f-77307bf3ea23 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:20.902161 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d6da9f7d-45a3-466e-943f-77307bf3ea23 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.117257 May 03 09:18:20.902874 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 892/1950] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:20 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:21.055869 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-035d6d42-de34-4fe7-a821-094169bd33a5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:21.056898 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-035d6d42-de34-4fe7-a821-094169bd33a5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:21.065512 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-035d6d42-de34-4fe7-a821-094169bd33a5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:21.066153 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-035d6d42-de34-4fe7-a821-094169bd33a5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:21.067821 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-035d6d42-de34-4fe7-a821-094169bd33a5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:21.068437 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-035d6d42-de34-4fe7-a821-094169bd33a5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:21.233542 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-035d6d42-de34-4fe7-a821-094169bd33a5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:21.241521 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-035d6d42-de34-4fe7-a821-094169bd33a5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.191735 May 03 09:18:21.242092 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1059/1951] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:21 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:18:21.921993 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7007dc8f-393a-4583-b672-36afbb9fd892 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:21.922631 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7007dc8f-393a-4583-b672-36afbb9fd892 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:21.930364 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7007dc8f-393a-4583-b672-36afbb9fd892 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:21.930848 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7007dc8f-393a-4583-b672-36afbb9fd892 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:21.931598 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7007dc8f-393a-4583-b672-36afbb9fd892 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:21.932046 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7007dc8f-393a-4583-b672-36afbb9fd892 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:22.000447 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7007dc8f-393a-4583-b672-36afbb9fd892 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:22.010475 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7007dc8f-393a-4583-b672-36afbb9fd892 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.092585 May 03 09:18:22.011059 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 893/1952] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:21 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:22.261757 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c4ce5577-3f9b-433b-acd4-b7747c96482d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:22.262507 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c4ce5577-3f9b-433b-acd4-b7747c96482d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:22.269449 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c4ce5577-3f9b-433b-acd4-b7747c96482d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:22.269952 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c4ce5577-3f9b-433b-acd4-b7747c96482d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:22.270761 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c4ce5577-3f9b-433b-acd4-b7747c96482d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:22.271214 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c4ce5577-3f9b-433b-acd4-b7747c96482d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:22.422543 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c4ce5577-3f9b-433b-acd4-b7747c96482d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:22.433696 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c4ce5577-3f9b-433b-acd4-b7747c96482d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.176569 May 03 09:18:22.434264 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1060/1953] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:22 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:23.028258 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-25f30682-252f-4c06-9bed-f1f731d103f1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:23.028972 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-25f30682-252f-4c06-9bed-f1f731d103f1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:23.040204 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-25f30682-252f-4c06-9bed-f1f731d103f1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:23.040649 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-25f30682-252f-4c06-9bed-f1f731d103f1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:23.041658 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-25f30682-252f-4c06-9bed-f1f731d103f1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:23.042088 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-25f30682-252f-4c06-9bed-f1f731d103f1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:23.130259 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-25f30682-252f-4c06-9bed-f1f731d103f1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:23.141076 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-25f30682-252f-4c06-9bed-f1f731d103f1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.117166 May 03 09:18:23.141907 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 894/1954] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:23 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:23.451310 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-227b869b-5839-4379-9c6b-049e2cd9b8ed tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:23.451994 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-227b869b-5839-4379-9c6b-049e2cd9b8ed tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:23.460268 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-227b869b-5839-4379-9c6b-049e2cd9b8ed tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:23.460756 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-227b869b-5839-4379-9c6b-049e2cd9b8ed tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:23.461617 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-227b869b-5839-4379-9c6b-049e2cd9b8ed tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:23.462057 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-227b869b-5839-4379-9c6b-049e2cd9b8ed tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:23.634246 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-227b869b-5839-4379-9c6b-049e2cd9b8ed tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:23.642597 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-227b869b-5839-4379-9c6b-049e2cd9b8ed tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.195243 May 03 09:18:23.643203 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1061/1955] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:23 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:24.162977 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-827d8ea8-b3ec-4927-9f00-c9979e8a84e9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:24.163991 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-827d8ea8-b3ec-4927-9f00-c9979e8a84e9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:24.174259 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-827d8ea8-b3ec-4927-9f00-c9979e8a84e9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:24.174995 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-827d8ea8-b3ec-4927-9f00-c9979e8a84e9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:24.176310 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-827d8ea8-b3ec-4927-9f00-c9979e8a84e9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:24.177021 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-827d8ea8-b3ec-4927-9f00-c9979e8a84e9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:24.251825 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-827d8ea8-b3ec-4927-9f00-c9979e8a84e9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:24.260512 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-827d8ea8-b3ec-4927-9f00-c9979e8a84e9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.104380 May 03 09:18:24.261102 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 895/1956] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:24 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:24.661922 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-291f9db3-aaaf-459b-966a-6ed2371922bd tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:24.662614 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-291f9db3-aaaf-459b-966a-6ed2371922bd tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:24.670796 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-291f9db3-aaaf-459b-966a-6ed2371922bd tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:24.671370 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-291f9db3-aaaf-459b-966a-6ed2371922bd tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:24.672374 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-291f9db3-aaaf-459b-966a-6ed2371922bd tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:24.672904 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-291f9db3-aaaf-459b-966a-6ed2371922bd tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:24.811223 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-291f9db3-aaaf-459b-966a-6ed2371922bd tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:24.819482 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-291f9db3-aaaf-459b-966a-6ed2371922bd tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.162521 May 03 09:18:24.820089 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1062/1957] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:24 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:25.279013 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-80ab0716-1515-4200-a55f-390ef2d82b7b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:25.279652 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-80ab0716-1515-4200-a55f-390ef2d82b7b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:25.286430 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-80ab0716-1515-4200-a55f-390ef2d82b7b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:25.286873 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-80ab0716-1515-4200-a55f-390ef2d82b7b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:25.287636 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-80ab0716-1515-4200-a55f-390ef2d82b7b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:25.288103 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-80ab0716-1515-4200-a55f-390ef2d82b7b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:25.354278 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-80ab0716-1515-4200-a55f-390ef2d82b7b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:25.362164 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-80ab0716-1515-4200-a55f-390ef2d82b7b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.088329 May 03 09:18:25.362731 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 896/1958] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:25 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:25.837705 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e9d06265-94f5-4f7e-bc3f-25e3975ec401 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:25.838342 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e9d06265-94f5-4f7e-bc3f-25e3975ec401 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:25.845006 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e9d06265-94f5-4f7e-bc3f-25e3975ec401 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:25.845460 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e9d06265-94f5-4f7e-bc3f-25e3975ec401 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:25.846227 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e9d06265-94f5-4f7e-bc3f-25e3975ec401 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:25.846642 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e9d06265-94f5-4f7e-bc3f-25e3975ec401 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:25.983437 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e9d06265-94f5-4f7e-bc3f-25e3975ec401 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:25.992148 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e9d06265-94f5-4f7e-bc3f-25e3975ec401 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.158371 May 03 09:18:25.992816 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1063/1959] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:25 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:26.381964 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-cd81a6c6-ff4d-46ec-90ad-2d792c2420b2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:26.382582 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-cd81a6c6-ff4d-46ec-90ad-2d792c2420b2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:26.389314 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cd81a6c6-ff4d-46ec-90ad-2d792c2420b2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:26.389764 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cd81a6c6-ff4d-46ec-90ad-2d792c2420b2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:26.390530 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cd81a6c6-ff4d-46ec-90ad-2d792c2420b2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:26.390962 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cd81a6c6-ff4d-46ec-90ad-2d792c2420b2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:26.464805 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-cd81a6c6-ff4d-46ec-90ad-2d792c2420b2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:26.477188 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-cd81a6c6-ff4d-46ec-90ad-2d792c2420b2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.100621 May 03 09:18:26.478076 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 897/1960] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:26 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:27.009470 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-146cc279-7959-4115-b9b3-f8dd36f4ac53 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:27.010103 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-146cc279-7959-4115-b9b3-f8dd36f4ac53 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:27.016642 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-146cc279-7959-4115-b9b3-f8dd36f4ac53 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:27.017087 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-146cc279-7959-4115-b9b3-f8dd36f4ac53 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:27.017855 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-146cc279-7959-4115-b9b3-f8dd36f4ac53 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:27.018285 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-146cc279-7959-4115-b9b3-f8dd36f4ac53 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:27.164417 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-146cc279-7959-4115-b9b3-f8dd36f4ac53 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:27.174186 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-146cc279-7959-4115-b9b3-f8dd36f4ac53 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.168734 May 03 09:18:27.174822 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1064/1961] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:27 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:27.496298 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-766ee512-8f67-4479-be07-7b1c9cd7e999 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:27.497087 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-766ee512-8f67-4479-be07-7b1c9cd7e999 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:27.505543 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-766ee512-8f67-4479-be07-7b1c9cd7e999 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:27.506263 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-766ee512-8f67-4479-be07-7b1c9cd7e999 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:27.507533 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-766ee512-8f67-4479-be07-7b1c9cd7e999 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:27.508341 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-766ee512-8f67-4479-be07-7b1c9cd7e999 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:27.590679 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-766ee512-8f67-4479-be07-7b1c9cd7e999 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:27.601166 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-766ee512-8f67-4479-be07-7b1c9cd7e999 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.110044 May 03 09:18:27.601757 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 898/1962] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:27 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:18:28.196659 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d95c18a0-80ce-4e04-8710-04dc840ee919 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:28.197553 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d95c18a0-80ce-4e04-8710-04dc840ee919 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:28.204609 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d95c18a0-80ce-4e04-8710-04dc840ee919 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:28.205066 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d95c18a0-80ce-4e04-8710-04dc840ee919 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:28.205937 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d95c18a0-80ce-4e04-8710-04dc840ee919 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:28.206384 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d95c18a0-80ce-4e04-8710-04dc840ee919 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:28.359379 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d95c18a0-80ce-4e04-8710-04dc840ee919 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:28.368326 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d95c18a0-80ce-4e04-8710-04dc840ee919 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.176035 May 03 09:18:28.368911 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1065/1963] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:28 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:28.619031 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-daad3971-57d4-4bd7-ad0b-a1ac5e1e246b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:28.619698 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-daad3971-57d4-4bd7-ad0b-a1ac5e1e246b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:28.626698 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-daad3971-57d4-4bd7-ad0b-a1ac5e1e246b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:28.627147 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-daad3971-57d4-4bd7-ad0b-a1ac5e1e246b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:28.627961 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-daad3971-57d4-4bd7-ad0b-a1ac5e1e246b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:28.628395 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-daad3971-57d4-4bd7-ad0b-a1ac5e1e246b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:28.700712 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-daad3971-57d4-4bd7-ad0b-a1ac5e1e246b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:28.708886 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-daad3971-57d4-4bd7-ad0b-a1ac5e1e246b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.093861 May 03 09:18:28.709435 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 899/1964] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:28 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:29.386142 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-187adf8b-f70b-44c1-989e-2a00f38d1d23 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:29.386820 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-187adf8b-f70b-44c1-989e-2a00f38d1d23 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:29.393624 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-187adf8b-f70b-44c1-989e-2a00f38d1d23 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:29.394099 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-187adf8b-f70b-44c1-989e-2a00f38d1d23 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:29.394886 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-187adf8b-f70b-44c1-989e-2a00f38d1d23 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:29.395318 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-187adf8b-f70b-44c1-989e-2a00f38d1d23 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:29.546832 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-187adf8b-f70b-44c1-989e-2a00f38d1d23 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:29.555603 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-187adf8b-f70b-44c1-989e-2a00f38d1d23 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.173459 May 03 09:18:29.556249 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1066/1965] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:29 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:29.726450 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b877db5e-9c30-4a0d-a9f4-388a5e916ec9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:29.727099 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b877db5e-9c30-4a0d-a9f4-388a5e916ec9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:29.734057 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b877db5e-9c30-4a0d-a9f4-388a5e916ec9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:29.734499 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b877db5e-9c30-4a0d-a9f4-388a5e916ec9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:29.735302 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b877db5e-9c30-4a0d-a9f4-388a5e916ec9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:29.735735 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b877db5e-9c30-4a0d-a9f4-388a5e916ec9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:29.814258 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b877db5e-9c30-4a0d-a9f4-388a5e916ec9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:29.827294 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b877db5e-9c30-4a0d-a9f4-388a5e916ec9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.104506 May 03 09:18:29.828231 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 900/1966] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:29 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:30.580201 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-cb8b7303-fded-48f4-be58-17b14f92ceae tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:30.580766 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-cb8b7303-fded-48f4-be58-17b14f92ceae tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:30.587805 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cb8b7303-fded-48f4-be58-17b14f92ceae tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:30.588271 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cb8b7303-fded-48f4-be58-17b14f92ceae tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:30.589057 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cb8b7303-fded-48f4-be58-17b14f92ceae tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:30.589495 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cb8b7303-fded-48f4-be58-17b14f92ceae tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:30.724654 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-cb8b7303-fded-48f4-be58-17b14f92ceae tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:30.738651 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-cb8b7303-fded-48f4-be58-17b14f92ceae tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.162395 May 03 09:18:30.739260 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1067/1967] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:30 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:30.853041 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-8bdeff6b-a9b1-4152-b1b3-58a6725af3c2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:30.853611 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-8bdeff6b-a9b1-4152-b1b3-58a6725af3c2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:30.860590 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8bdeff6b-a9b1-4152-b1b3-58a6725af3c2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:30.861027 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8bdeff6b-a9b1-4152-b1b3-58a6725af3c2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:30.861980 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8bdeff6b-a9b1-4152-b1b3-58a6725af3c2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:30.862473 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8bdeff6b-a9b1-4152-b1b3-58a6725af3c2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:30.925509 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-8bdeff6b-a9b1-4152-b1b3-58a6725af3c2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:30.934123 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-8bdeff6b-a9b1-4152-b1b3-58a6725af3c2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.087784 May 03 09:18:30.934692 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 901/1968] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:30 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:31.757386 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-7aaa8c10-197d-4893-b0cc-abb7fb1a21ec tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:31.758012 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-7aaa8c10-197d-4893-b0cc-abb7fb1a21ec tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:31.764938 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7aaa8c10-197d-4893-b0cc-abb7fb1a21ec tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:31.765393 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7aaa8c10-197d-4893-b0cc-abb7fb1a21ec tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:31.766163 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7aaa8c10-197d-4893-b0cc-abb7fb1a21ec tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:31.766599 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7aaa8c10-197d-4893-b0cc-abb7fb1a21ec tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:31.905908 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7aaa8c10-197d-4893-b0cc-abb7fb1a21ec tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:31.914989 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-7aaa8c10-197d-4893-b0cc-abb7fb1a21ec tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.161474 May 03 09:18:31.915579 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1068/1969] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:31 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:31.951374 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4f73abd3-828c-41f8-a4ae-b3651af62414 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:31.952329 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4f73abd3-828c-41f8-a4ae-b3651af62414 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:31.959139 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4f73abd3-828c-41f8-a4ae-b3651af62414 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:31.959596 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4f73abd3-828c-41f8-a4ae-b3651af62414 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:31.960437 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4f73abd3-828c-41f8-a4ae-b3651af62414 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:31.960879 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4f73abd3-828c-41f8-a4ae-b3651af62414 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:32.027169 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-4f73abd3-828c-41f8-a4ae-b3651af62414 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:32.046926 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-4f73abd3-828c-41f8-a4ae-b3651af62414 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.098799 May 03 09:18:32.047501 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 902/1970] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:31 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:32.942770 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-022a7086-8fb6-4f35-a5f2-e21d60efb47d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:32.943754 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-022a7086-8fb6-4f35-a5f2-e21d60efb47d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:32.954383 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-022a7086-8fb6-4f35-a5f2-e21d60efb47d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:32.955115 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-022a7086-8fb6-4f35-a5f2-e21d60efb47d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:32.956542 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-022a7086-8fb6-4f35-a5f2-e21d60efb47d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:32.957271 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-022a7086-8fb6-4f35-a5f2-e21d60efb47d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:33.068559 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-aebe6a55-0311-4b95-87ce-5d82a95a5fe5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:33.069165 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-aebe6a55-0311-4b95-87ce-5d82a95a5fe5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:33.075927 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aebe6a55-0311-4b95-87ce-5d82a95a5fe5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:33.076387 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aebe6a55-0311-4b95-87ce-5d82a95a5fe5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:33.077156 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aebe6a55-0311-4b95-87ce-5d82a95a5fe5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:33.077594 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aebe6a55-0311-4b95-87ce-5d82a95a5fe5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:33.089624 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-022a7086-8fb6-4f35-a5f2-e21d60efb47d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:33.097850 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-022a7086-8fb6-4f35-a5f2-e21d60efb47d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.161880 May 03 09:18:33.098415 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1069/1971] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:32 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:33.141972 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-aebe6a55-0311-4b95-87ce-5d82a95a5fe5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:33.149924 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-aebe6a55-0311-4b95-87ce-5d82a95a5fe5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.085533 May 03 09:18:33.150506 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 903/1972] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:33 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:34.119120 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e4d56f4e-720f-432a-bb43-fcc27233d593 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:34.119670 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e4d56f4e-720f-432a-bb43-fcc27233d593 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:34.126445 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e4d56f4e-720f-432a-bb43-fcc27233d593 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:34.126893 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e4d56f4e-720f-432a-bb43-fcc27233d593 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:34.127642 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e4d56f4e-720f-432a-bb43-fcc27233d593 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:34.128111 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e4d56f4e-720f-432a-bb43-fcc27233d593 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:34.167103 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-177d172b-6bae-4d88-a050-b483b92d76b2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:34.167709 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-177d172b-6bae-4d88-a050-b483b92d76b2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:34.174902 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-177d172b-6bae-4d88-a050-b483b92d76b2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:34.175359 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-177d172b-6bae-4d88-a050-b483b92d76b2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:34.176184 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-177d172b-6bae-4d88-a050-b483b92d76b2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:34.176620 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-177d172b-6bae-4d88-a050-b483b92d76b2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:34.248043 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-177d172b-6bae-4d88-a050-b483b92d76b2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:34.256295 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-177d172b-6bae-4d88-a050-b483b92d76b2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.093164 May 03 09:18:34.256874 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 904/1973] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:34 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:34.282806 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e4d56f4e-720f-432a-bb43-fcc27233d593 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:34.290830 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e4d56f4e-720f-432a-bb43-fcc27233d593 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.177928 May 03 09:18:34.291434 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1070/1974] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:34 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:35.273340 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-140a706c-2485-45a0-95ae-c2b7759c8894 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:35.274104 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-140a706c-2485-45a0-95ae-c2b7759c8894 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:35.280877 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-140a706c-2485-45a0-95ae-c2b7759c8894 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:35.281320 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-140a706c-2485-45a0-95ae-c2b7759c8894 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:35.282080 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-140a706c-2485-45a0-95ae-c2b7759c8894 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:35.282508 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-140a706c-2485-45a0-95ae-c2b7759c8894 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:35.308288 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e2657a93-ce61-4ca2-a66c-140cb0057e5e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:35.308897 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e2657a93-ce61-4ca2-a66c-140cb0057e5e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:35.315813 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e2657a93-ce61-4ca2-a66c-140cb0057e5e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:35.316301 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e2657a93-ce61-4ca2-a66c-140cb0057e5e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:35.317069 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e2657a93-ce61-4ca2-a66c-140cb0057e5e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:35.317505 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e2657a93-ce61-4ca2-a66c-140cb0057e5e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:35.346551 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-140a706c-2485-45a0-95ae-c2b7759c8894 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:35.361886 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-140a706c-2485-45a0-95ae-c2b7759c8894 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.092398 May 03 09:18:35.362500 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 905/1975] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:35 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:35.467816 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e2657a93-ce61-4ca2-a66c-140cb0057e5e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:35.476285 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e2657a93-ce61-4ca2-a66c-140cb0057e5e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.171960 May 03 09:18:35.476844 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1071/1976] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:35 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:36.378861 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ae1596dc-672b-47ff-806a-2cc57e0c3acc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:36.379512 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ae1596dc-672b-47ff-806a-2cc57e0c3acc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:36.386277 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ae1596dc-672b-47ff-806a-2cc57e0c3acc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:36.386731 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ae1596dc-672b-47ff-806a-2cc57e0c3acc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:36.387489 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ae1596dc-672b-47ff-806a-2cc57e0c3acc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:36.387994 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ae1596dc-672b-47ff-806a-2cc57e0c3acc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:36.465861 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ae1596dc-672b-47ff-806a-2cc57e0c3acc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:36.478779 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ae1596dc-672b-47ff-806a-2cc57e0c3acc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.103633 May 03 09:18:36.479819 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 906/1977] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:36 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:36.496084 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-1e082678-2732-4797-ae9d-2c28b4560cf4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:36.496772 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-1e082678-2732-4797-ae9d-2c28b4560cf4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:36.505957 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1e082678-2732-4797-ae9d-2c28b4560cf4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:36.506457 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1e082678-2732-4797-ae9d-2c28b4560cf4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:36.507601 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1e082678-2732-4797-ae9d-2c28b4560cf4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:36.508381 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1e082678-2732-4797-ae9d-2c28b4560cf4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:36.653644 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-1e082678-2732-4797-ae9d-2c28b4560cf4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:36.663319 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-1e082678-2732-4797-ae9d-2c28b4560cf4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.173067 May 03 09:18:36.663923 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1072/1978] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:36 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:37.498691 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-211f7b56-53d4-4bb0-bd2b-873a1cacd41f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:37.499223 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-211f7b56-53d4-4bb0-bd2b-873a1cacd41f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:37.506003 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-211f7b56-53d4-4bb0-bd2b-873a1cacd41f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:37.506447 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-211f7b56-53d4-4bb0-bd2b-873a1cacd41f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:37.507237 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-211f7b56-53d4-4bb0-bd2b-873a1cacd41f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:37.507664 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-211f7b56-53d4-4bb0-bd2b-873a1cacd41f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:37.570915 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-211f7b56-53d4-4bb0-bd2b-873a1cacd41f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:37.579400 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-211f7b56-53d4-4bb0-bd2b-873a1cacd41f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.084800 May 03 09:18:37.580001 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 907/1979] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:37 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:37.680362 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-8330b41d-4fe0-4f97-b94e-8438a065bfdf tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:37.680945 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-8330b41d-4fe0-4f97-b94e-8438a065bfdf tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:37.687799 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8330b41d-4fe0-4f97-b94e-8438a065bfdf tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:37.688244 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8330b41d-4fe0-4f97-b94e-8438a065bfdf tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:37.688999 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8330b41d-4fe0-4f97-b94e-8438a065bfdf tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:37.689429 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8330b41d-4fe0-4f97-b94e-8438a065bfdf tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:37.818980 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-8330b41d-4fe0-4f97-b94e-8438a065bfdf tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:37.827450 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-8330b41d-4fe0-4f97-b94e-8438a065bfdf tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.150966 May 03 09:18:37.828036 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1073/1980] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:37 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:38.422612 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 09:18:38.422912 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: Tue May 3 09:18:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 03 09:18:38.598555 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-492886e9-2c99-433f-bc63-d5ae3b608631 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:38.600595 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-492886e9-2c99-433f-bc63-d5ae3b608631 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:38.608414 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-492886e9-2c99-433f-bc63-d5ae3b608631 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:38.608982 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-492886e9-2c99-433f-bc63-d5ae3b608631 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:38.609965 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-492886e9-2c99-433f-bc63-d5ae3b608631 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:38.611134 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-492886e9-2c99-433f-bc63-d5ae3b608631 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:38.689629 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-492886e9-2c99-433f-bc63-d5ae3b608631 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:38.705256 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-492886e9-2c99-433f-bc63-d5ae3b608631 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.111399 May 03 09:18:38.706257 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 908/1981] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:38 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:38.844648 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-420d5fba-cc38-4777-8828-5dc480108d20 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:38.845253 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-420d5fba-cc38-4777-8828-5dc480108d20 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:38.854421 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-420d5fba-cc38-4777-8828-5dc480108d20 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:38.855082 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-420d5fba-cc38-4777-8828-5dc480108d20 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:38.856355 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-420d5fba-cc38-4777-8828-5dc480108d20 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:38.857125 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-420d5fba-cc38-4777-8828-5dc480108d20 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:39.035892 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-420d5fba-cc38-4777-8828-5dc480108d20 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:39.044699 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-420d5fba-cc38-4777-8828-5dc480108d20 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.204181 May 03 09:18:39.045258 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1074/1982] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:38 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:39.722967 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a33998f9-6613-49da-9840-efab7fd3075c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:39.723601 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a33998f9-6613-49da-9840-efab7fd3075c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:39.730295 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a33998f9-6613-49da-9840-efab7fd3075c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:39.730743 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a33998f9-6613-49da-9840-efab7fd3075c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:39.731511 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a33998f9-6613-49da-9840-efab7fd3075c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:39.731981 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a33998f9-6613-49da-9840-efab7fd3075c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:39.797991 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a33998f9-6613-49da-9840-efab7fd3075c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:39.808280 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a33998f9-6613-49da-9840-efab7fd3075c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.089248 May 03 09:18:39.808870 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 909/1983] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:39 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:40.063662 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b447e050-5085-42a8-94eb-aacfc2907117 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:40.064313 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b447e050-5085-42a8-94eb-aacfc2907117 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:40.071033 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b447e050-5085-42a8-94eb-aacfc2907117 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:40.071481 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b447e050-5085-42a8-94eb-aacfc2907117 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:40.072291 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b447e050-5085-42a8-94eb-aacfc2907117 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:40.072799 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b447e050-5085-42a8-94eb-aacfc2907117 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:40.217838 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b447e050-5085-42a8-94eb-aacfc2907117 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:40.225928 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b447e050-5085-42a8-94eb-aacfc2907117 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.166986 May 03 09:18:40.226497 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1075/1984] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:40 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:40.826539 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-58e592e7-f04f-47e3-97ce-8c3e38f756a0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:40.827242 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-58e592e7-f04f-47e3-97ce-8c3e38f756a0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:40.833840 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-58e592e7-f04f-47e3-97ce-8c3e38f756a0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:40.834297 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-58e592e7-f04f-47e3-97ce-8c3e38f756a0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:40.835266 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-58e592e7-f04f-47e3-97ce-8c3e38f756a0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:40.835711 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-58e592e7-f04f-47e3-97ce-8c3e38f756a0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:40.901026 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-58e592e7-f04f-47e3-97ce-8c3e38f756a0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:40.909088 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-58e592e7-f04f-47e3-97ce-8c3e38f756a0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.086779 May 03 09:18:40.909660 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 910/1985] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:40 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:41.245590 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-96a45c8e-ae30-4dc1-9453-dee7892b7372 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:41.246363 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-96a45c8e-ae30-4dc1-9453-dee7892b7372 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:41.256295 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-96a45c8e-ae30-4dc1-9453-dee7892b7372 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:41.256858 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-96a45c8e-ae30-4dc1-9453-dee7892b7372 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:41.258038 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-96a45c8e-ae30-4dc1-9453-dee7892b7372 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:41.258657 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-96a45c8e-ae30-4dc1-9453-dee7892b7372 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:41.396221 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-96a45c8e-ae30-4dc1-9453-dee7892b7372 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:41.405413 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-96a45c8e-ae30-4dc1-9453-dee7892b7372 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.166028 May 03 09:18:41.406069 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1076/1986] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:41 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:41.926296 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a0758578-b059-47cc-ae5c-f58f67860955 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:41.926906 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a0758578-b059-47cc-ae5c-f58f67860955 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:41.933842 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a0758578-b059-47cc-ae5c-f58f67860955 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:41.934290 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a0758578-b059-47cc-ae5c-f58f67860955 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:41.935057 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a0758578-b059-47cc-ae5c-f58f67860955 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:41.935492 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a0758578-b059-47cc-ae5c-f58f67860955 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:42.005270 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a0758578-b059-47cc-ae5c-f58f67860955 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:42.016257 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a0758578-b059-47cc-ae5c-f58f67860955 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.093782 May 03 09:18:42.016817 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 911/1987] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:41 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:42.423599 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d0f56d56-9003-4668-8c03-6f4d48ccaab5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:42.424360 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d0f56d56-9003-4668-8c03-6f4d48ccaab5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:42.431026 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d0f56d56-9003-4668-8c03-6f4d48ccaab5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:42.431461 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d0f56d56-9003-4668-8c03-6f4d48ccaab5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:42.432442 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d0f56d56-9003-4668-8c03-6f4d48ccaab5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:42.432873 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d0f56d56-9003-4668-8c03-6f4d48ccaab5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:42.573846 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d0f56d56-9003-4668-8c03-6f4d48ccaab5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:42.585446 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d0f56d56-9003-4668-8c03-6f4d48ccaab5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.165713 May 03 09:18:42.586007 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1077/1988] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:42 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:43.035990 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ffd68304-f01b-4bb5-a63b-ce1a07b45d39 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:43.036623 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ffd68304-f01b-4bb5-a63b-ce1a07b45d39 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:43.043503 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ffd68304-f01b-4bb5-a63b-ce1a07b45d39 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:43.043984 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ffd68304-f01b-4bb5-a63b-ce1a07b45d39 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:43.044761 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ffd68304-f01b-4bb5-a63b-ce1a07b45d39 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:43.045204 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ffd68304-f01b-4bb5-a63b-ce1a07b45d39 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:43.109300 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ffd68304-f01b-4bb5-a63b-ce1a07b45d39 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:43.117818 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ffd68304-f01b-4bb5-a63b-ce1a07b45d39 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.086931 May 03 09:18:43.118392 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 912/1989] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:43 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:43.606871 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a24eabaf-c935-47dc-87de-943b69033688 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:43.607521 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a24eabaf-c935-47dc-87de-943b69033688 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:43.617127 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a24eabaf-c935-47dc-87de-943b69033688 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:43.617754 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a24eabaf-c935-47dc-87de-943b69033688 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:43.618902 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a24eabaf-c935-47dc-87de-943b69033688 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:43.619500 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a24eabaf-c935-47dc-87de-943b69033688 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:43.757142 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a24eabaf-c935-47dc-87de-943b69033688 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:43.766324 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a24eabaf-c935-47dc-87de-943b69033688 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.166142 May 03 09:18:43.766904 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1078/1990] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:43 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:44.135207 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0dec0f64-c6ac-4b64-ac7a-7fef42f784d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:44.135836 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0dec0f64-c6ac-4b64-ac7a-7fef42f784d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:44.142726 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0dec0f64-c6ac-4b64-ac7a-7fef42f784d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:44.143194 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0dec0f64-c6ac-4b64-ac7a-7fef42f784d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:44.144015 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0dec0f64-c6ac-4b64-ac7a-7fef42f784d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:44.144453 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0dec0f64-c6ac-4b64-ac7a-7fef42f784d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:44.211728 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0dec0f64-c6ac-4b64-ac7a-7fef42f784d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:44.220656 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0dec0f64-c6ac-4b64-ac7a-7fef42f784d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.089404 May 03 09:18:44.221242 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 913/1991] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:44 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:44.785813 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d9203ac7-7429-4f62-8857-947c63ba02eb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:44.786590 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d9203ac7-7429-4f62-8857-947c63ba02eb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:44.794841 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d9203ac7-7429-4f62-8857-947c63ba02eb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:44.795391 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d9203ac7-7429-4f62-8857-947c63ba02eb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:44.796420 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d9203ac7-7429-4f62-8857-947c63ba02eb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:44.796957 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d9203ac7-7429-4f62-8857-947c63ba02eb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:44.937217 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d9203ac7-7429-4f62-8857-947c63ba02eb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:44.948785 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d9203ac7-7429-4f62-8857-947c63ba02eb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.167901 May 03 09:18:44.949462 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1079/1992] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:44 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:45.238363 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-583f63f9-13fe-4cfa-a3d3-8e97f08abd27 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:45.238971 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-583f63f9-13fe-4cfa-a3d3-8e97f08abd27 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:45.246040 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-583f63f9-13fe-4cfa-a3d3-8e97f08abd27 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:45.246491 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-583f63f9-13fe-4cfa-a3d3-8e97f08abd27 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:45.247359 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-583f63f9-13fe-4cfa-a3d3-8e97f08abd27 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:45.247801 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-583f63f9-13fe-4cfa-a3d3-8e97f08abd27 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:45.315488 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-583f63f9-13fe-4cfa-a3d3-8e97f08abd27 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:45.323798 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-583f63f9-13fe-4cfa-a3d3-8e97f08abd27 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.089388 May 03 09:18:45.324381 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 914/1993] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:45 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:45.975636 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-2f145dbe-b297-4717-b0f0-a7415bcd96ec tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:45.976590 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-2f145dbe-b297-4717-b0f0-a7415bcd96ec tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:45.988025 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2f145dbe-b297-4717-b0f0-a7415bcd96ec tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:45.988769 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2f145dbe-b297-4717-b0f0-a7415bcd96ec tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:45.990010 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2f145dbe-b297-4717-b0f0-a7415bcd96ec tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:45.990722 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2f145dbe-b297-4717-b0f0-a7415bcd96ec tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:46.142832 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-2f145dbe-b297-4717-b0f0-a7415bcd96ec tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:46.151266 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-2f145dbe-b297-4717-b0f0-a7415bcd96ec tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.182485 May 03 09:18:46.151842 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1080/1994] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:45 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:46.341516 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0f9fd0c4-92b2-445a-85f0-7a18c6962eaa tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:46.342075 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0f9fd0c4-92b2-445a-85f0-7a18c6962eaa tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:46.349004 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0f9fd0c4-92b2-445a-85f0-7a18c6962eaa tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:46.349455 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0f9fd0c4-92b2-445a-85f0-7a18c6962eaa tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:46.350225 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0f9fd0c4-92b2-445a-85f0-7a18c6962eaa tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:46.350660 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0f9fd0c4-92b2-445a-85f0-7a18c6962eaa tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:46.412563 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0f9fd0c4-92b2-445a-85f0-7a18c6962eaa tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:46.421325 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0f9fd0c4-92b2-445a-85f0-7a18c6962eaa tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.083886 May 03 09:18:46.421911 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 915/1995] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:46 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:47.171147 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-78172480-e722-43f9-8f7e-6ebdc2725dbc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:47.171833 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-78172480-e722-43f9-8f7e-6ebdc2725dbc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:47.181227 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-78172480-e722-43f9-8f7e-6ebdc2725dbc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:47.181839 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-78172480-e722-43f9-8f7e-6ebdc2725dbc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:47.183002 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-78172480-e722-43f9-8f7e-6ebdc2725dbc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:47.183616 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-78172480-e722-43f9-8f7e-6ebdc2725dbc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:47.320234 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-78172480-e722-43f9-8f7e-6ebdc2725dbc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:47.331747 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-78172480-e722-43f9-8f7e-6ebdc2725dbc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.164607 May 03 09:18:47.332559 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1081/1996] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:47 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:47.441089 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-443f6d3c-6beb-42b7-8406-6ebbba4772ea tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:47.441656 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-443f6d3c-6beb-42b7-8406-6ebbba4772ea tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:47.448374 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-443f6d3c-6beb-42b7-8406-6ebbba4772ea tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:47.448822 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-443f6d3c-6beb-42b7-8406-6ebbba4772ea tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:47.449585 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-443f6d3c-6beb-42b7-8406-6ebbba4772ea tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:47.450010 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-443f6d3c-6beb-42b7-8406-6ebbba4772ea tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:47.531183 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-443f6d3c-6beb-42b7-8406-6ebbba4772ea tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:47.540069 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-443f6d3c-6beb-42b7-8406-6ebbba4772ea tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.103644 May 03 09:18:47.540644 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 916/1997] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:47 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:48.355347 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e6547b14-5718-49db-9429-fafdae986992 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:48.355968 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e6547b14-5718-49db-9429-fafdae986992 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:48.363093 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e6547b14-5718-49db-9429-fafdae986992 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:48.363544 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e6547b14-5718-49db-9429-fafdae986992 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:48.364343 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e6547b14-5718-49db-9429-fafdae986992 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:48.364775 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e6547b14-5718-49db-9429-fafdae986992 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:48.501690 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e6547b14-5718-49db-9429-fafdae986992 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:48.510052 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e6547b14-5718-49db-9429-fafdae986992 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.161115 May 03 09:18:48.510619 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1082/1998] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:48 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:48.561890 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2c5f257d-921e-4ffc-862c-14f89b198cfc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:48.562779 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-2c5f257d-921e-4ffc-862c-14f89b198cfc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:48.572863 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2c5f257d-921e-4ffc-862c-14f89b198cfc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:48.573495 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2c5f257d-921e-4ffc-862c-14f89b198cfc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:48.574685 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2c5f257d-921e-4ffc-862c-14f89b198cfc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:48.575497 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2c5f257d-921e-4ffc-862c-14f89b198cfc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:48.638498 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2c5f257d-921e-4ffc-862c-14f89b198cfc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:48.646942 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-2c5f257d-921e-4ffc-862c-14f89b198cfc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.091530 May 03 09:18:48.647528 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 917/1999] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:48 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:18:49.530760 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5c47604a-66f2-4f2e-b530-7cb5372f9674 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:49.531388 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5c47604a-66f2-4f2e-b530-7cb5372f9674 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:49.539158 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5c47604a-66f2-4f2e-b530-7cb5372f9674 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:49.539657 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5c47604a-66f2-4f2e-b530-7cb5372f9674 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:49.540587 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5c47604a-66f2-4f2e-b530-7cb5372f9674 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:49.541092 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5c47604a-66f2-4f2e-b530-7cb5372f9674 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:49.664506 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-46a086c0-70a3-4607-a1eb-0c6219c25dc2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:49.665074 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-46a086c0-70a3-4607-a1eb-0c6219c25dc2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:49.671563 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-46a086c0-70a3-4607-a1eb-0c6219c25dc2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:49.672012 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-46a086c0-70a3-4607-a1eb-0c6219c25dc2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:49.672779 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-46a086c0-70a3-4607-a1eb-0c6219c25dc2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:49.673206 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-46a086c0-70a3-4607-a1eb-0c6219c25dc2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:49.692200 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5c47604a-66f2-4f2e-b530-7cb5372f9674 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:49.700466 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5c47604a-66f2-4f2e-b530-7cb5372f9674 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.175743 May 03 09:18:49.701039 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1083/2000] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:49 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:49.734822 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-46a086c0-70a3-4607-a1eb-0c6219c25dc2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:49.742885 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-46a086c0-70a3-4607-a1eb-0c6219c25dc2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.082284 May 03 09:18:49.743448 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 918/2001] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:49 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:50.722330 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-73f19b11-7f7c-4506-9f1d-9659672e144c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:50.723363 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-73f19b11-7f7c-4506-9f1d-9659672e144c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:50.732801 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-73f19b11-7f7c-4506-9f1d-9659672e144c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:50.733253 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-73f19b11-7f7c-4506-9f1d-9659672e144c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:50.734015 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-73f19b11-7f7c-4506-9f1d-9659672e144c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:50.734447 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-73f19b11-7f7c-4506-9f1d-9659672e144c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:50.763337 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-603e5317-fa97-49df-8dc4-d2d7106083dd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:50.764000 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-603e5317-fa97-49df-8dc4-d2d7106083dd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:50.771076 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-603e5317-fa97-49df-8dc4-d2d7106083dd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:50.771532 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-603e5317-fa97-49df-8dc4-d2d7106083dd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:50.772348 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-603e5317-fa97-49df-8dc4-d2d7106083dd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:50.772785 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-603e5317-fa97-49df-8dc4-d2d7106083dd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:50.850071 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-603e5317-fa97-49df-8dc4-d2d7106083dd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:50.858578 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-603e5317-fa97-49df-8dc4-d2d7106083dd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.100720 May 03 09:18:50.859169 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 919/2002] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:50 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:50.883603 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-73f19b11-7f7c-4506-9f1d-9659672e144c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:50.892257 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-73f19b11-7f7c-4506-9f1d-9659672e144c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.176517 May 03 09:18:50.892801 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1084/2003] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:50 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:51.879990 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-690cd55b-c249-40a7-9d6f-b32ba7be030e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:51.880990 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-690cd55b-c249-40a7-9d6f-b32ba7be030e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:51.891734 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-690cd55b-c249-40a7-9d6f-b32ba7be030e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:51.892548 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-690cd55b-c249-40a7-9d6f-b32ba7be030e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:51.893810 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-690cd55b-c249-40a7-9d6f-b32ba7be030e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:51.894541 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-690cd55b-c249-40a7-9d6f-b32ba7be030e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:51.909777 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a756ed71-c35c-47d4-befa-e73b35378c1b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:51.910465 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a756ed71-c35c-47d4-befa-e73b35378c1b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:51.917084 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a756ed71-c35c-47d4-befa-e73b35378c1b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:51.917531 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a756ed71-c35c-47d4-befa-e73b35378c1b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:51.918291 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a756ed71-c35c-47d4-befa-e73b35378c1b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:51.918699 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a756ed71-c35c-47d4-befa-e73b35378c1b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:51.971822 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-690cd55b-c249-40a7-9d6f-b32ba7be030e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:51.980445 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-690cd55b-c249-40a7-9d6f-b32ba7be030e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.107022 May 03 09:18:51.981029 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 920/2004] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:51 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:52.062029 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a756ed71-c35c-47d4-befa-e73b35378c1b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:52.074382 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a756ed71-c35c-47d4-befa-e73b35378c1b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.168322 May 03 09:18:52.075286 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1085/2005] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:51 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:53.000987 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6a015385-d551-42ab-96ce-ac79a73d9edf tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:53.001966 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6a015385-d551-42ab-96ce-ac79a73d9edf tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:53.012846 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6a015385-d551-42ab-96ce-ac79a73d9edf tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:53.013292 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6a015385-d551-42ab-96ce-ac79a73d9edf tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:53.014060 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6a015385-d551-42ab-96ce-ac79a73d9edf tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:53.014499 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6a015385-d551-42ab-96ce-ac79a73d9edf tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:53.076005 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6a015385-d551-42ab-96ce-ac79a73d9edf tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:53.084979 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6a015385-d551-42ab-96ce-ac79a73d9edf tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.090610 May 03 09:18:53.085548 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 921/2006] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:52 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:53.096854 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-140cd435-1543-436b-bb56-d9dd51a68e77 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:53.097460 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-140cd435-1543-436b-bb56-d9dd51a68e77 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:53.104488 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-140cd435-1543-436b-bb56-d9dd51a68e77 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:53.104934 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-140cd435-1543-436b-bb56-d9dd51a68e77 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:53.105689 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-140cd435-1543-436b-bb56-d9dd51a68e77 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:53.106120 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-140cd435-1543-436b-bb56-d9dd51a68e77 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:53.240919 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-140cd435-1543-436b-bb56-d9dd51a68e77 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:53.249662 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-140cd435-1543-436b-bb56-d9dd51a68e77 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.156704 May 03 09:18:53.250253 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1086/2007] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:53 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:54.106877 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-49fa8591-c0f5-454b-a35d-6c914935e6d1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:54.107861 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-49fa8591-c0f5-454b-a35d-6c914935e6d1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:54.117981 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-49fa8591-c0f5-454b-a35d-6c914935e6d1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:54.118716 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-49fa8591-c0f5-454b-a35d-6c914935e6d1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:54.120016 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-49fa8591-c0f5-454b-a35d-6c914935e6d1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:54.120735 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-49fa8591-c0f5-454b-a35d-6c914935e6d1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:54.186184 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-49fa8591-c0f5-454b-a35d-6c914935e6d1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:54.194759 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-49fa8591-c0f5-454b-a35d-6c914935e6d1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.094711 May 03 09:18:54.195336 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 922/2008] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:54 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:54.269200 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9dee3bc3-7338-4e84-a2a2-73e1a999929f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:54.270103 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9dee3bc3-7338-4e84-a2a2-73e1a999929f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:54.279352 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9dee3bc3-7338-4e84-a2a2-73e1a999929f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:54.280052 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9dee3bc3-7338-4e84-a2a2-73e1a999929f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:54.281142 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9dee3bc3-7338-4e84-a2a2-73e1a999929f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:54.281757 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9dee3bc3-7338-4e84-a2a2-73e1a999929f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:54.416624 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9dee3bc3-7338-4e84-a2a2-73e1a999929f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:54.425304 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9dee3bc3-7338-4e84-a2a2-73e1a999929f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.161772 May 03 09:18:54.425882 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1087/2009] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:54 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:54.470389 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-85898842-9c70-4d08-97f5-8f49df5be59a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:54.470875 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-85898842-9c70-4d08-97f5-8f49df5be59a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: 2dbd7241-ce49-4617-9aad-57a39f136403] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:54.477645 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-85898842-9c70-4d08-97f5-8f49df5be59a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:54.478102 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-85898842-9c70-4d08-97f5-8f49df5be59a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:54.478857 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-85898842-9c70-4d08-97f5-8f49df5be59a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:54.479285 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-85898842-9c70-4d08-97f5-8f49df5be59a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:54.502168 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-85898842-9c70-4d08-97f5-8f49df5be59a tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/2dbd7241-ce49-4617-9aad-57a39f136403/ips" status: 200 len: 153 microversion: 2.20 time: 0.035796 May 03 09:18:54.502718 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 923/2010] 10.222.0.11 () {60 vars in 1288 bytes} [Tue May 3 09:18:54 2022] GET /compute/v2.1/servers/2dbd7241-ce49-4617-9aad-57a39f136403/ips => generated 153 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 09:18:55.216920 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-360594fd-5963-426d-92e5-17b0c6058414 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:55.217934 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-360594fd-5963-426d-92e5-17b0c6058414 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:55.228201 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-360594fd-5963-426d-92e5-17b0c6058414 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:55.228946 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-360594fd-5963-426d-92e5-17b0c6058414 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:55.230206 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-360594fd-5963-426d-92e5-17b0c6058414 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:55.230942 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-360594fd-5963-426d-92e5-17b0c6058414 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:55.298872 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-360594fd-5963-426d-92e5-17b0c6058414 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:55.310160 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-360594fd-5963-426d-92e5-17b0c6058414 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.100111 May 03 09:18:55.310806 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1088/2011] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:55 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:55.446362 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a8887bfa-9e53-4945-a578-e9482f8e15cc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:55.447386 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a8887bfa-9e53-4945-a578-e9482f8e15cc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:55.458037 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a8887bfa-9e53-4945-a578-e9482f8e15cc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:55.458784 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a8887bfa-9e53-4945-a578-e9482f8e15cc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:55.460139 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a8887bfa-9e53-4945-a578-e9482f8e15cc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:55.460867 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a8887bfa-9e53-4945-a578-e9482f8e15cc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:55.597391 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a8887bfa-9e53-4945-a578-e9482f8e15cc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:55.609293 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a8887bfa-9e53-4945-a578-e9482f8e15cc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.169417 May 03 09:18:55.609935 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 924/2012] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:55 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:56.330970 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-722eef6c-de34-4d8e-8797-cdc0202a5b88 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:56.331522 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-722eef6c-de34-4d8e-8797-cdc0202a5b88 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:56.337715 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-722eef6c-de34-4d8e-8797-cdc0202a5b88 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:56.338145 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-722eef6c-de34-4d8e-8797-cdc0202a5b88 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:56.338935 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-722eef6c-de34-4d8e-8797-cdc0202a5b88 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:56.339369 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-722eef6c-de34-4d8e-8797-cdc0202a5b88 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:56.399223 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-722eef6c-de34-4d8e-8797-cdc0202a5b88 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:56.407505 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-722eef6c-de34-4d8e-8797-cdc0202a5b88 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.080605 May 03 09:18:56.408117 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1089/2013] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:56 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:56.630763 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-fcfdffe5-6be6-4e3e-bb2a-d8e7b7e46463 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:56.631812 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-fcfdffe5-6be6-4e3e-bb2a-d8e7b7e46463 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:56.641352 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fcfdffe5-6be6-4e3e-bb2a-d8e7b7e46463 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:56.641797 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fcfdffe5-6be6-4e3e-bb2a-d8e7b7e46463 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:56.642593 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fcfdffe5-6be6-4e3e-bb2a-d8e7b7e46463 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:56.643025 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fcfdffe5-6be6-4e3e-bb2a-d8e7b7e46463 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:56.784710 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-fcfdffe5-6be6-4e3e-bb2a-d8e7b7e46463 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:56.793087 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-fcfdffe5-6be6-4e3e-bb2a-d8e7b7e46463 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.168649 May 03 09:18:56.793670 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 925/2014] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:56 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:57.428818 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-48c0f3cf-e62e-434f-bf63-f9077b44fc22 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:57.429786 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-48c0f3cf-e62e-434f-bf63-f9077b44fc22 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:57.440962 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-48c0f3cf-e62e-434f-bf63-f9077b44fc22 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:57.441703 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-48c0f3cf-e62e-434f-bf63-f9077b44fc22 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:57.443018 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-48c0f3cf-e62e-434f-bf63-f9077b44fc22 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:57.443721 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-48c0f3cf-e62e-434f-bf63-f9077b44fc22 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:57.510431 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-48c0f3cf-e62e-434f-bf63-f9077b44fc22 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:57.518549 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-48c0f3cf-e62e-434f-bf63-f9077b44fc22 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.096217 May 03 09:18:57.519108 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1090/2015] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:57 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:57.814443 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-3844c61b-09f4-49c8-b564-c63082223849 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:57.815298 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-3844c61b-09f4-49c8-b564-c63082223849 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:57.824109 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3844c61b-09f4-49c8-b564-c63082223849 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:57.824864 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3844c61b-09f4-49c8-b564-c63082223849 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:57.825884 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3844c61b-09f4-49c8-b564-c63082223849 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:57.826462 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3844c61b-09f4-49c8-b564-c63082223849 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:57.965085 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-3844c61b-09f4-49c8-b564-c63082223849 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:57.973156 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-3844c61b-09f4-49c8-b564-c63082223849 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.165070 May 03 09:18:57.973727 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 926/2016] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:57 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:58.536335 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-59cd206e-090a-4a0f-b873-9f965d7c5d0c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:58.536981 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-59cd206e-090a-4a0f-b873-9f965d7c5d0c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:58.543685 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-59cd206e-090a-4a0f-b873-9f965d7c5d0c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:58.544162 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-59cd206e-090a-4a0f-b873-9f965d7c5d0c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:58.544957 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-59cd206e-090a-4a0f-b873-9f965d7c5d0c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:58.545386 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-59cd206e-090a-4a0f-b873-9f965d7c5d0c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:58.618439 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-59cd206e-090a-4a0f-b873-9f965d7c5d0c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:58.629501 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-59cd206e-090a-4a0f-b873-9f965d7c5d0c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.098088 May 03 09:18:58.630181 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1091/2017] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:58 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:58.992158 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0b246e36-e68a-4b18-b271-08891acdb7cf tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:58.992955 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0b246e36-e68a-4b18-b271-08891acdb7cf tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:59.002057 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0b246e36-e68a-4b18-b271-08891acdb7cf tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:59.002753 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0b246e36-e68a-4b18-b271-08891acdb7cf tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:59.004018 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0b246e36-e68a-4b18-b271-08891acdb7cf tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:59.004707 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0b246e36-e68a-4b18-b271-08891acdb7cf tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:59.152510 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0b246e36-e68a-4b18-b271-08891acdb7cf tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:59.162411 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0b246e36-e68a-4b18-b271-08891acdb7cf tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.175485 May 03 09:18:59.162999 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 927/2018] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:58 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:18:59.647084 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-0dfd679c-b8c6-4f84-aa3f-21e879b1ca4c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:18:59.647678 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-0dfd679c-b8c6-4f84-aa3f-21e879b1ca4c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:18:59.654254 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0dfd679c-b8c6-4f84-aa3f-21e879b1ca4c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:59.654724 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0dfd679c-b8c6-4f84-aa3f-21e879b1ca4c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:59.655530 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0dfd679c-b8c6-4f84-aa3f-21e879b1ca4c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:18:59.656164 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0dfd679c-b8c6-4f84-aa3f-21e879b1ca4c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:18:59.716844 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-0dfd679c-b8c6-4f84-aa3f-21e879b1ca4c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:18:59.725114 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-0dfd679c-b8c6-4f84-aa3f-21e879b1ca4c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.082244 May 03 09:18:59.725680 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1092/2019] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:18:59 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:19:00.184386 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c20a1d75-d1a0-4fa7-b01c-45d314548a3a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:00.185261 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c20a1d75-d1a0-4fa7-b01c-45d314548a3a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:00.193055 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c20a1d75-d1a0-4fa7-b01c-45d314548a3a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:00.193499 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c20a1d75-d1a0-4fa7-b01c-45d314548a3a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:00.194282 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c20a1d75-d1a0-4fa7-b01c-45d314548a3a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:00.194715 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c20a1d75-d1a0-4fa7-b01c-45d314548a3a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:00.329243 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c20a1d75-d1a0-4fa7-b01c-45d314548a3a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:00.337769 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c20a1d75-d1a0-4fa7-b01c-45d314548a3a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.160136 May 03 09:19:00.338348 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 928/2020] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:00 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:00.746697 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ed773c88-93c6-4825-9940-e2788ee8d191 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:00.747723 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ed773c88-93c6-4825-9940-e2788ee8d191 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:00.755924 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ed773c88-93c6-4825-9940-e2788ee8d191 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:00.756433 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ed773c88-93c6-4825-9940-e2788ee8d191 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:00.757283 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ed773c88-93c6-4825-9940-e2788ee8d191 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:00.757764 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ed773c88-93c6-4825-9940-e2788ee8d191 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:00.825233 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ed773c88-93c6-4825-9940-e2788ee8d191 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:00.833880 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ed773c88-93c6-4825-9940-e2788ee8d191 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.093901 May 03 09:19:00.834459 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1093/2021] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:00 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:01.359731 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-14e887e3-7366-4489-bcd8-66d78f317ef2 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:01.360754 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-14e887e3-7366-4489-bcd8-66d78f317ef2 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:01.371567 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-14e887e3-7366-4489-bcd8-66d78f317ef2 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:01.372376 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-14e887e3-7366-4489-bcd8-66d78f317ef2 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:01.373652 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-14e887e3-7366-4489-bcd8-66d78f317ef2 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:01.374382 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-14e887e3-7366-4489-bcd8-66d78f317ef2 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:01.508317 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-14e887e3-7366-4489-bcd8-66d78f317ef2 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:01.520722 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-14e887e3-7366-4489-bcd8-66d78f317ef2 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.167281 May 03 09:19:01.521603 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 929/2022] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:01 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:01.853594 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f58c0c71-f126-4013-a15b-8e2c87868f3d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:01.854325 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f58c0c71-f126-4013-a15b-8e2c87868f3d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:01.862356 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f58c0c71-f126-4013-a15b-8e2c87868f3d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:01.862804 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f58c0c71-f126-4013-a15b-8e2c87868f3d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:01.863565 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f58c0c71-f126-4013-a15b-8e2c87868f3d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:01.864030 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f58c0c71-f126-4013-a15b-8e2c87868f3d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:01.936123 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f58c0c71-f126-4013-a15b-8e2c87868f3d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:01.944489 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f58c0c71-f126-4013-a15b-8e2c87868f3d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.096406 May 03 09:19:01.945064 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1094/2023] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:01 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:02.546059 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-831c172f-dbb7-4b41-9131-4c6f7c368996 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:02.546714 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-831c172f-dbb7-4b41-9131-4c6f7c368996 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:02.553563 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-831c172f-dbb7-4b41-9131-4c6f7c368996 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:02.554008 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-831c172f-dbb7-4b41-9131-4c6f7c368996 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:02.554765 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-831c172f-dbb7-4b41-9131-4c6f7c368996 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:02.555190 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-831c172f-dbb7-4b41-9131-4c6f7c368996 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:02.689755 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-831c172f-dbb7-4b41-9131-4c6f7c368996 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:02.697704 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-831c172f-dbb7-4b41-9131-4c6f7c368996 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.158222 May 03 09:19:02.698317 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 930/2024] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:02 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:02.966207 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-caa42a76-4396-4b68-916a-15107efc3f9a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:02.967141 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-caa42a76-4396-4b68-916a-15107efc3f9a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:02.975051 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-caa42a76-4396-4b68-916a-15107efc3f9a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:02.975502 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-caa42a76-4396-4b68-916a-15107efc3f9a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:02.976369 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-caa42a76-4396-4b68-916a-15107efc3f9a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:02.976803 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-caa42a76-4396-4b68-916a-15107efc3f9a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:03.047372 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-caa42a76-4396-4b68-916a-15107efc3f9a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:03.059406 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-caa42a76-4396-4b68-916a-15107efc3f9a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.099864 May 03 09:19:03.060194 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1095/2025] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:02 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:03.716417 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-96cd2312-ae9d-4a02-b02c-c822e433881c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:03.717093 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-96cd2312-ae9d-4a02-b02c-c822e433881c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:03.724637 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-96cd2312-ae9d-4a02-b02c-c822e433881c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:03.725135 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-96cd2312-ae9d-4a02-b02c-c822e433881c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:03.725985 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-96cd2312-ae9d-4a02-b02c-c822e433881c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:03.726463 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-96cd2312-ae9d-4a02-b02c-c822e433881c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:03.859039 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-96cd2312-ae9d-4a02-b02c-c822e433881c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:03.867056 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-96cd2312-ae9d-4a02-b02c-c822e433881c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.155443 May 03 09:19:03.867627 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 931/2026] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:03 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:04.080368 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-88ed7410-e044-4318-af61-cc91917b465c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:04.080951 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-88ed7410-e044-4318-af61-cc91917b465c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:04.087861 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-88ed7410-e044-4318-af61-cc91917b465c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:04.088364 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-88ed7410-e044-4318-af61-cc91917b465c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:04.089199 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-88ed7410-e044-4318-af61-cc91917b465c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:04.089983 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-88ed7410-e044-4318-af61-cc91917b465c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:04.159622 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-88ed7410-e044-4318-af61-cc91917b465c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:04.170052 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-88ed7410-e044-4318-af61-cc91917b465c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.094691 May 03 09:19:04.170906 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1096/2027] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:04 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:04.888798 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6b20d300-7729-438f-bca3-a42799de8e26 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:04.889851 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6b20d300-7729-438f-bca3-a42799de8e26 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:04.896856 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6b20d300-7729-438f-bca3-a42799de8e26 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:04.897308 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6b20d300-7729-438f-bca3-a42799de8e26 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:04.898081 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6b20d300-7729-438f-bca3-a42799de8e26 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:04.898521 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6b20d300-7729-438f-bca3-a42799de8e26 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:05.031213 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6b20d300-7729-438f-bca3-a42799de8e26 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:05.039605 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6b20d300-7729-438f-bca3-a42799de8e26 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.158242 May 03 09:19:05.040224 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 932/2028] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:04 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:05.196852 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e5698ebe-50e4-41cb-a1a7-2c20c2fe76c6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:05.197844 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e5698ebe-50e4-41cb-a1a7-2c20c2fe76c6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:05.208594 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e5698ebe-50e4-41cb-a1a7-2c20c2fe76c6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:05.209375 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e5698ebe-50e4-41cb-a1a7-2c20c2fe76c6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:05.210683 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e5698ebe-50e4-41cb-a1a7-2c20c2fe76c6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:05.211396 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e5698ebe-50e4-41cb-a1a7-2c20c2fe76c6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:05.280188 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e5698ebe-50e4-41cb-a1a7-2c20c2fe76c6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:05.288926 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e5698ebe-50e4-41cb-a1a7-2c20c2fe76c6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.098515 May 03 09:19:05.289504 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1097/2029] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:05 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:06.061225 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9b7b967e-4e37-4442-9d96-d7e4b0c34da8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:06.062289 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9b7b967e-4e37-4442-9d96-d7e4b0c34da8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:06.070096 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9b7b967e-4e37-4442-9d96-d7e4b0c34da8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:06.070622 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9b7b967e-4e37-4442-9d96-d7e4b0c34da8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:06.071526 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9b7b967e-4e37-4442-9d96-d7e4b0c34da8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:06.072079 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9b7b967e-4e37-4442-9d96-d7e4b0c34da8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:06.234958 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9b7b967e-4e37-4442-9d96-d7e4b0c34da8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:06.243236 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9b7b967e-4e37-4442-9d96-d7e4b0c34da8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.188524 May 03 09:19:06.243871 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 933/2030] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:06 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:06.311061 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-7e575344-7d67-4d5f-a647-2ef8dd82a2ac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:06.311745 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-7e575344-7d67-4d5f-a647-2ef8dd82a2ac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:06.318197 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7e575344-7d67-4d5f-a647-2ef8dd82a2ac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:06.318659 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7e575344-7d67-4d5f-a647-2ef8dd82a2ac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:06.319416 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7e575344-7d67-4d5f-a647-2ef8dd82a2ac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:06.319883 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7e575344-7d67-4d5f-a647-2ef8dd82a2ac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:06.380627 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7e575344-7d67-4d5f-a647-2ef8dd82a2ac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:06.388608 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-7e575344-7d67-4d5f-a647-2ef8dd82a2ac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.081497 May 03 09:19:06.389173 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1098/2031] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:06 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:19:07.259956 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b157e4e7-e358-4e41-bff1-742a8b2f1d09 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:07.260559 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b157e4e7-e358-4e41-bff1-742a8b2f1d09 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:07.267288 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b157e4e7-e358-4e41-bff1-742a8b2f1d09 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:07.267725 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b157e4e7-e358-4e41-bff1-742a8b2f1d09 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:07.268513 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b157e4e7-e358-4e41-bff1-742a8b2f1d09 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:07.268945 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b157e4e7-e358-4e41-bff1-742a8b2f1d09 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:07.399580 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b157e4e7-e358-4e41-bff1-742a8b2f1d09 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:07.405482 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b76fa01f-6957-4404-9778-e0d1fcbb6c86 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:07.406134 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b76fa01f-6957-4404-9778-e0d1fcbb6c86 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:07.409126 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b157e4e7-e358-4e41-bff1-742a8b2f1d09 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.153196 May 03 09:19:07.409961 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 934/2032] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:07 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:07.412579 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b76fa01f-6957-4404-9778-e0d1fcbb6c86 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:07.413026 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b76fa01f-6957-4404-9778-e0d1fcbb6c86 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:07.413787 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b76fa01f-6957-4404-9778-e0d1fcbb6c86 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:07.414812 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b76fa01f-6957-4404-9778-e0d1fcbb6c86 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:07.474389 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b76fa01f-6957-4404-9778-e0d1fcbb6c86 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:07.482349 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b76fa01f-6957-4404-9778-e0d1fcbb6c86 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.080686 May 03 09:19:07.482906 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1099/2033] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:07 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:19:08.430856 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-442aede6-411b-4618-bf77-e344e6118c00 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:08.431891 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-442aede6-411b-4618-bf77-e344e6118c00 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:08.442531 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-442aede6-411b-4618-bf77-e344e6118c00 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:08.443247 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-442aede6-411b-4618-bf77-e344e6118c00 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:08.444611 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-442aede6-411b-4618-bf77-e344e6118c00 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:08.445377 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-442aede6-411b-4618-bf77-e344e6118c00 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:08.499853 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b872f439-5079-45ef-bcdb-02d96fe9aecd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:08.500499 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b872f439-5079-45ef-bcdb-02d96fe9aecd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:08.507038 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b872f439-5079-45ef-bcdb-02d96fe9aecd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:08.507488 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b872f439-5079-45ef-bcdb-02d96fe9aecd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:08.508324 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b872f439-5079-45ef-bcdb-02d96fe9aecd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:08.508731 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b872f439-5079-45ef-bcdb-02d96fe9aecd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:08.584684 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b872f439-5079-45ef-bcdb-02d96fe9aecd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:08.592787 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b872f439-5079-45ef-bcdb-02d96fe9aecd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.096982 May 03 09:19:08.593362 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1100/2034] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:08 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:08.601766 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-442aede6-411b-4618-bf77-e344e6118c00 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:08.610010 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-442aede6-411b-4618-bf77-e344e6118c00 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.185781 May 03 09:19:08.610582 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 935/2035] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:08 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:09.612988 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-019e832f-1c7c-4a9d-985f-5ae5ab8ec86b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:09.613845 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-019e832f-1c7c-4a9d-985f-5ae5ab8ec86b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:09.622946 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-019e832f-1c7c-4a9d-985f-5ae5ab8ec86b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:09.623391 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-019e832f-1c7c-4a9d-985f-5ae5ab8ec86b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:09.624190 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-019e832f-1c7c-4a9d-985f-5ae5ab8ec86b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:09.624680 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-019e832f-1c7c-4a9d-985f-5ae5ab8ec86b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:09.627419 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-064e5bb3-1114-41fd-bcbd-ab8b45793260 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:09.628052 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-064e5bb3-1114-41fd-bcbd-ab8b45793260 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:09.634320 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-064e5bb3-1114-41fd-bcbd-ab8b45793260 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:09.634763 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-064e5bb3-1114-41fd-bcbd-ab8b45793260 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:09.635532 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-064e5bb3-1114-41fd-bcbd-ab8b45793260 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:09.635996 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-064e5bb3-1114-41fd-bcbd-ab8b45793260 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:09.696092 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-019e832f-1c7c-4a9d-985f-5ae5ab8ec86b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:09.704030 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-019e832f-1c7c-4a9d-985f-5ae5ab8ec86b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.097610 May 03 09:19:09.704640 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1101/2036] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:09 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:09.783990 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-064e5bb3-1114-41fd-bcbd-ab8b45793260 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:09.796990 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-064e5bb3-1114-41fd-bcbd-ab8b45793260 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.173784 May 03 09:19:09.797883 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 936/2037] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:09 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:10.725090 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3645e5d4-5bf9-4042-95f5-e0ece2047e55 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:10.726051 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-3645e5d4-5bf9-4042-95f5-e0ece2047e55 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:10.736647 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3645e5d4-5bf9-4042-95f5-e0ece2047e55 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:10.737095 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3645e5d4-5bf9-4042-95f5-e0ece2047e55 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:10.737848 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3645e5d4-5bf9-4042-95f5-e0ece2047e55 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:10.738273 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3645e5d4-5bf9-4042-95f5-e0ece2047e55 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:10.809038 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-3645e5d4-5bf9-4042-95f5-e0ece2047e55 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:10.817452 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-3645e5d4-5bf9-4042-95f5-e0ece2047e55 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.098898 May 03 09:19:10.818029 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1102/2038] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:10 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:10.819830 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d22ebda6-af15-47f4-8d44-7f0abcd8ecd6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:10.820471 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d22ebda6-af15-47f4-8d44-7f0abcd8ecd6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:10.826976 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d22ebda6-af15-47f4-8d44-7f0abcd8ecd6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:10.827426 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d22ebda6-af15-47f4-8d44-7f0abcd8ecd6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:10.828252 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d22ebda6-af15-47f4-8d44-7f0abcd8ecd6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:10.828686 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d22ebda6-af15-47f4-8d44-7f0abcd8ecd6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:10.961794 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d22ebda6-af15-47f4-8d44-7f0abcd8ecd6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:10.973960 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d22ebda6-af15-47f4-8d44-7f0abcd8ecd6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.157697 May 03 09:19:10.974792 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 937/2039] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:10 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:11.838642 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-fd71437c-8bee-4a74-9887-5b5bc545efb9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:11.840035 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-fd71437c-8bee-4a74-9887-5b5bc545efb9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:11.848931 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fd71437c-8bee-4a74-9887-5b5bc545efb9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:11.849397 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fd71437c-8bee-4a74-9887-5b5bc545efb9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:11.850171 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fd71437c-8bee-4a74-9887-5b5bc545efb9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:11.850609 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fd71437c-8bee-4a74-9887-5b5bc545efb9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:11.922783 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-fd71437c-8bee-4a74-9887-5b5bc545efb9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:11.935372 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-fd71437c-8bee-4a74-9887-5b5bc545efb9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.103062 May 03 09:19:11.936250 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1103/2040] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:11 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:11.995919 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ac3a5eb0-3a7b-460d-8f3c-e93b596079c0 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:11.996565 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ac3a5eb0-3a7b-460d-8f3c-e93b596079c0 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:12.003399 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ac3a5eb0-3a7b-460d-8f3c-e93b596079c0 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:12.003864 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ac3a5eb0-3a7b-460d-8f3c-e93b596079c0 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:12.004654 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ac3a5eb0-3a7b-460d-8f3c-e93b596079c0 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:12.005076 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ac3a5eb0-3a7b-460d-8f3c-e93b596079c0 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:12.149787 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ac3a5eb0-3a7b-460d-8f3c-e93b596079c0 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:12.157609 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ac3a5eb0-3a7b-460d-8f3c-e93b596079c0 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.165643 May 03 09:19:12.158222 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 938/2041] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:11 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:12.956331 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9dfef0c9-5893-4ce2-aa3f-21f9f410c5c8 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:12.957034 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9dfef0c9-5893-4ce2-aa3f-21f9f410c5c8 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:12.966276 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9dfef0c9-5893-4ce2-aa3f-21f9f410c5c8 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:12.966836 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9dfef0c9-5893-4ce2-aa3f-21f9f410c5c8 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:12.967856 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9dfef0c9-5893-4ce2-aa3f-21f9f410c5c8 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:12.968444 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9dfef0c9-5893-4ce2-aa3f-21f9f410c5c8 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:13.041443 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9dfef0c9-5893-4ce2-aa3f-21f9f410c5c8 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:13.049864 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9dfef0c9-5893-4ce2-aa3f-21f9f410c5c8 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.099133 May 03 09:19:13.050408 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1104/2042] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:12 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:13.184998 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9a72f97e-2ac0-4da5-b3c6-42c0b6ecc6e6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:13.186004 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9a72f97e-2ac0-4da5-b3c6-42c0b6ecc6e6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:13.196718 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9a72f97e-2ac0-4da5-b3c6-42c0b6ecc6e6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:13.197463 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9a72f97e-2ac0-4da5-b3c6-42c0b6ecc6e6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:13.198769 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9a72f97e-2ac0-4da5-b3c6-42c0b6ecc6e6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:13.199468 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9a72f97e-2ac0-4da5-b3c6-42c0b6ecc6e6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:13.333013 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9a72f97e-2ac0-4da5-b3c6-42c0b6ecc6e6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:13.341915 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9a72f97e-2ac0-4da5-b3c6-42c0b6ecc6e6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.163605 May 03 09:19:13.342504 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 939/2043] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:13 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:14.071136 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c3616f7a-fbd5-4d52-a697-44875a4ac904 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:14.072136 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c3616f7a-fbd5-4d52-a697-44875a4ac904 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:14.082579 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c3616f7a-fbd5-4d52-a697-44875a4ac904 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:14.083032 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c3616f7a-fbd5-4d52-a697-44875a4ac904 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:14.083800 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c3616f7a-fbd5-4d52-a697-44875a4ac904 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:14.084268 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c3616f7a-fbd5-4d52-a697-44875a4ac904 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:14.156347 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c3616f7a-fbd5-4d52-a697-44875a4ac904 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:14.168887 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c3616f7a-fbd5-4d52-a697-44875a4ac904 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.103992 May 03 09:19:14.169731 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1105/2044] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:14 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:14.362785 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-993e666f-231b-4087-8227-1eb30355229e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:14.363589 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-993e666f-231b-4087-8227-1eb30355229e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:14.371367 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-993e666f-231b-4087-8227-1eb30355229e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:14.371948 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-993e666f-231b-4087-8227-1eb30355229e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:14.372843 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-993e666f-231b-4087-8227-1eb30355229e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:14.373352 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-993e666f-231b-4087-8227-1eb30355229e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:14.509266 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-993e666f-231b-4087-8227-1eb30355229e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:14.518016 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-993e666f-231b-4087-8227-1eb30355229e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.161860 May 03 09:19:14.518575 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 940/2045] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:14 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:15.192440 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9e545225-51c8-43e4-b3bf-616f353e60b4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:15.193377 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9e545225-51c8-43e4-b3bf-616f353e60b4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:15.204203 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9e545225-51c8-43e4-b3bf-616f353e60b4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:15.204946 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9e545225-51c8-43e4-b3bf-616f353e60b4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:15.206272 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9e545225-51c8-43e4-b3bf-616f353e60b4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:15.207005 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9e545225-51c8-43e4-b3bf-616f353e60b4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:15.276528 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9e545225-51c8-43e4-b3bf-616f353e60b4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:15.285189 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9e545225-51c8-43e4-b3bf-616f353e60b4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.099333 May 03 09:19:15.285745 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1106/2046] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:15 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:15.544792 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9fa8fdd0-6b27-4160-93b8-364a31529d11 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:15.545663 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9fa8fdd0-6b27-4160-93b8-364a31529d11 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:15.554185 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9fa8fdd0-6b27-4160-93b8-364a31529d11 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:15.554647 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9fa8fdd0-6b27-4160-93b8-364a31529d11 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:15.555402 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9fa8fdd0-6b27-4160-93b8-364a31529d11 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:15.555975 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9fa8fdd0-6b27-4160-93b8-364a31529d11 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:15.689868 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9fa8fdd0-6b27-4160-93b8-364a31529d11 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:15.698560 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9fa8fdd0-6b27-4160-93b8-364a31529d11 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.160487 May 03 09:19:15.699142 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 941/2047] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:15 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:16.303919 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-cc74c50d-db92-4451-85da-2dd0f8e7184d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:16.304638 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-cc74c50d-db92-4451-85da-2dd0f8e7184d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:16.311270 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cc74c50d-db92-4451-85da-2dd0f8e7184d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:16.311737 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cc74c50d-db92-4451-85da-2dd0f8e7184d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:16.312515 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cc74c50d-db92-4451-85da-2dd0f8e7184d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:16.312944 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cc74c50d-db92-4451-85da-2dd0f8e7184d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:16.376299 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-cc74c50d-db92-4451-85da-2dd0f8e7184d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:16.384328 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-cc74c50d-db92-4451-85da-2dd0f8e7184d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.085051 May 03 09:19:16.384914 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1107/2048] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:16 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:16.719290 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-1cd1a043-8c7c-4c3a-98ce-96e806163505 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:16.719911 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-1cd1a043-8c7c-4c3a-98ce-96e806163505 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:16.726773 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1cd1a043-8c7c-4c3a-98ce-96e806163505 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:16.727251 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1cd1a043-8c7c-4c3a-98ce-96e806163505 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:16.728063 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1cd1a043-8c7c-4c3a-98ce-96e806163505 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:16.728500 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1cd1a043-8c7c-4c3a-98ce-96e806163505 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:16.861477 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-1cd1a043-8c7c-4c3a-98ce-96e806163505 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:16.874978 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-1cd1a043-8c7c-4c3a-98ce-96e806163505 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.159395 May 03 09:19:16.876020 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 942/2049] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:16 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:17.405470 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c7ebd961-10a6-4c37-bf6f-468f60f8f4f0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:17.406459 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c7ebd961-10a6-4c37-bf6f-468f60f8f4f0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:17.414519 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c7ebd961-10a6-4c37-bf6f-468f60f8f4f0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:17.414954 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c7ebd961-10a6-4c37-bf6f-468f60f8f4f0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:17.415728 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c7ebd961-10a6-4c37-bf6f-468f60f8f4f0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:17.416193 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c7ebd961-10a6-4c37-bf6f-468f60f8f4f0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:17.486557 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c7ebd961-10a6-4c37-bf6f-468f60f8f4f0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:17.494974 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c7ebd961-10a6-4c37-bf6f-468f60f8f4f0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.096051 May 03 09:19:17.495555 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1108/2050] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:17 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:17.897782 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-986e37ae-24fd-4b7b-972f-7fbfba3bd4ab tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:17.898738 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-986e37ae-24fd-4b7b-972f-7fbfba3bd4ab tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:17.909291 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-986e37ae-24fd-4b7b-972f-7fbfba3bd4ab tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:17.910025 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-986e37ae-24fd-4b7b-972f-7fbfba3bd4ab tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:17.911277 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-986e37ae-24fd-4b7b-972f-7fbfba3bd4ab tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:17.912048 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-986e37ae-24fd-4b7b-972f-7fbfba3bd4ab tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:18.061380 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-986e37ae-24fd-4b7b-972f-7fbfba3bd4ab tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:18.074159 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-986e37ae-24fd-4b7b-972f-7fbfba3bd4ab tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.183267 May 03 09:19:18.074966 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 943/2051] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:17 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:18.516402 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e8e048dd-0b5c-4fcc-b535-e0c5a2aebde0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:18.517280 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e8e048dd-0b5c-4fcc-b535-e0c5a2aebde0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:18.524989 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e8e048dd-0b5c-4fcc-b535-e0c5a2aebde0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:18.525461 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e8e048dd-0b5c-4fcc-b535-e0c5a2aebde0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:18.526267 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e8e048dd-0b5c-4fcc-b535-e0c5a2aebde0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:18.526723 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e8e048dd-0b5c-4fcc-b535-e0c5a2aebde0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:18.590942 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e8e048dd-0b5c-4fcc-b535-e0c5a2aebde0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:18.607000 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e8e048dd-0b5c-4fcc-b535-e0c5a2aebde0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.096899 May 03 09:19:18.607804 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1109/2052] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:18 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:19.098307 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c26d3d66-6a95-4f6a-b7aa-f53d5a21ac5c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:19.099007 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c26d3d66-6a95-4f6a-b7aa-f53d5a21ac5c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:19.107321 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c26d3d66-6a95-4f6a-b7aa-f53d5a21ac5c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:19.107944 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c26d3d66-6a95-4f6a-b7aa-f53d5a21ac5c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:19.108894 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c26d3d66-6a95-4f6a-b7aa-f53d5a21ac5c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:19.109437 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c26d3d66-6a95-4f6a-b7aa-f53d5a21ac5c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:19.244836 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c26d3d66-6a95-4f6a-b7aa-f53d5a21ac5c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:19.257067 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c26d3d66-6a95-4f6a-b7aa-f53d5a21ac5c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.165020 May 03 09:19:19.257865 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 944/2053] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:19 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:19.627999 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-903a9221-9cb2-4859-b279-347a9628dbc9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:19.628860 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-903a9221-9cb2-4859-b279-347a9628dbc9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:19.636316 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-903a9221-9cb2-4859-b279-347a9628dbc9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:19.636316 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-903a9221-9cb2-4859-b279-347a9628dbc9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:19.637046 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-903a9221-9cb2-4859-b279-347a9628dbc9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:19.637500 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-903a9221-9cb2-4859-b279-347a9628dbc9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:19.713636 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-903a9221-9cb2-4859-b279-347a9628dbc9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:19.722766 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-903a9221-9cb2-4859-b279-347a9628dbc9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.101307 May 03 09:19:19.723365 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1110/2054] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:19 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:20.282948 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d005ebfc-3b52-4e19-9bdc-3fed6025992f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:20.284082 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d005ebfc-3b52-4e19-9bdc-3fed6025992f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:20.294825 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d005ebfc-3b52-4e19-9bdc-3fed6025992f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:20.295581 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d005ebfc-3b52-4e19-9bdc-3fed6025992f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:20.296919 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d005ebfc-3b52-4e19-9bdc-3fed6025992f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:20.297633 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d005ebfc-3b52-4e19-9bdc-3fed6025992f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:20.432176 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d005ebfc-3b52-4e19-9bdc-3fed6025992f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:20.440865 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d005ebfc-3b52-4e19-9bdc-3fed6025992f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.164549 May 03 09:19:20.441448 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 945/2055] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:20 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:20.744011 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-44f5307f-f4d9-4923-9dfd-a4bbc987995c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:20.745042 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-44f5307f-f4d9-4923-9dfd-a4bbc987995c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:20.755740 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-44f5307f-f4d9-4923-9dfd-a4bbc987995c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:20.756544 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-44f5307f-f4d9-4923-9dfd-a4bbc987995c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:20.757902 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-44f5307f-f4d9-4923-9dfd-a4bbc987995c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:20.758784 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-44f5307f-f4d9-4923-9dfd-a4bbc987995c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:20.824902 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-44f5307f-f4d9-4923-9dfd-a4bbc987995c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:20.833041 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-44f5307f-f4d9-4923-9dfd-a4bbc987995c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.095470 May 03 09:19:20.833613 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1111/2056] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:20 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:21.465559 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d789c13b-1283-418c-9f35-cd7f6c6d056a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:21.466393 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d789c13b-1283-418c-9f35-cd7f6c6d056a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:21.474573 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d789c13b-1283-418c-9f35-cd7f6c6d056a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:21.475013 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d789c13b-1283-418c-9f35-cd7f6c6d056a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:21.475886 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d789c13b-1283-418c-9f35-cd7f6c6d056a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:21.476322 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d789c13b-1283-418c-9f35-cd7f6c6d056a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:21.612015 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d789c13b-1283-418c-9f35-cd7f6c6d056a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:21.623346 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d789c13b-1283-418c-9f35-cd7f6c6d056a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.162889 May 03 09:19:21.624026 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 946/2057] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:21 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:21.852302 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-6f842896-3a1d-4645-b12b-446d6ba57219 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:21.852881 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-6f842896-3a1d-4645-b12b-446d6ba57219 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:21.859308 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6f842896-3a1d-4645-b12b-446d6ba57219 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:21.859758 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6f842896-3a1d-4645-b12b-446d6ba57219 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:21.860554 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6f842896-3a1d-4645-b12b-446d6ba57219 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:21.860992 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6f842896-3a1d-4645-b12b-446d6ba57219 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:21.925672 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-6f842896-3a1d-4645-b12b-446d6ba57219 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:21.934358 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-6f842896-3a1d-4645-b12b-446d6ba57219 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.086430 May 03 09:19:21.934937 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1112/2058] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:21 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:22.645394 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-3299919e-0e93-4f6e-8fa0-225b2037b514 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:22.646251 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-3299919e-0e93-4f6e-8fa0-225b2037b514 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:22.656999 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3299919e-0e93-4f6e-8fa0-225b2037b514 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:22.657691 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3299919e-0e93-4f6e-8fa0-225b2037b514 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:22.658871 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3299919e-0e93-4f6e-8fa0-225b2037b514 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:22.659523 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3299919e-0e93-4f6e-8fa0-225b2037b514 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:22.805543 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-3299919e-0e93-4f6e-8fa0-225b2037b514 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:22.813897 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-3299919e-0e93-4f6e-8fa0-225b2037b514 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.175164 May 03 09:19:22.814476 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 947/2059] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:22 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:22.955857 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9256c306-8c61-4948-bb53-a146cdb48be7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:22.956745 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9256c306-8c61-4948-bb53-a146cdb48be7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:22.963813 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9256c306-8c61-4948-bb53-a146cdb48be7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:22.964635 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9256c306-8c61-4948-bb53-a146cdb48be7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:22.965391 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9256c306-8c61-4948-bb53-a146cdb48be7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:22.965817 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9256c306-8c61-4948-bb53-a146cdb48be7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:23.036797 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9256c306-8c61-4948-bb53-a146cdb48be7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:23.044763 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9256c306-8c61-4948-bb53-a146cdb48be7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.095602 May 03 09:19:23.045315 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1113/2060] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:22 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:23.836480 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-641b1fae-cd79-44c3-8b34-1f7b75fa567c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:23.837436 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-641b1fae-cd79-44c3-8b34-1f7b75fa567c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:23.848288 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-641b1fae-cd79-44c3-8b34-1f7b75fa567c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:23.849053 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-641b1fae-cd79-44c3-8b34-1f7b75fa567c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:23.850313 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-641b1fae-cd79-44c3-8b34-1f7b75fa567c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:23.851038 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-641b1fae-cd79-44c3-8b34-1f7b75fa567c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:24.062125 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-237009f1-a47f-4af2-ae49-cd501a2f7653 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:24.062760 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-237009f1-a47f-4af2-ae49-cd501a2f7653 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:24.069684 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-237009f1-a47f-4af2-ae49-cd501a2f7653 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:24.070136 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-237009f1-a47f-4af2-ae49-cd501a2f7653 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:24.070919 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-237009f1-a47f-4af2-ae49-cd501a2f7653 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:24.071343 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-237009f1-a47f-4af2-ae49-cd501a2f7653 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:24.226777 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-237009f1-a47f-4af2-ae49-cd501a2f7653 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:24.237770 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-237009f1-a47f-4af2-ae49-cd501a2f7653 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.179327 May 03 09:19:24.238789 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1114/2061] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:24 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:24.284083 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-641b1fae-cd79-44c3-8b34-1f7b75fa567c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:24.292058 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-641b1fae-cd79-44c3-8b34-1f7b75fa567c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.462467 May 03 09:19:24.292628 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 948/2062] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:23 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:25.255460 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3c73fbcb-d45c-4e92-85db-ec6033a0bca5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:25.256076 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-3c73fbcb-d45c-4e92-85db-ec6033a0bca5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:25.262810 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3c73fbcb-d45c-4e92-85db-ec6033a0bca5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:25.263260 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3c73fbcb-d45c-4e92-85db-ec6033a0bca5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:25.264059 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3c73fbcb-d45c-4e92-85db-ec6033a0bca5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:25.264499 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3c73fbcb-d45c-4e92-85db-ec6033a0bca5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:25.309283 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4c5b47e2-f8d2-4d5e-b694-993a43bd461f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:25.309860 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4c5b47e2-f8d2-4d5e-b694-993a43bd461f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:25.316388 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4c5b47e2-f8d2-4d5e-b694-993a43bd461f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:25.316861 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4c5b47e2-f8d2-4d5e-b694-993a43bd461f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:25.317621 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4c5b47e2-f8d2-4d5e-b694-993a43bd461f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:25.318055 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4c5b47e2-f8d2-4d5e-b694-993a43bd461f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:25.329749 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-3c73fbcb-d45c-4e92-85db-ec6033a0bca5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:25.338320 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-3c73fbcb-d45c-4e92-85db-ec6033a0bca5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.086929 May 03 09:19:25.339605 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1115/2063] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:25 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:25.524233 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-4c5b47e2-f8d2-4d5e-b694-993a43bd461f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:25.532451 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-4c5b47e2-f8d2-4d5e-b694-993a43bd461f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.227085 May 03 09:19:25.533027 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 949/2064] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:25 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:19:26.359810 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d0125394-f1ab-4330-a0dc-e1409eea0757 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:26.360774 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d0125394-f1ab-4330-a0dc-e1409eea0757 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:26.370992 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d0125394-f1ab-4330-a0dc-e1409eea0757 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:26.371738 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d0125394-f1ab-4330-a0dc-e1409eea0757 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:26.373033 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d0125394-f1ab-4330-a0dc-e1409eea0757 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:26.373768 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d0125394-f1ab-4330-a0dc-e1409eea0757 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:26.437373 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d0125394-f1ab-4330-a0dc-e1409eea0757 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:26.445525 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d0125394-f1ab-4330-a0dc-e1409eea0757 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.092556 May 03 09:19:26.446083 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1116/2065] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:26 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:26.550961 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-fcb29fb6-5361-402b-898b-b683faee556b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:26.551548 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-fcb29fb6-5361-402b-898b-b683faee556b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:26.558300 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fcb29fb6-5361-402b-898b-b683faee556b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:26.558746 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fcb29fb6-5361-402b-898b-b683faee556b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:26.559509 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fcb29fb6-5361-402b-898b-b683faee556b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:26.559979 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fcb29fb6-5361-402b-898b-b683faee556b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:26.697073 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-fcb29fb6-5361-402b-898b-b683faee556b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:26.705356 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-fcb29fb6-5361-402b-898b-b683faee556b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.158430 May 03 09:19:26.705930 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 950/2066] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:26 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:27.467741 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-4d19eb11-5dfa-4512-9dea-90216d75bb50 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:27.468639 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-4d19eb11-5dfa-4512-9dea-90216d75bb50 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:27.479223 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4d19eb11-5dfa-4512-9dea-90216d75bb50 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:27.480115 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4d19eb11-5dfa-4512-9dea-90216d75bb50 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:27.481387 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4d19eb11-5dfa-4512-9dea-90216d75bb50 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:27.482090 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4d19eb11-5dfa-4512-9dea-90216d75bb50 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:27.547726 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-4d19eb11-5dfa-4512-9dea-90216d75bb50 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:27.559056 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-4d19eb11-5dfa-4512-9dea-90216d75bb50 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.098207 May 03 09:19:27.559646 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1117/2067] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:27 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:27.727011 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ea853b2e-f9b3-42bf-978b-f33daf879c15 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:27.727958 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ea853b2e-f9b3-42bf-978b-f33daf879c15 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:27.738788 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ea853b2e-f9b3-42bf-978b-f33daf879c15 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:27.739243 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ea853b2e-f9b3-42bf-978b-f33daf879c15 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:27.740058 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ea853b2e-f9b3-42bf-978b-f33daf879c15 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:27.740496 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ea853b2e-f9b3-42bf-978b-f33daf879c15 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:27.868531 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ea853b2e-f9b3-42bf-978b-f33daf879c15 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:27.880155 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ea853b2e-f9b3-42bf-978b-f33daf879c15 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.160126 May 03 09:19:27.880733 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 951/2068] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:27 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:28.583569 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-24c10ef6-4f95-403c-93e3-76fe28703620 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:28.586158 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-24c10ef6-4f95-403c-93e3-76fe28703620 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:28.595426 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-24c10ef6-4f95-403c-93e3-76fe28703620 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:28.595907 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-24c10ef6-4f95-403c-93e3-76fe28703620 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:28.596675 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-24c10ef6-4f95-403c-93e3-76fe28703620 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:28.597107 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-24c10ef6-4f95-403c-93e3-76fe28703620 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:28.663126 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-24c10ef6-4f95-403c-93e3-76fe28703620 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:28.675047 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-24c10ef6-4f95-403c-93e3-76fe28703620 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.101001 May 03 09:19:28.675825 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1118/2069] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:28 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:28.902566 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d93d7ea6-06d3-494e-b063-85b54fb37f74 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:28.903546 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d93d7ea6-06d3-494e-b063-85b54fb37f74 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:28.914787 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d93d7ea6-06d3-494e-b063-85b54fb37f74 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:28.914787 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d93d7ea6-06d3-494e-b063-85b54fb37f74 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:28.914787 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d93d7ea6-06d3-494e-b063-85b54fb37f74 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:28.915112 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d93d7ea6-06d3-494e-b063-85b54fb37f74 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:29.056080 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d93d7ea6-06d3-494e-b063-85b54fb37f74 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:29.068060 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d93d7ea6-06d3-494e-b063-85b54fb37f74 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.171994 May 03 09:19:29.068832 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 952/2070] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:28 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:29.700915 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9cb50d97-c0db-40d0-8f0a-0310e1acdbce tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:29.701898 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9cb50d97-c0db-40d0-8f0a-0310e1acdbce tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:29.710931 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9cb50d97-c0db-40d0-8f0a-0310e1acdbce tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:29.711383 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9cb50d97-c0db-40d0-8f0a-0310e1acdbce tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:29.712183 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9cb50d97-c0db-40d0-8f0a-0310e1acdbce tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:29.712622 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9cb50d97-c0db-40d0-8f0a-0310e1acdbce tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:29.776512 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9cb50d97-c0db-40d0-8f0a-0310e1acdbce tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:29.784468 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9cb50d97-c0db-40d0-8f0a-0310e1acdbce tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.090171 May 03 09:19:29.785034 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1119/2071] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:29 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:30.089933 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-24ce9858-f53b-4b9c-a46f-e487015631bc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:30.090741 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-24ce9858-f53b-4b9c-a46f-e487015631bc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:30.100473 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-24ce9858-f53b-4b9c-a46f-e487015631bc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:30.100916 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-24ce9858-f53b-4b9c-a46f-e487015631bc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:30.101671 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-24ce9858-f53b-4b9c-a46f-e487015631bc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:30.102099 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-24ce9858-f53b-4b9c-a46f-e487015631bc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:30.249481 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-24ce9858-f53b-4b9c-a46f-e487015631bc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:30.259034 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-24ce9858-f53b-4b9c-a46f-e487015631bc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.176311 May 03 09:19:30.260029 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 953/2072] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:30 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:30.805652 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-334007bd-df11-4962-9fba-90dbcf1a26f0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:30.806654 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-334007bd-df11-4962-9fba-90dbcf1a26f0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:30.817362 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-334007bd-df11-4962-9fba-90dbcf1a26f0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:30.818098 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-334007bd-df11-4962-9fba-90dbcf1a26f0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:30.819349 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-334007bd-df11-4962-9fba-90dbcf1a26f0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:30.820118 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-334007bd-df11-4962-9fba-90dbcf1a26f0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:30.893506 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-334007bd-df11-4962-9fba-90dbcf1a26f0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:30.901510 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-334007bd-df11-4962-9fba-90dbcf1a26f0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.102492 May 03 09:19:30.902005 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1120/2073] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:30 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:31.281855 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2512510b-bc0d-4960-b7fb-1f27c64ab79f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:31.282894 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-2512510b-bc0d-4960-b7fb-1f27c64ab79f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:31.293915 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2512510b-bc0d-4960-b7fb-1f27c64ab79f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:31.294670 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2512510b-bc0d-4960-b7fb-1f27c64ab79f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:31.296193 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2512510b-bc0d-4960-b7fb-1f27c64ab79f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:31.296906 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2512510b-bc0d-4960-b7fb-1f27c64ab79f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:31.437733 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2512510b-bc0d-4960-b7fb-1f27c64ab79f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:31.446146 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-2512510b-bc0d-4960-b7fb-1f27c64ab79f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.170803 May 03 09:19:31.446726 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 954/2074] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:31 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:31.921888 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-7ef88dba-8892-4ba0-84e8-a77085f348f2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:31.922898 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-7ef88dba-8892-4ba0-84e8-a77085f348f2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:31.933679 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7ef88dba-8892-4ba0-84e8-a77085f348f2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:31.934420 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7ef88dba-8892-4ba0-84e8-a77085f348f2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:31.936324 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7ef88dba-8892-4ba0-84e8-a77085f348f2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:31.937039 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7ef88dba-8892-4ba0-84e8-a77085f348f2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:32.003111 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7ef88dba-8892-4ba0-84e8-a77085f348f2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:32.010812 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-7ef88dba-8892-4ba0-84e8-a77085f348f2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.095564 May 03 09:19:32.011371 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1121/2075] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:31 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:32.463809 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0d4a4125-b5bf-41b5-9ac3-64a56f042a53 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:32.464690 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0d4a4125-b5bf-41b5-9ac3-64a56f042a53 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:32.471505 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0d4a4125-b5bf-41b5-9ac3-64a56f042a53 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:32.472041 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0d4a4125-b5bf-41b5-9ac3-64a56f042a53 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:32.472811 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0d4a4125-b5bf-41b5-9ac3-64a56f042a53 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:32.473310 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0d4a4125-b5bf-41b5-9ac3-64a56f042a53 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:32.602505 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0d4a4125-b5bf-41b5-9ac3-64a56f042a53 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:32.615069 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0d4a4125-b5bf-41b5-9ac3-64a56f042a53 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.155054 May 03 09:19:32.615818 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 955/2076] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:32 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:33.035563 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e7a0007c-843c-44b6-83da-59042e7bc9fa tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:33.036635 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e7a0007c-843c-44b6-83da-59042e7bc9fa tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:33.047383 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e7a0007c-843c-44b6-83da-59042e7bc9fa tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:33.048218 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e7a0007c-843c-44b6-83da-59042e7bc9fa tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:33.049573 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e7a0007c-843c-44b6-83da-59042e7bc9fa tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:33.050298 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e7a0007c-843c-44b6-83da-59042e7bc9fa tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:33.116065 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e7a0007c-843c-44b6-83da-59042e7bc9fa tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:33.128415 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e7a0007c-843c-44b6-83da-59042e7bc9fa tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.099214 May 03 09:19:33.129196 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1122/2077] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:33 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:33.641712 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-fd5057ee-a879-4270-a0df-7ce18551d602 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:33.642701 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-fd5057ee-a879-4270-a0df-7ce18551d602 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:33.650700 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fd5057ee-a879-4270-a0df-7ce18551d602 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:33.651164 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fd5057ee-a879-4270-a0df-7ce18551d602 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:33.652013 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fd5057ee-a879-4270-a0df-7ce18551d602 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:33.652461 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fd5057ee-a879-4270-a0df-7ce18551d602 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:33.798283 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-fd5057ee-a879-4270-a0df-7ce18551d602 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:33.806463 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-fd5057ee-a879-4270-a0df-7ce18551d602 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.171311 May 03 09:19:33.807035 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 956/2078] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:33 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:34.150326 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-682b21e9-ad35-4190-b782-44387ad0cd63 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:34.151299 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-682b21e9-ad35-4190-b782-44387ad0cd63 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:34.161593 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-682b21e9-ad35-4190-b782-44387ad0cd63 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:34.162037 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-682b21e9-ad35-4190-b782-44387ad0cd63 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:34.163024 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-682b21e9-ad35-4190-b782-44387ad0cd63 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:34.163490 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-682b21e9-ad35-4190-b782-44387ad0cd63 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:34.230230 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-682b21e9-ad35-4190-b782-44387ad0cd63 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:34.238243 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-682b21e9-ad35-4190-b782-44387ad0cd63 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.094681 May 03 09:19:34.238934 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1123/2079] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:34 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:34.828232 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-29b5d6f2-4292-4e91-9301-bf6677db661e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:34.829294 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-29b5d6f2-4292-4e91-9301-bf6677db661e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:34.840373 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-29b5d6f2-4292-4e91-9301-bf6677db661e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:34.841109 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-29b5d6f2-4292-4e91-9301-bf6677db661e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:34.842359 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-29b5d6f2-4292-4e91-9301-bf6677db661e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:34.843074 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-29b5d6f2-4292-4e91-9301-bf6677db661e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:34.980863 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-29b5d6f2-4292-4e91-9301-bf6677db661e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:34.988843 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-29b5d6f2-4292-4e91-9301-bf6677db661e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.167191 May 03 09:19:34.989397 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 957/2080] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:34 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:35.254740 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-aaa14237-dad1-43c7-acf2-0e46a86eb2e6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:35.255357 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-aaa14237-dad1-43c7-acf2-0e46a86eb2e6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:35.262531 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-aaa14237-dad1-43c7-acf2-0e46a86eb2e6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:35.262987 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-aaa14237-dad1-43c7-acf2-0e46a86eb2e6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:35.263752 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-aaa14237-dad1-43c7-acf2-0e46a86eb2e6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:35.264235 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-aaa14237-dad1-43c7-acf2-0e46a86eb2e6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:35.328909 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-aaa14237-dad1-43c7-acf2-0e46a86eb2e6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:35.337046 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-aaa14237-dad1-43c7-acf2-0e46a86eb2e6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.086304 May 03 09:19:35.337635 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1124/2081] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:35 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:36.010054 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-37061a73-0b28-4509-91a1-a228a18910aa tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:36.011100 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-37061a73-0b28-4509-91a1-a228a18910aa tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:36.021333 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-37061a73-0b28-4509-91a1-a228a18910aa tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:36.021781 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-37061a73-0b28-4509-91a1-a228a18910aa tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:36.022540 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-37061a73-0b28-4509-91a1-a228a18910aa tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:36.022987 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-37061a73-0b28-4509-91a1-a228a18910aa tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:36.166006 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-37061a73-0b28-4509-91a1-a228a18910aa tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:36.178059 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-37061a73-0b28-4509-91a1-a228a18910aa tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.174366 May 03 09:19:36.178963 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 958/2082] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:36 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:36.361420 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-cc77f131-7aa9-4b02-a78d-2aef6507e074 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:36.362344 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-cc77f131-7aa9-4b02-a78d-2aef6507e074 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:36.373004 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cc77f131-7aa9-4b02-a78d-2aef6507e074 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:36.373750 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cc77f131-7aa9-4b02-a78d-2aef6507e074 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:36.375013 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cc77f131-7aa9-4b02-a78d-2aef6507e074 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:36.375748 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cc77f131-7aa9-4b02-a78d-2aef6507e074 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:36.445715 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-cc77f131-7aa9-4b02-a78d-2aef6507e074 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:36.457747 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-cc77f131-7aa9-4b02-a78d-2aef6507e074 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.102671 May 03 09:19:36.458318 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1125/2083] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:36 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:37.199836 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-61bbfbee-95a8-4a4b-a4a6-af93b3c89868 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:37.200930 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-61bbfbee-95a8-4a4b-a4a6-af93b3c89868 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:37.210387 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-61bbfbee-95a8-4a4b-a4a6-af93b3c89868 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:37.210808 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-61bbfbee-95a8-4a4b-a4a6-af93b3c89868 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:37.211625 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-61bbfbee-95a8-4a4b-a4a6-af93b3c89868 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:37.212090 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-61bbfbee-95a8-4a4b-a4a6-af93b3c89868 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:37.346215 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-61bbfbee-95a8-4a4b-a4a6-af93b3c89868 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:37.354562 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-61bbfbee-95a8-4a4b-a4a6-af93b3c89868 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.161366 May 03 09:19:37.355141 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 959/2084] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:37 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:37.479918 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-be366cfc-4907-4e05-bfb5-f1ce49db89d6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:37.480951 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-be366cfc-4907-4e05-bfb5-f1ce49db89d6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:37.490794 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-be366cfc-4907-4e05-bfb5-f1ce49db89d6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:37.491265 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-be366cfc-4907-4e05-bfb5-f1ce49db89d6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:37.492073 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-be366cfc-4907-4e05-bfb5-f1ce49db89d6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:37.492515 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-be366cfc-4907-4e05-bfb5-f1ce49db89d6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:37.565527 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-be366cfc-4907-4e05-bfb5-f1ce49db89d6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:37.574014 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-be366cfc-4907-4e05-bfb5-f1ce49db89d6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.100804 May 03 09:19:37.574562 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1126/2085] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:37 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:38.372314 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-03a09786-a180-4844-bca2-ff3f5340ad44 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:38.372949 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-03a09786-a180-4844-bca2-ff3f5340ad44 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:38.379856 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-03a09786-a180-4844-bca2-ff3f5340ad44 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:38.380306 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-03a09786-a180-4844-bca2-ff3f5340ad44 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:38.381062 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-03a09786-a180-4844-bca2-ff3f5340ad44 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:38.381490 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-03a09786-a180-4844-bca2-ff3f5340ad44 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:38.516676 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-03a09786-a180-4844-bca2-ff3f5340ad44 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:38.524998 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-03a09786-a180-4844-bca2-ff3f5340ad44 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.156658 May 03 09:19:38.525548 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 960/2086] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:38 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:38.591601 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a2f44b85-3a59-44e2-b2f1-99a2e1c5bcf2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:38.592211 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a2f44b85-3a59-44e2-b2f1-99a2e1c5bcf2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:38.599308 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a2f44b85-3a59-44e2-b2f1-99a2e1c5bcf2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:38.599757 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a2f44b85-3a59-44e2-b2f1-99a2e1c5bcf2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:38.600552 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a2f44b85-3a59-44e2-b2f1-99a2e1c5bcf2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:38.600947 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a2f44b85-3a59-44e2-b2f1-99a2e1c5bcf2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:38.673382 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a2f44b85-3a59-44e2-b2f1-99a2e1c5bcf2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:38.681513 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a2f44b85-3a59-44e2-b2f1-99a2e1c5bcf2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.094199 May 03 09:19:38.682079 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1127/2087] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:38 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:39.552756 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c9a1b774-48c1-4a6b-a3a9-c16e9a464a08 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:39.553665 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c9a1b774-48c1-4a6b-a3a9-c16e9a464a08 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:39.564107 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c9a1b774-48c1-4a6b-a3a9-c16e9a464a08 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:39.564851 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c9a1b774-48c1-4a6b-a3a9-c16e9a464a08 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:39.566124 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c9a1b774-48c1-4a6b-a3a9-c16e9a464a08 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:39.566842 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c9a1b774-48c1-4a6b-a3a9-c16e9a464a08 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:39.698595 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-dee02350-1865-4045-a846-b981739d7c75 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:39.699221 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-dee02350-1865-4045-a846-b981739d7c75 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:39.705877 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dee02350-1865-4045-a846-b981739d7c75 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:39.706383 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dee02350-1865-4045-a846-b981739d7c75 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:39.707142 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dee02350-1865-4045-a846-b981739d7c75 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:39.707663 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dee02350-1865-4045-a846-b981739d7c75 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:39.712142 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c9a1b774-48c1-4a6b-a3a9-c16e9a464a08 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:39.720830 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c9a1b774-48c1-4a6b-a3a9-c16e9a464a08 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.174897 May 03 09:19:39.721743 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 961/2088] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:39 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:39.769053 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-dee02350-1865-4045-a846-b981739d7c75 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:39.777135 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-dee02350-1865-4045-a846-b981739d7c75 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.082506 May 03 09:19:39.777924 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1128/2089] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:39 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:40.742440 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-be0fa695-395b-4480-82d9-9e79c51c17a2 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:40.743429 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-be0fa695-395b-4480-82d9-9e79c51c17a2 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:40.754030 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-be0fa695-395b-4480-82d9-9e79c51c17a2 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:40.754732 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-be0fa695-395b-4480-82d9-9e79c51c17a2 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:40.755489 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-be0fa695-395b-4480-82d9-9e79c51c17a2 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:40.755954 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-be0fa695-395b-4480-82d9-9e79c51c17a2 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:40.796942 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-962396b1-d9f0-4c7a-8644-df27646d8c2b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:40.797681 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-962396b1-d9f0-4c7a-8644-df27646d8c2b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:40.807358 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-962396b1-d9f0-4c7a-8644-df27646d8c2b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:40.808191 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-962396b1-d9f0-4c7a-8644-df27646d8c2b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:40.809235 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-962396b1-d9f0-4c7a-8644-df27646d8c2b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:40.809782 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-962396b1-d9f0-4c7a-8644-df27646d8c2b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:40.885504 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-962396b1-d9f0-4c7a-8644-df27646d8c2b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:40.893518 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-962396b1-d9f0-4c7a-8644-df27646d8c2b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.102682 May 03 09:19:40.894095 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1129/2090] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:40 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:40.920352 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-be0fa695-395b-4480-82d9-9e79c51c17a2 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:40.928840 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-be0fa695-395b-4480-82d9-9e79c51c17a2 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.192925 May 03 09:19:40.929412 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 962/2091] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:40 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:41.919119 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-59be6691-526f-4457-af48-54e77bf37e31 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:41.920130 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-59be6691-526f-4457-af48-54e77bf37e31 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:41.929359 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-59be6691-526f-4457-af48-54e77bf37e31 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:41.929812 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-59be6691-526f-4457-af48-54e77bf37e31 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:41.930575 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-59be6691-526f-4457-af48-54e77bf37e31 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:41.931011 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-59be6691-526f-4457-af48-54e77bf37e31 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:41.946527 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-538b67d7-59f9-477a-9d05-3cf0990acd09 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:41.947173 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-538b67d7-59f9-477a-9d05-3cf0990acd09 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:41.953829 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-538b67d7-59f9-477a-9d05-3cf0990acd09 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:41.954278 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-538b67d7-59f9-477a-9d05-3cf0990acd09 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:41.955032 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-538b67d7-59f9-477a-9d05-3cf0990acd09 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:41.955471 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-538b67d7-59f9-477a-9d05-3cf0990acd09 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:42.003949 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-59be6691-526f-4457-af48-54e77bf37e31 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:42.012741 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-59be6691-526f-4457-af48-54e77bf37e31 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.100064 May 03 09:19:42.013363 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1130/2092] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:41 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:42.087568 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-538b67d7-59f9-477a-9d05-3cf0990acd09 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:42.096460 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-538b67d7-59f9-477a-9d05-3cf0990acd09 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.153845 May 03 09:19:42.097036 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 963/2093] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:41 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:43.034402 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c85e63a5-aa0a-4149-889d-12f056bb0088 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:43.035289 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c85e63a5-aa0a-4149-889d-12f056bb0088 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:43.043453 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c85e63a5-aa0a-4149-889d-12f056bb0088 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:43.043991 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c85e63a5-aa0a-4149-889d-12f056bb0088 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:43.044833 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c85e63a5-aa0a-4149-889d-12f056bb0088 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:43.045482 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c85e63a5-aa0a-4149-889d-12f056bb0088 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:43.113341 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c85e63a5-aa0a-4149-889d-12f056bb0088 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:43.114058 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d5880844-c28d-4d88-bea1-68566c435031 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:43.114678 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d5880844-c28d-4d88-bea1-68566c435031 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:43.121336 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d5880844-c28d-4d88-bea1-68566c435031 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:43.121760 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c85e63a5-aa0a-4149-889d-12f056bb0088 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.093981 May 03 09:19:43.121929 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d5880844-c28d-4d88-bea1-68566c435031 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:43.122306 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1131/2094] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:43 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:43.122555 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d5880844-c28d-4d88-bea1-68566c435031 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:43.122990 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d5880844-c28d-4d88-bea1-68566c435031 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:43.260952 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d5880844-c28d-4d88-bea1-68566c435031 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:43.269687 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d5880844-c28d-4d88-bea1-68566c435031 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.159557 May 03 09:19:43.270261 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 964/2095] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:43 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:44.142225 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-86492032-c56d-4cf5-bf74-595b8dbc7c16 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:44.143361 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-86492032-c56d-4cf5-bf74-595b8dbc7c16 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:44.151637 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-86492032-c56d-4cf5-bf74-595b8dbc7c16 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:44.152189 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-86492032-c56d-4cf5-bf74-595b8dbc7c16 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:44.152963 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-86492032-c56d-4cf5-bf74-595b8dbc7c16 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:44.153398 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-86492032-c56d-4cf5-bf74-595b8dbc7c16 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:44.222783 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-86492032-c56d-4cf5-bf74-595b8dbc7c16 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:44.231231 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-86492032-c56d-4cf5-bf74-595b8dbc7c16 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.095644 May 03 09:19:44.231786 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1132/2096] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:44 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:44.294443 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5b1a5145-450c-4be3-8d0e-8cd50f9e9176 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:44.295450 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5b1a5145-450c-4be3-8d0e-8cd50f9e9176 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:44.306237 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5b1a5145-450c-4be3-8d0e-8cd50f9e9176 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:44.306975 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5b1a5145-450c-4be3-8d0e-8cd50f9e9176 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:44.308599 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5b1a5145-450c-4be3-8d0e-8cd50f9e9176 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:44.309887 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5b1a5145-450c-4be3-8d0e-8cd50f9e9176 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:44.459692 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5b1a5145-450c-4be3-8d0e-8cd50f9e9176 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:44.468081 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5b1a5145-450c-4be3-8d0e-8cd50f9e9176 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.180128 May 03 09:19:44.468630 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 965/2097] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:44 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:45.248699 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-cda2abed-cd66-4e8a-8ce2-a3e57d045cab tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:45.249314 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-cda2abed-cd66-4e8a-8ce2-a3e57d045cab tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:45.256078 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cda2abed-cd66-4e8a-8ce2-a3e57d045cab tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:45.256536 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cda2abed-cd66-4e8a-8ce2-a3e57d045cab tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:45.257321 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cda2abed-cd66-4e8a-8ce2-a3e57d045cab tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:45.257752 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cda2abed-cd66-4e8a-8ce2-a3e57d045cab tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:45.329799 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-cda2abed-cd66-4e8a-8ce2-a3e57d045cab tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:45.342209 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-cda2abed-cd66-4e8a-8ce2-a3e57d045cab tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.097225 May 03 09:19:45.343016 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1133/2098] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:45 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:45.489866 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a0c6c877-782e-4e75-acfa-2d2073320cf1 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:45.490726 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a0c6c877-782e-4e75-acfa-2d2073320cf1 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:45.497934 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a0c6c877-782e-4e75-acfa-2d2073320cf1 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:45.498382 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a0c6c877-782e-4e75-acfa-2d2073320cf1 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:45.499148 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a0c6c877-782e-4e75-acfa-2d2073320cf1 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:45.499608 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a0c6c877-782e-4e75-acfa-2d2073320cf1 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:45.629030 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a0c6c877-782e-4e75-acfa-2d2073320cf1 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:45.636994 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a0c6c877-782e-4e75-acfa-2d2073320cf1 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.153887 May 03 09:19:45.637576 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 966/2099] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:45 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:46.362917 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-627b5f23-dbcc-4a36-bede-5ca46ba084c0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:46.363491 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-627b5f23-dbcc-4a36-bede-5ca46ba084c0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:46.370444 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-627b5f23-dbcc-4a36-bede-5ca46ba084c0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:46.370908 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-627b5f23-dbcc-4a36-bede-5ca46ba084c0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:46.371711 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-627b5f23-dbcc-4a36-bede-5ca46ba084c0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:46.372189 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-627b5f23-dbcc-4a36-bede-5ca46ba084c0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:46.446452 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-627b5f23-dbcc-4a36-bede-5ca46ba084c0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:46.455045 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-627b5f23-dbcc-4a36-bede-5ca46ba084c0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.096150 May 03 09:19:46.455625 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1134/2100] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:46 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:46.659068 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f83c5c29-4291-408e-a60f-b4021caf8646 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:46.662176 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f83c5c29-4291-408e-a60f-b4021caf8646 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:46.669139 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f83c5c29-4291-408e-a60f-b4021caf8646 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:46.669587 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f83c5c29-4291-408e-a60f-b4021caf8646 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:46.670349 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f83c5c29-4291-408e-a60f-b4021caf8646 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:46.670783 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f83c5c29-4291-408e-a60f-b4021caf8646 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:46.812227 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f83c5c29-4291-408e-a60f-b4021caf8646 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:46.821041 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f83c5c29-4291-408e-a60f-b4021caf8646 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.169101 May 03 09:19:46.821630 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 967/2101] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:46 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:47.476758 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b6af635a-dbdb-4ac4-ae99-dd392fa90913 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:47.477461 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b6af635a-dbdb-4ac4-ae99-dd392fa90913 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:47.485757 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b6af635a-dbdb-4ac4-ae99-dd392fa90913 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:47.486319 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b6af635a-dbdb-4ac4-ae99-dd392fa90913 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:47.487271 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b6af635a-dbdb-4ac4-ae99-dd392fa90913 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:47.487813 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b6af635a-dbdb-4ac4-ae99-dd392fa90913 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:47.552783 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b6af635a-dbdb-4ac4-ae99-dd392fa90913 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:47.561069 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b6af635a-dbdb-4ac4-ae99-dd392fa90913 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.090931 May 03 09:19:47.561639 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1135/2102] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:47 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:47.843357 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c4b5c3f2-16df-4bf1-978e-9bf4ce08dc55 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:47.844253 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c4b5c3f2-16df-4bf1-978e-9bf4ce08dc55 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:47.854918 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c4b5c3f2-16df-4bf1-978e-9bf4ce08dc55 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:47.855667 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c4b5c3f2-16df-4bf1-978e-9bf4ce08dc55 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:47.857197 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c4b5c3f2-16df-4bf1-978e-9bf4ce08dc55 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:47.857931 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c4b5c3f2-16df-4bf1-978e-9bf4ce08dc55 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:47.998237 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c4b5c3f2-16df-4bf1-978e-9bf4ce08dc55 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:48.006440 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c4b5c3f2-16df-4bf1-978e-9bf4ce08dc55 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.170146 May 03 09:19:48.007045 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 968/2103] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:47 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:48.582792 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-1c8c764a-7c0d-4b13-a92c-1d7d10ae4e23 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:48.583736 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-1c8c764a-7c0d-4b13-a92c-1d7d10ae4e23 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:48.591934 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1c8c764a-7c0d-4b13-a92c-1d7d10ae4e23 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:48.592411 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1c8c764a-7c0d-4b13-a92c-1d7d10ae4e23 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:48.593223 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1c8c764a-7c0d-4b13-a92c-1d7d10ae4e23 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:48.593681 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1c8c764a-7c0d-4b13-a92c-1d7d10ae4e23 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:48.663576 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-1c8c764a-7c0d-4b13-a92c-1d7d10ae4e23 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:48.672198 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-1c8c764a-7c0d-4b13-a92c-1d7d10ae4e23 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.096439 May 03 09:19:48.672771 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1136/2104] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:48 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:49.027297 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e7cfe696-4e15-4331-b3ef-bdfda45776cd tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:49.028287 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e7cfe696-4e15-4331-b3ef-bdfda45776cd tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:49.038963 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e7cfe696-4e15-4331-b3ef-bdfda45776cd tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:49.039401 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e7cfe696-4e15-4331-b3ef-bdfda45776cd tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:49.040206 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e7cfe696-4e15-4331-b3ef-bdfda45776cd tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:49.040638 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e7cfe696-4e15-4331-b3ef-bdfda45776cd tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:49.187293 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e7cfe696-4e15-4331-b3ef-bdfda45776cd tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:49.200909 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e7cfe696-4e15-4331-b3ef-bdfda45776cd tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.180175 May 03 09:19:49.201611 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 969/2105] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:49 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:49.693699 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d7edce3e-d9df-44bf-aff3-29e21ce3812b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:49.694780 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d7edce3e-d9df-44bf-aff3-29e21ce3812b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:49.701514 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d7edce3e-d9df-44bf-aff3-29e21ce3812b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:49.701965 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d7edce3e-d9df-44bf-aff3-29e21ce3812b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:49.702730 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d7edce3e-d9df-44bf-aff3-29e21ce3812b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:49.703216 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d7edce3e-d9df-44bf-aff3-29e21ce3812b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:49.770395 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d7edce3e-d9df-44bf-aff3-29e21ce3812b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:49.787472 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d7edce3e-d9df-44bf-aff3-29e21ce3812b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.100181 May 03 09:19:49.788389 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1137/2106] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:49 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:50.219048 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6a7aecf5-f51e-4cd9-a6ce-b489be4ad7bb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:50.219704 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6a7aecf5-f51e-4cd9-a6ce-b489be4ad7bb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:50.226580 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6a7aecf5-f51e-4cd9-a6ce-b489be4ad7bb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:50.227031 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6a7aecf5-f51e-4cd9-a6ce-b489be4ad7bb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:50.227806 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6a7aecf5-f51e-4cd9-a6ce-b489be4ad7bb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:50.228274 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6a7aecf5-f51e-4cd9-a6ce-b489be4ad7bb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:50.364414 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6a7aecf5-f51e-4cd9-a6ce-b489be4ad7bb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:50.372643 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6a7aecf5-f51e-4cd9-a6ce-b489be4ad7bb tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.157544 May 03 09:19:50.373217 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 970/2107] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:50 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:50.813869 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-7f4e3f9b-57cf-4df8-b96a-043cbd31392e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:50.814875 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-7f4e3f9b-57cf-4df8-b96a-043cbd31392e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:50.825500 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7f4e3f9b-57cf-4df8-b96a-043cbd31392e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:50.826245 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7f4e3f9b-57cf-4df8-b96a-043cbd31392e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:50.827484 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7f4e3f9b-57cf-4df8-b96a-043cbd31392e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:50.828244 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7f4e3f9b-57cf-4df8-b96a-043cbd31392e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:50.892103 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7f4e3f9b-57cf-4df8-b96a-043cbd31392e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:50.900116 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-7f4e3f9b-57cf-4df8-b96a-043cbd31392e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.092923 May 03 09:19:50.900671 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1138/2108] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:50 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:51.394271 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7e79ea97-ba99-4e7a-9b02-19019d6d54a8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:51.395317 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7e79ea97-ba99-4e7a-9b02-19019d6d54a8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:51.402954 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7e79ea97-ba99-4e7a-9b02-19019d6d54a8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:51.403392 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7e79ea97-ba99-4e7a-9b02-19019d6d54a8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:51.404187 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7e79ea97-ba99-4e7a-9b02-19019d6d54a8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:51.404613 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7e79ea97-ba99-4e7a-9b02-19019d6d54a8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:51.555230 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7e79ea97-ba99-4e7a-9b02-19019d6d54a8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:51.563876 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7e79ea97-ba99-4e7a-9b02-19019d6d54a8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.176609 May 03 09:19:51.564461 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 971/2109] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:51 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:51.921371 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5b5ae365-3544-4227-9304-504f775a81e7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:51.922302 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5b5ae365-3544-4227-9304-504f775a81e7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:51.933252 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5b5ae365-3544-4227-9304-504f775a81e7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:51.934045 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5b5ae365-3544-4227-9304-504f775a81e7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:51.935314 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5b5ae365-3544-4227-9304-504f775a81e7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:51.936101 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5b5ae365-3544-4227-9304-504f775a81e7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:52.004037 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5b5ae365-3544-4227-9304-504f775a81e7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:52.012296 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5b5ae365-3544-4227-9304-504f775a81e7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.097544 May 03 09:19:52.012875 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1139/2110] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:51 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:52.585796 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d464e93d-f6a4-420a-b661-52136e633a41 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:52.586671 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d464e93d-f6a4-420a-b661-52136e633a41 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:52.597708 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d464e93d-f6a4-420a-b661-52136e633a41 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:52.598440 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d464e93d-f6a4-420a-b661-52136e633a41 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:52.599691 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d464e93d-f6a4-420a-b661-52136e633a41 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:52.600442 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d464e93d-f6a4-420a-b661-52136e633a41 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:52.728651 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d464e93d-f6a4-420a-b661-52136e633a41 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:52.737237 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d464e93d-f6a4-420a-b661-52136e633a41 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.158105 May 03 09:19:52.737761 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 972/2111] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:52 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:53.033322 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-49277320-4931-4674-96d1-a9bfe36b95a3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:53.034283 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-49277320-4931-4674-96d1-a9bfe36b95a3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:53.045072 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-49277320-4931-4674-96d1-a9bfe36b95a3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:53.045819 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-49277320-4931-4674-96d1-a9bfe36b95a3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:53.047076 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-49277320-4931-4674-96d1-a9bfe36b95a3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:53.047839 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-49277320-4931-4674-96d1-a9bfe36b95a3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:53.133901 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-49277320-4931-4674-96d1-a9bfe36b95a3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:53.145934 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-49277320-4931-4674-96d1-a9bfe36b95a3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.118815 May 03 09:19:53.146711 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1140/2112] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:53 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:53.764382 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-133ae85c-f846-401d-8c51-9796ec9df3b1 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:53.765324 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-133ae85c-f846-401d-8c51-9796ec9df3b1 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:53.774632 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-133ae85c-f846-401d-8c51-9796ec9df3b1 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:53.775080 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-133ae85c-f846-401d-8c51-9796ec9df3b1 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:53.775838 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-133ae85c-f846-401d-8c51-9796ec9df3b1 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:53.776295 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-133ae85c-f846-401d-8c51-9796ec9df3b1 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:53.915879 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-133ae85c-f846-401d-8c51-9796ec9df3b1 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:53.924223 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-133ae85c-f846-401d-8c51-9796ec9df3b1 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.166655 May 03 09:19:53.924836 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 973/2113] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:53 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:54.167539 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b4391f6d-903b-45bb-9b0e-8d9475252e26 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:54.168632 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b4391f6d-903b-45bb-9b0e-8d9475252e26 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:54.179281 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b4391f6d-903b-45bb-9b0e-8d9475252e26 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:54.180084 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b4391f6d-903b-45bb-9b0e-8d9475252e26 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:54.181342 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b4391f6d-903b-45bb-9b0e-8d9475252e26 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:54.182055 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b4391f6d-903b-45bb-9b0e-8d9475252e26 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:54.249157 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b4391f6d-903b-45bb-9b0e-8d9475252e26 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:54.257015 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b4391f6d-903b-45bb-9b0e-8d9475252e26 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.096031 May 03 09:19:54.257971 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1141/2114] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:54 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:54.640665 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5f7fb534-c4d4-4d9a-9d9e-c0a8b5885201 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:54.641207 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5f7fb534-c4d4-4d9a-9d9e-c0a8b5885201 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: 2dbd7241-ce49-4617-9aad-57a39f136403] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:54.647102 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5f7fb534-c4d4-4d9a-9d9e-c0a8b5885201 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:54.647541 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5f7fb534-c4d4-4d9a-9d9e-c0a8b5885201 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:54.648399 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5f7fb534-c4d4-4d9a-9d9e-c0a8b5885201 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:54.648826 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5f7fb534-c4d4-4d9a-9d9e-c0a8b5885201 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:54.673693 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5f7fb534-c4d4-4d9a-9d9e-c0a8b5885201 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: 2dbd7241-ce49-4617-9aad-57a39f136403] Going to try to terminate instance {{(pid=123392) delete /opt/stack/nova/nova/compute/api.py:2664}} May 03 09:19:54.754447 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5f7fb534-c4d4-4d9a-9d9e-c0a8b5885201 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "DELETE /compute/v2.1/servers/2dbd7241-ce49-4617-9aad-57a39f136403" status: 204 len: 0 microversion: 2.20 time: 0.182950 May 03 09:19:54.755473 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 974/2115] 10.222.0.11 () {60 vars in 1279 bytes} [Tue May 3 09:19:54 2022] DELETE /compute/v2.1/servers/2dbd7241-ce49-4617-9aad-57a39f136403 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 03 09:19:54.763847 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f32d39a9-5623-401c-9aeb-75d460225463 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:54.764463 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f32d39a9-5623-401c-9aeb-75d460225463 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: 2dbd7241-ce49-4617-9aad-57a39f136403] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:54.770257 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f32d39a9-5623-401c-9aeb-75d460225463 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:54.770700 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f32d39a9-5623-401c-9aeb-75d460225463 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:54.771473 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f32d39a9-5623-401c-9aeb-75d460225463 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:54.771934 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f32d39a9-5623-401c-9aeb-75d460225463 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:54.899638 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f32d39a9-5623-401c-9aeb-75d460225463 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:54.907461 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f32d39a9-5623-401c-9aeb-75d460225463 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:54.908997 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f32d39a9-5623-401c-9aeb-75d460225463 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:54.910166 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f32d39a9-5623-401c-9aeb-75d460225463 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/2dbd7241-ce49-4617-9aad-57a39f136403" status: 200 len: 1722 microversion: 2.20 time: 0.150326 May 03 09:19:54.910723 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1142/2116] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:19:54 2022] GET /compute/v2.1/servers/2dbd7241-ce49-4617-9aad-57a39f136403 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:19:54.942579 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6168a902-186a-4709-836f-481f85ad68ce tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:54.943289 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6168a902-186a-4709-836f-481f85ad68ce tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:54.950171 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6168a902-186a-4709-836f-481f85ad68ce tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:54.950617 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6168a902-186a-4709-836f-481f85ad68ce tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:54.951385 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6168a902-186a-4709-836f-481f85ad68ce tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:54.951846 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6168a902-186a-4709-836f-481f85ad68ce tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:55.108449 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6168a902-186a-4709-836f-481f85ad68ce tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:55.117793 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6168a902-186a-4709-836f-481f85ad68ce tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.179532 May 03 09:19:55.118354 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 975/2117] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:54 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:55.275744 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-cf90d4e2-0b61-496a-8313-b27ecd7d1d29 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:55.276495 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-cf90d4e2-0b61-496a-8313-b27ecd7d1d29 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:55.284238 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cf90d4e2-0b61-496a-8313-b27ecd7d1d29 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:55.284768 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cf90d4e2-0b61-496a-8313-b27ecd7d1d29 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:55.285652 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cf90d4e2-0b61-496a-8313-b27ecd7d1d29 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:55.286153 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cf90d4e2-0b61-496a-8313-b27ecd7d1d29 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:55.354709 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-cf90d4e2-0b61-496a-8313-b27ecd7d1d29 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:55.363082 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-cf90d4e2-0b61-496a-8313-b27ecd7d1d29 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.092101 May 03 09:19:55.363657 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1143/2118] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:55 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:55.930476 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5c029f6d-ff8c-4bc2-a286-7dc9f7b8a645 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:55.931080 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5c029f6d-ff8c-4bc2-a286-7dc9f7b8a645 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: 2dbd7241-ce49-4617-9aad-57a39f136403] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:55.937907 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5c029f6d-ff8c-4bc2-a286-7dc9f7b8a645 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:55.938357 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5c029f6d-ff8c-4bc2-a286-7dc9f7b8a645 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:55.939126 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5c029f6d-ff8c-4bc2-a286-7dc9f7b8a645 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:55.939562 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5c029f6d-ff8c-4bc2-a286-7dc9f7b8a645 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:56.072096 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5c029f6d-ff8c-4bc2-a286-7dc9f7b8a645 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:56.083858 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5c029f6d-ff8c-4bc2-a286-7dc9f7b8a645 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:56.085988 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5c029f6d-ff8c-4bc2-a286-7dc9f7b8a645 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:56.087163 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5c029f6d-ff8c-4bc2-a286-7dc9f7b8a645 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/2dbd7241-ce49-4617-9aad-57a39f136403" status: 200 len: 1722 microversion: 2.20 time: 0.162112 May 03 09:19:56.087734 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 976/2119] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:19:55 2022] GET /compute/v2.1/servers/2dbd7241-ce49-4617-9aad-57a39f136403 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 09:19:56.135759 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ab2fd824-f174-4826-ac4d-74e279fa22f0 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:56.136388 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ab2fd824-f174-4826-ac4d-74e279fa22f0 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:56.143638 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ab2fd824-f174-4826-ac4d-74e279fa22f0 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:56.144480 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ab2fd824-f174-4826-ac4d-74e279fa22f0 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:56.145930 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ab2fd824-f174-4826-ac4d-74e279fa22f0 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:56.146716 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ab2fd824-f174-4826-ac4d-74e279fa22f0 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:56.284927 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ab2fd824-f174-4826-ac4d-74e279fa22f0 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:56.293737 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ab2fd824-f174-4826-ac4d-74e279fa22f0 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.161920 May 03 09:19:56.294327 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1144/2120] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:56 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:19:56.380736 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0ee540d2-9171-4c37-9fb1-700d4af7aa42 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:56.381383 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0ee540d2-9171-4c37-9fb1-700d4af7aa42 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:56.388174 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0ee540d2-9171-4c37-9fb1-700d4af7aa42 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:56.388618 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0ee540d2-9171-4c37-9fb1-700d4af7aa42 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:56.389396 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0ee540d2-9171-4c37-9fb1-700d4af7aa42 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:56.389821 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0ee540d2-9171-4c37-9fb1-700d4af7aa42 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:56.453721 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0ee540d2-9171-4c37-9fb1-700d4af7aa42 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:56.462585 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0ee540d2-9171-4c37-9fb1-700d4af7aa42 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.085766 May 03 09:19:56.463173 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 977/2121] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:56 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:57.106235 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b0623ebf-8276-4bc2-857e-2404037c1a5e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:57.106843 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b0623ebf-8276-4bc2-857e-2404037c1a5e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: 2dbd7241-ce49-4617-9aad-57a39f136403] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:57.112759 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b0623ebf-8276-4bc2-857e-2404037c1a5e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:57.113207 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b0623ebf-8276-4bc2-857e-2404037c1a5e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:57.113966 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b0623ebf-8276-4bc2-857e-2404037c1a5e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:57.114396 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b0623ebf-8276-4bc2-857e-2404037c1a5e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:57.179900 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b0623ebf-8276-4bc2-857e-2404037c1a5e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:57.188582 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b0623ebf-8276-4bc2-857e-2404037c1a5e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:57.190243 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b0623ebf-8276-4bc2-857e-2404037c1a5e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:57.191463 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b0623ebf-8276-4bc2-857e-2404037c1a5e tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/2dbd7241-ce49-4617-9aad-57a39f136403" status: 200 len: 1654 microversion: 2.20 time: 0.089247 May 03 09:19:57.199587 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1145/2122] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:19:57 2022] GET /compute/v2.1/servers/2dbd7241-ce49-4617-9aad-57a39f136403 => generated 1654 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 09:19:57.268775 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-4777d553-51ab-4140-97b3-ad2159c32ce8 req-2ad55e73-8c18-4d21-a7a2-f8fc78418e44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dbd7241-ce49-4617-9aad-57a39f136403", "name": "network-vif-deleted", "tag": "3390c222-09ae-4629-b4d7-4e4001985505"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:19:57.279472 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-4777d553-51ab-4140-97b3-ad2159c32ce8 req-2ad55e73-8c18-4d21-a7a2-f8fc78418e44 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:57.280086 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-4777d553-51ab-4140-97b3-ad2159c32ce8 req-2ad55e73-8c18-4d21-a7a2-f8fc78418e44 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:57.292753 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-4777d553-51ab-4140-97b3-ad2159c32ce8 req-2ad55e73-8c18-4d21-a7a2-f8fc78418e44 service nova] Creating event network-vif-deleted:3390c222-09ae-4629-b4d7-4e4001985505 for instance 2dbd7241-ce49-4617-9aad-57a39f136403 on hv-cinder-84027 May 03 09:19:57.299072 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-4777d553-51ab-4140-97b3-ad2159c32ce8 req-2ad55e73-8c18-4d21-a7a2-f8fc78418e44 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034669 May 03 09:19:57.300363 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 978/2123] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:19:57.311858 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-2ae7aeca-cd2a-4757-86e0-e2b250cbcd75 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:57.313854 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-2ae7aeca-cd2a-4757-86e0-e2b250cbcd75 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:57.320269 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2ae7aeca-cd2a-4757-86e0-e2b250cbcd75 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:57.321451 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2ae7aeca-cd2a-4757-86e0-e2b250cbcd75 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:57.322467 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2ae7aeca-cd2a-4757-86e0-e2b250cbcd75 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:57.323075 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2ae7aeca-cd2a-4757-86e0-e2b250cbcd75 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:57.480745 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-68d7a902-8b91-4dd7-8522-36906cd71b33 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:57.481432 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-68d7a902-8b91-4dd7-8522-36906cd71b33 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:57.481804 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-2ae7aeca-cd2a-4757-86e0-e2b250cbcd75 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:57.487927 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-68d7a902-8b91-4dd7-8522-36906cd71b33 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:57.488456 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-68d7a902-8b91-4dd7-8522-36906cd71b33 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:57.489141 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-68d7a902-8b91-4dd7-8522-36906cd71b33 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:57.489583 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-68d7a902-8b91-4dd7-8522-36906cd71b33 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:57.491324 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-2ae7aeca-cd2a-4757-86e0-e2b250cbcd75 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.184445 May 03 09:19:57.492788 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1146/2124] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:57 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:57.560904 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-68d7a902-8b91-4dd7-8522-36906cd71b33 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:57.569920 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-68d7a902-8b91-4dd7-8522-36906cd71b33 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.093486 May 03 09:19:57.570529 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 979/2125] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:57 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:19:58.210052 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b0dd4976-47de-4fab-96d0-6f2fc6120692 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:58.210821 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b0dd4976-47de-4fab-96d0-6f2fc6120692 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: 2dbd7241-ce49-4617-9aad-57a39f136403] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:58.218050 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b0dd4976-47de-4fab-96d0-6f2fc6120692 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:58.218510 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b0dd4976-47de-4fab-96d0-6f2fc6120692 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:58.219266 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b0dd4976-47de-4fab-96d0-6f2fc6120692 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:58.219697 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b0dd4976-47de-4fab-96d0-6f2fc6120692 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:58.235299 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.wsgi [None req-b0dd4976-47de-4fab-96d0-6f2fc6120692 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] HTTP exception thrown: Instance 2dbd7241-ce49-4617-9aad-57a39f136403 could not be found. May 03 09:19:58.235910 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b0dd4976-47de-4fab-96d0-6f2fc6120692 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Returning 404 to user: Instance 2dbd7241-ce49-4617-9aad-57a39f136403 could not be found. {{(pid=123391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 09:19:58.236749 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b0dd4976-47de-4fab-96d0-6f2fc6120692 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/2dbd7241-ce49-4617-9aad-57a39f136403" status: 404 len: 111 microversion: 2.20 time: 0.030786 May 03 09:19:58.237288 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1147/2126] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:19:58 2022] GET /compute/v2.1/servers/2dbd7241-ce49-4617-9aad-57a39f136403 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 03 09:19:58.245884 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6e00d811-ecd6-423d-a6e3-7b2dc344dbfb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '.version_select at 0x7f09cf9f3670>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:58.265616 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6e00d811-ecd6-423d-a6e3-7b2dc344dbfb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-3140678" status: 204 len: 0 microversion: 2.20 time: 0.023584 May 03 09:19:58.266352 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 980/2127] 10.222.0.11 () {60 vars in 1252 bytes} [Tue May 3 09:19:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-3140678 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 03 09:19:58.508830 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-91966ab7-7d3a-4085-89d4-a47181c5330e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:58.509478 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-91966ab7-7d3a-4085-89d4-a47181c5330e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:58.515596 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-91966ab7-7d3a-4085-89d4-a47181c5330e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:58.516154 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-91966ab7-7d3a-4085-89d4-a47181c5330e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:58.516933 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-91966ab7-7d3a-4085-89d4-a47181c5330e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:58.517406 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-91966ab7-7d3a-4085-89d4-a47181c5330e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:58.586772 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f61abbdc-a3bd-4d3a-ad22-36890cb88cd3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:58.587412 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f61abbdc-a3bd-4d3a-ad22-36890cb88cd3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:58.594587 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f61abbdc-a3bd-4d3a-ad22-36890cb88cd3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:58.595237 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f61abbdc-a3bd-4d3a-ad22-36890cb88cd3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:58.595832 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f61abbdc-a3bd-4d3a-ad22-36890cb88cd3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:58.596277 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f61abbdc-a3bd-4d3a-ad22-36890cb88cd3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:58.669821 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f61abbdc-a3bd-4d3a-ad22-36890cb88cd3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:58.673952 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-91966ab7-7d3a-4085-89d4-a47181c5330e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:58.679232 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f61abbdc-a3bd-4d3a-ad22-36890cb88cd3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.096280 May 03 09:19:58.679899 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 981/2128] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:58 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:19:58.691102 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-91966ab7-7d3a-4085-89d4-a47181c5330e tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.186275 May 03 09:19:58.691963 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1148/2129] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:58 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:58.903176 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-fd77a4c5-c2a7-4ae9-bd05-9a841bfcfb34 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:58.903669 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-fd77a4c5-c2a7-4ae9-bd05-9a841bfcfb34 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: 2dbd7241-ce49-4617-9aad-57a39f136403] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:58.909943 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fd77a4c5-c2a7-4ae9-bd05-9a841bfcfb34 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:58.910382 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fd77a4c5-c2a7-4ae9-bd05-9a841bfcfb34 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:58.911145 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fd77a4c5-c2a7-4ae9-bd05-9a841bfcfb34 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:58.911580 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fd77a4c5-c2a7-4ae9-bd05-9a841bfcfb34 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:58.924788 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-fd77a4c5-c2a7-4ae9-bd05-9a841bfcfb34 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] HTTP exception thrown: Instance 2dbd7241-ce49-4617-9aad-57a39f136403 could not be found. May 03 09:19:58.925355 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-fd77a4c5-c2a7-4ae9-bd05-9a841bfcfb34 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Returning 404 to user: Instance 2dbd7241-ce49-4617-9aad-57a39f136403 could not be found. {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 09:19:58.926299 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-fd77a4c5-c2a7-4ae9-bd05-9a841bfcfb34 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "DELETE /compute/v2.1/servers/2dbd7241-ce49-4617-9aad-57a39f136403" status: 404 len: 111 microversion: 2.20 time: 0.027154 May 03 09:19:58.926812 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 982/2130] 10.222.0.11 () {60 vars in 1279 bytes} [Tue May 3 09:19:58 2022] DELETE /compute/v2.1/servers/2dbd7241-ce49-4617-9aad-57a39f136403 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 03 09:19:58.934930 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3586707e-d97d-42f1-8e81-8797b27775cb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:58.935578 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-3586707e-d97d-42f1-8e81-8797b27775cb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: 2dbd7241-ce49-4617-9aad-57a39f136403] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:58.941727 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3586707e-d97d-42f1-8e81-8797b27775cb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:58.942177 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3586707e-d97d-42f1-8e81-8797b27775cb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:58.942936 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3586707e-d97d-42f1-8e81-8797b27775cb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:58.943402 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3586707e-d97d-42f1-8e81-8797b27775cb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:58.956672 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.wsgi [None req-3586707e-d97d-42f1-8e81-8797b27775cb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] HTTP exception thrown: Instance 2dbd7241-ce49-4617-9aad-57a39f136403 could not be found. May 03 09:19:58.957260 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3586707e-d97d-42f1-8e81-8797b27775cb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Returning 404 to user: Instance 2dbd7241-ce49-4617-9aad-57a39f136403 could not be found. {{(pid=123391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 09:19:58.958080 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-3586707e-d97d-42f1-8e81-8797b27775cb tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/2dbd7241-ce49-4617-9aad-57a39f136403" status: 404 len: 111 microversion: 2.20 time: 0.027105 May 03 09:19:58.958607 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1149/2131] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:19:58 2022] GET /compute/v2.1/servers/2dbd7241-ce49-4617-9aad-57a39f136403 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 03 09:19:59.700387 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ba59e76a-8249-4e3f-a5e8-88bf0298f615 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:59.701388 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ba59e76a-8249-4e3f-a5e8-88bf0298f615 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:59.711463 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ba59e76a-8249-4e3f-a5e8-88bf0298f615 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:59.711945 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ba59e76a-8249-4e3f-a5e8-88bf0298f615 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:59.712112 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-66b0bed6-cf85-468a-b70e-a939045c6a2a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:19:59.712586 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-66b0bed6-cf85-468a-b70e-a939045c6a2a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:19:59.712737 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ba59e76a-8249-4e3f-a5e8-88bf0298f615 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:59.713133 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ba59e76a-8249-4e3f-a5e8-88bf0298f615 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:59.720070 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-66b0bed6-cf85-468a-b70e-a939045c6a2a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:59.720507 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-66b0bed6-cf85-468a-b70e-a939045c6a2a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:59.721288 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-66b0bed6-cf85-468a-b70e-a939045c6a2a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:19:59.721722 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-66b0bed6-cf85-468a-b70e-a939045c6a2a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:19:59.790701 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ba59e76a-8249-4e3f-a5e8-88bf0298f615 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:59.799640 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ba59e76a-8249-4e3f-a5e8-88bf0298f615 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.105746 May 03 09:19:59.800863 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 983/2132] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:59 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:19:59.876311 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-66b0bed6-cf85-468a-b70e-a939045c6a2a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:19:59.884511 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-66b0bed6-cf85-468a-b70e-a939045c6a2a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.178466 May 03 09:19:59.885082 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1150/2133] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:19:59 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:00.820685 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c16d29e1-d2e5-40ab-9541-8f1be7a766fa tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:00.821303 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c16d29e1-d2e5-40ab-9541-8f1be7a766fa tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:00.828300 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c16d29e1-d2e5-40ab-9541-8f1be7a766fa tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:00.828751 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c16d29e1-d2e5-40ab-9541-8f1be7a766fa tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:00.829526 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c16d29e1-d2e5-40ab-9541-8f1be7a766fa tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:00.829962 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c16d29e1-d2e5-40ab-9541-8f1be7a766fa tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:00.900007 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c16d29e1-d2e5-40ab-9541-8f1be7a766fa tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:00.902551 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-8040f7a2-6b44-4614-a60f-229f03e4b2ec tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:00.903176 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-8040f7a2-6b44-4614-a60f-229f03e4b2ec tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:00.908730 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c16d29e1-d2e5-40ab-9541-8f1be7a766fa tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.094358 May 03 09:20:00.909333 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 984/2134] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:00 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:00.909933 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8040f7a2-6b44-4614-a60f-229f03e4b2ec tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:00.910375 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8040f7a2-6b44-4614-a60f-229f03e4b2ec tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:00.911157 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8040f7a2-6b44-4614-a60f-229f03e4b2ec tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:00.911594 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8040f7a2-6b44-4614-a60f-229f03e4b2ec tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:01.048426 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-8040f7a2-6b44-4614-a60f-229f03e4b2ec tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:01.057348 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-8040f7a2-6b44-4614-a60f-229f03e4b2ec tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.158686 May 03 09:20:01.057917 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1151/2135] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:00 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:01.930826 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-031b7aaf-cd85-41de-98df-8ddc7446192b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:01.931836 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-031b7aaf-cd85-41de-98df-8ddc7446192b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:01.942533 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-031b7aaf-cd85-41de-98df-8ddc7446192b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:01.943297 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-031b7aaf-cd85-41de-98df-8ddc7446192b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:01.944623 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-031b7aaf-cd85-41de-98df-8ddc7446192b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:01.945352 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-031b7aaf-cd85-41de-98df-8ddc7446192b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:02.019578 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-031b7aaf-cd85-41de-98df-8ddc7446192b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:02.028313 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-031b7aaf-cd85-41de-98df-8ddc7446192b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.104677 May 03 09:20:02.029017 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 985/2136] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:01 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:02.077916 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9f1689f9-aef2-4a3c-9a2a-4c74bebb32fc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:02.078915 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9f1689f9-aef2-4a3c-9a2a-4c74bebb32fc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:02.088601 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9f1689f9-aef2-4a3c-9a2a-4c74bebb32fc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:02.089082 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9f1689f9-aef2-4a3c-9a2a-4c74bebb32fc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:02.089857 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9f1689f9-aef2-4a3c-9a2a-4c74bebb32fc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:02.090303 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9f1689f9-aef2-4a3c-9a2a-4c74bebb32fc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:02.226135 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9f1689f9-aef2-4a3c-9a2a-4c74bebb32fc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:02.234510 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9f1689f9-aef2-4a3c-9a2a-4c74bebb32fc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.162780 May 03 09:20:02.235055 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1152/2137] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:02 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:03.049790 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-43447df9-e33a-492f-917f-26a132f6bd24 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:03.050640 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-43447df9-e33a-492f-917f-26a132f6bd24 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:03.061685 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-43447df9-e33a-492f-917f-26a132f6bd24 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:03.062427 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-43447df9-e33a-492f-917f-26a132f6bd24 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:03.063680 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-43447df9-e33a-492f-917f-26a132f6bd24 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:03.064451 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-43447df9-e33a-492f-917f-26a132f6bd24 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:03.127038 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-43447df9-e33a-492f-917f-26a132f6bd24 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:03.135363 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-43447df9-e33a-492f-917f-26a132f6bd24 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.092371 May 03 09:20:03.135959 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 986/2138] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:03 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:03.251132 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c4968db2-c9b9-4127-b575-3179fc0782f8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:03.251745 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c4968db2-c9b9-4127-b575-3179fc0782f8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:03.261031 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c4968db2-c9b9-4127-b575-3179fc0782f8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:03.261479 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c4968db2-c9b9-4127-b575-3179fc0782f8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:03.262246 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c4968db2-c9b9-4127-b575-3179fc0782f8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:03.262676 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c4968db2-c9b9-4127-b575-3179fc0782f8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:03.395148 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c4968db2-c9b9-4127-b575-3179fc0782f8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:03.404064 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c4968db2-c9b9-4127-b575-3179fc0782f8 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.156895 May 03 09:20:03.404695 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1153/2139] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:03 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:04.156611 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a87ee8ec-4aec-457b-8599-5cc094dea254 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:04.157546 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a87ee8ec-4aec-457b-8599-5cc094dea254 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:04.174477 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a87ee8ec-4aec-457b-8599-5cc094dea254 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:04.175229 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a87ee8ec-4aec-457b-8599-5cc094dea254 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:04.176573 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a87ee8ec-4aec-457b-8599-5cc094dea254 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:04.177301 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a87ee8ec-4aec-457b-8599-5cc094dea254 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:04.255966 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a87ee8ec-4aec-457b-8599-5cc094dea254 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:04.264110 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a87ee8ec-4aec-457b-8599-5cc094dea254 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.114102 May 03 09:20:04.264682 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 987/2140] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:04 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:04.425489 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-106cabdf-91db-4f40-898e-8d5e6b91683c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:04.426311 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-106cabdf-91db-4f40-898e-8d5e6b91683c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:04.434373 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-106cabdf-91db-4f40-898e-8d5e6b91683c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:04.434824 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-106cabdf-91db-4f40-898e-8d5e6b91683c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:04.435589 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-106cabdf-91db-4f40-898e-8d5e6b91683c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:04.436063 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-106cabdf-91db-4f40-898e-8d5e6b91683c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:04.580070 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-106cabdf-91db-4f40-898e-8d5e6b91683c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:04.592805 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-106cabdf-91db-4f40-898e-8d5e6b91683c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.173668 May 03 09:20:04.593610 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1154/2141] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:04 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:05.293628 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-327e2f26-081f-473d-9940-77f97f7e9864 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:05.293628 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-327e2f26-081f-473d-9940-77f97f7e9864 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:05.295453 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-327e2f26-081f-473d-9940-77f97f7e9864 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:05.295983 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-327e2f26-081f-473d-9940-77f97f7e9864 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:05.296749 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-327e2f26-081f-473d-9940-77f97f7e9864 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:05.297174 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-327e2f26-081f-473d-9940-77f97f7e9864 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:05.358207 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-327e2f26-081f-473d-9940-77f97f7e9864 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:05.366190 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-327e2f26-081f-473d-9940-77f97f7e9864 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.086708 May 03 09:20:05.366760 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 988/2142] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:05 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:05.615206 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-98d18862-5212-4f31-b545-07287c366f2f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:05.615925 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-98d18862-5212-4f31-b545-07287c366f2f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:05.623051 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-98d18862-5212-4f31-b545-07287c366f2f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:05.623502 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-98d18862-5212-4f31-b545-07287c366f2f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:05.624303 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-98d18862-5212-4f31-b545-07287c366f2f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:05.624742 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-98d18862-5212-4f31-b545-07287c366f2f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:05.752524 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-98d18862-5212-4f31-b545-07287c366f2f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:05.760429 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-98d18862-5212-4f31-b545-07287c366f2f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.150352 May 03 09:20:05.760987 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1155/2143] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:05 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:06.387181 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e09c8e7d-2b37-4f86-958e-46a02916425a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:06.388143 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e09c8e7d-2b37-4f86-958e-46a02916425a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:06.399247 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e09c8e7d-2b37-4f86-958e-46a02916425a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:06.399703 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e09c8e7d-2b37-4f86-958e-46a02916425a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:06.400519 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e09c8e7d-2b37-4f86-958e-46a02916425a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:06.400956 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e09c8e7d-2b37-4f86-958e-46a02916425a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:06.462264 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e09c8e7d-2b37-4f86-958e-46a02916425a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:06.470791 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e09c8e7d-2b37-4f86-958e-46a02916425a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.090458 May 03 09:20:06.471359 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 989/2144] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:06 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:06.781830 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ea3a072c-7c7e-4b2d-b033-ad69dd2efeaa tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:06.782838 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ea3a072c-7c7e-4b2d-b033-ad69dd2efeaa tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:06.792155 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ea3a072c-7c7e-4b2d-b033-ad69dd2efeaa tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:06.792598 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ea3a072c-7c7e-4b2d-b033-ad69dd2efeaa tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:06.793353 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ea3a072c-7c7e-4b2d-b033-ad69dd2efeaa tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:06.793781 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ea3a072c-7c7e-4b2d-b033-ad69dd2efeaa tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:06.926860 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ea3a072c-7c7e-4b2d-b033-ad69dd2efeaa tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:06.939230 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ea3a072c-7c7e-4b2d-b033-ad69dd2efeaa tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.163554 May 03 09:20:06.940029 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1156/2145] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:06 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:07.492649 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-15999409-34c6-4d55-af15-29e9cc1b0d44 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:07.493502 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-15999409-34c6-4d55-af15-29e9cc1b0d44 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:07.504815 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-15999409-34c6-4d55-af15-29e9cc1b0d44 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:07.505577 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-15999409-34c6-4d55-af15-29e9cc1b0d44 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:07.506868 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-15999409-34c6-4d55-af15-29e9cc1b0d44 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:07.507586 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-15999409-34c6-4d55-af15-29e9cc1b0d44 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:07.570653 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-15999409-34c6-4d55-af15-29e9cc1b0d44 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:07.578761 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-15999409-34c6-4d55-af15-29e9cc1b0d44 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.092964 May 03 09:20:07.579342 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 990/2146] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:07 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:07.962831 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-1e05313e-3985-432d-9fab-e3e8fcef525b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:07.963944 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-1e05313e-3985-432d-9fab-e3e8fcef525b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:07.971748 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1e05313e-3985-432d-9fab-e3e8fcef525b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:07.972317 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1e05313e-3985-432d-9fab-e3e8fcef525b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:07.973224 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1e05313e-3985-432d-9fab-e3e8fcef525b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:07.973742 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1e05313e-3985-432d-9fab-e3e8fcef525b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:08.119637 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-1e05313e-3985-432d-9fab-e3e8fcef525b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:08.132118 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-1e05313e-3985-432d-9fab-e3e8fcef525b tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.175384 May 03 09:20:08.132957 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1157/2147] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:07 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:08.600718 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a3f3c5a7-4353-4e0e-9e70-0c68d2bdf6f6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:08.601707 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a3f3c5a7-4353-4e0e-9e70-0c68d2bdf6f6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:08.613239 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a3f3c5a7-4353-4e0e-9e70-0c68d2bdf6f6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:08.613976 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a3f3c5a7-4353-4e0e-9e70-0c68d2bdf6f6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:08.615249 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a3f3c5a7-4353-4e0e-9e70-0c68d2bdf6f6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:08.616039 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a3f3c5a7-4353-4e0e-9e70-0c68d2bdf6f6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:08.685661 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a3f3c5a7-4353-4e0e-9e70-0c68d2bdf6f6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:08.697169 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a3f3c5a7-4353-4e0e-9e70-0c68d2bdf6f6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.102973 May 03 09:20:08.697925 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 991/2148] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:08 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:09.153827 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c48910aa-4ed1-4373-96ab-305c8ace703f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:09.154866 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c48910aa-4ed1-4373-96ab-305c8ace703f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:09.165284 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c48910aa-4ed1-4373-96ab-305c8ace703f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:09.165739 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c48910aa-4ed1-4373-96ab-305c8ace703f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:09.166467 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c48910aa-4ed1-4373-96ab-305c8ace703f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:09.166918 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c48910aa-4ed1-4373-96ab-305c8ace703f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:09.310005 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c48910aa-4ed1-4373-96ab-305c8ace703f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:09.318060 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c48910aa-4ed1-4373-96ab-305c8ace703f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.170862 May 03 09:20:09.318719 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1158/2149] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:09 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:09.724180 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-99d66b2d-ea10-4be3-9c29-1452ae856b19 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:09.725114 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-99d66b2d-ea10-4be3-9c29-1452ae856b19 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:09.732614 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-99d66b2d-ea10-4be3-9c29-1452ae856b19 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:09.733062 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-99d66b2d-ea10-4be3-9c29-1452ae856b19 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:09.733822 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-99d66b2d-ea10-4be3-9c29-1452ae856b19 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:09.734255 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-99d66b2d-ea10-4be3-9c29-1452ae856b19 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:09.802546 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-99d66b2d-ea10-4be3-9c29-1452ae856b19 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:09.813432 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-99d66b2d-ea10-4be3-9c29-1452ae856b19 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.095785 May 03 09:20:09.814248 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 992/2150] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:09 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:10.345485 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-00b55e91-5e7e-4803-9dc3-64e3abe8d34f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:10.346510 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-00b55e91-5e7e-4803-9dc3-64e3abe8d34f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:10.357384 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-00b55e91-5e7e-4803-9dc3-64e3abe8d34f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:10.358148 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-00b55e91-5e7e-4803-9dc3-64e3abe8d34f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:10.359401 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-00b55e91-5e7e-4803-9dc3-64e3abe8d34f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:10.360196 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-00b55e91-5e7e-4803-9dc3-64e3abe8d34f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:10.500476 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-00b55e91-5e7e-4803-9dc3-64e3abe8d34f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:10.508489 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-00b55e91-5e7e-4803-9dc3-64e3abe8d34f tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.169476 May 03 09:20:10.509063 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1159/2151] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:10 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:10.834875 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-41edb82e-0748-4bd7-9d2d-f1b910987d86 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:10.835689 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-41edb82e-0748-4bd7-9d2d-f1b910987d86 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:10.843198 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-41edb82e-0748-4bd7-9d2d-f1b910987d86 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:10.843658 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-41edb82e-0748-4bd7-9d2d-f1b910987d86 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:10.844441 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-41edb82e-0748-4bd7-9d2d-f1b910987d86 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:10.844869 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-41edb82e-0748-4bd7-9d2d-f1b910987d86 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:10.912967 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-41edb82e-0748-4bd7-9d2d-f1b910987d86 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:10.921228 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-41edb82e-0748-4bd7-9d2d-f1b910987d86 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.093101 May 03 09:20:10.921799 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 993/2152] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:10 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:11.529991 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f2b8ed15-627b-4239-bc25-f0336225ec24 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:11.530884 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f2b8ed15-627b-4239-bc25-f0336225ec24 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:11.540735 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f2b8ed15-627b-4239-bc25-f0336225ec24 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:11.541184 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f2b8ed15-627b-4239-bc25-f0336225ec24 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:11.541947 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f2b8ed15-627b-4239-bc25-f0336225ec24 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:11.542379 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f2b8ed15-627b-4239-bc25-f0336225ec24 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:11.705711 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f2b8ed15-627b-4239-bc25-f0336225ec24 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:11.714549 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f2b8ed15-627b-4239-bc25-f0336225ec24 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.191263 May 03 09:20:11.715154 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1160/2153] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:11 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:11.940001 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f437abea-33ce-49cd-b52d-a45b07379a86 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:11.940948 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f437abea-33ce-49cd-b52d-a45b07379a86 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:11.948635 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f437abea-33ce-49cd-b52d-a45b07379a86 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:11.949088 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f437abea-33ce-49cd-b52d-a45b07379a86 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:11.949890 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f437abea-33ce-49cd-b52d-a45b07379a86 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:11.950325 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f437abea-33ce-49cd-b52d-a45b07379a86 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:12.013303 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f437abea-33ce-49cd-b52d-a45b07379a86 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:12.021396 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f437abea-33ce-49cd-b52d-a45b07379a86 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.085893 May 03 09:20:12.021969 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 994/2154] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:11 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:12.735831 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-298004b7-d110-4bf1-968c-5340f5929bb5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:12.736871 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-298004b7-d110-4bf1-968c-5340f5929bb5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:12.747545 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-298004b7-d110-4bf1-968c-5340f5929bb5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:12.748336 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-298004b7-d110-4bf1-968c-5340f5929bb5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:12.749598 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-298004b7-d110-4bf1-968c-5340f5929bb5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:12.750293 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-298004b7-d110-4bf1-968c-5340f5929bb5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:12.889600 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-298004b7-d110-4bf1-968c-5340f5929bb5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:12.901583 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-298004b7-d110-4bf1-968c-5340f5929bb5 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.172128 May 03 09:20:12.902577 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1161/2155] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:12 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:13.042714 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-187cd632-09e5-4046-a6a4-75174eb909b4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:13.043607 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-187cd632-09e5-4046-a6a4-75174eb909b4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:13.054369 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-187cd632-09e5-4046-a6a4-75174eb909b4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:13.055106 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-187cd632-09e5-4046-a6a4-75174eb909b4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:13.056431 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-187cd632-09e5-4046-a6a4-75174eb909b4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:13.057149 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-187cd632-09e5-4046-a6a4-75174eb909b4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:13.124838 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-187cd632-09e5-4046-a6a4-75174eb909b4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:13.133141 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-187cd632-09e5-4046-a6a4-75174eb909b4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.097197 May 03 09:20:13.133712 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 995/2156] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:13 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:13.923087 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-4ba9d87c-0eaf-44d3-b284-ad0aef57c650 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:13.924126 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-4ba9d87c-0eaf-44d3-b284-ad0aef57c650 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:13.933802 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4ba9d87c-0eaf-44d3-b284-ad0aef57c650 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:13.934245 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4ba9d87c-0eaf-44d3-b284-ad0aef57c650 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:13.935003 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4ba9d87c-0eaf-44d3-b284-ad0aef57c650 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:13.935433 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4ba9d87c-0eaf-44d3-b284-ad0aef57c650 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:14.072841 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-4ba9d87c-0eaf-44d3-b284-ad0aef57c650 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:14.081552 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-4ba9d87c-0eaf-44d3-b284-ad0aef57c650 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.164898 May 03 09:20:14.082131 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1162/2157] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:13 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:14.154193 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b3c9cc5e-6f16-4549-9608-2eedeb007e10 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:14.155163 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b3c9cc5e-6f16-4549-9608-2eedeb007e10 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:14.165758 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b3c9cc5e-6f16-4549-9608-2eedeb007e10 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:14.166446 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b3c9cc5e-6f16-4549-9608-2eedeb007e10 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:14.167213 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b3c9cc5e-6f16-4549-9608-2eedeb007e10 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:14.167642 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b3c9cc5e-6f16-4549-9608-2eedeb007e10 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:14.237011 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b3c9cc5e-6f16-4549-9608-2eedeb007e10 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:14.245439 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b3c9cc5e-6f16-4549-9608-2eedeb007e10 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.097893 May 03 09:20:14.246063 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 996/2158] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:14 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:15.102662 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c8e85d8e-9b82-4ea9-95a7-87af59443a4c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:15.103645 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c8e85d8e-9b82-4ea9-95a7-87af59443a4c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:15.110277 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c8e85d8e-9b82-4ea9-95a7-87af59443a4c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:15.110724 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c8e85d8e-9b82-4ea9-95a7-87af59443a4c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:15.111486 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c8e85d8e-9b82-4ea9-95a7-87af59443a4c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:15.111954 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c8e85d8e-9b82-4ea9-95a7-87af59443a4c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:15.253509 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c8e85d8e-9b82-4ea9-95a7-87af59443a4c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:15.261634 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c8e85d8e-9b82-4ea9-95a7-87af59443a4c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.165669 May 03 09:20:15.262210 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1163/2159] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:15 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:15.269801 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b8db1876-c121-4f83-b0df-4c472c15175a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:15.270419 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b8db1876-c121-4f83-b0df-4c472c15175a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:15.277058 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b8db1876-c121-4f83-b0df-4c472c15175a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:15.277500 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b8db1876-c121-4f83-b0df-4c472c15175a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:15.278268 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b8db1876-c121-4f83-b0df-4c472c15175a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:15.278699 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b8db1876-c121-4f83-b0df-4c472c15175a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:15.338667 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b8db1876-c121-4f83-b0df-4c472c15175a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:15.347220 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b8db1876-c121-4f83-b0df-4c472c15175a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.081310 May 03 09:20:15.347802 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 997/2160] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:15 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:16.282395 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-77cf95bb-2c9b-4ca6-93db-5aa3099f882d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:16.283290 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-77cf95bb-2c9b-4ca6-93db-5aa3099f882d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:16.294597 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-77cf95bb-2c9b-4ca6-93db-5aa3099f882d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:16.295419 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-77cf95bb-2c9b-4ca6-93db-5aa3099f882d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:16.296588 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-77cf95bb-2c9b-4ca6-93db-5aa3099f882d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:16.297229 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-77cf95bb-2c9b-4ca6-93db-5aa3099f882d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:16.364431 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-bb71ddab-7f44-46d2-a366-77631cef6dcd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:16.365044 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-bb71ddab-7f44-46d2-a366-77631cef6dcd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:16.371189 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bb71ddab-7f44-46d2-a366-77631cef6dcd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:16.371637 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bb71ddab-7f44-46d2-a366-77631cef6dcd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:16.372436 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bb71ddab-7f44-46d2-a366-77631cef6dcd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:16.372909 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bb71ddab-7f44-46d2-a366-77631cef6dcd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:16.446788 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-bb71ddab-7f44-46d2-a366-77631cef6dcd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:16.451508 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-77cf95bb-2c9b-4ca6-93db-5aa3099f882d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:16.455535 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-bb71ddab-7f44-46d2-a366-77631cef6dcd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.094975 May 03 09:20:16.456176 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 998/2161] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:16 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:20:16.459806 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-77cf95bb-2c9b-4ca6-93db-5aa3099f882d tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.183589 May 03 09:20:16.460374 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1164/2162] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:16 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:17.477421 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-bf928f5d-a19d-4f99-a0fc-cee62ce7e5d7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:17.478582 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-bf928f5d-a19d-4f99-a0fc-cee62ce7e5d7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:17.483510 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-2336cac1-696b-4612-93af-25b80953103c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:17.484159 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-2336cac1-696b-4612-93af-25b80953103c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:17.486221 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bf928f5d-a19d-4f99-a0fc-cee62ce7e5d7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:17.486678 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bf928f5d-a19d-4f99-a0fc-cee62ce7e5d7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:17.487441 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bf928f5d-a19d-4f99-a0fc-cee62ce7e5d7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:17.487906 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bf928f5d-a19d-4f99-a0fc-cee62ce7e5d7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:17.490640 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2336cac1-696b-4612-93af-25b80953103c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:17.491095 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2336cac1-696b-4612-93af-25b80953103c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:17.491999 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2336cac1-696b-4612-93af-25b80953103c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:17.492445 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2336cac1-696b-4612-93af-25b80953103c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:17.558563 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-bf928f5d-a19d-4f99-a0fc-cee62ce7e5d7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:17.566758 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-bf928f5d-a19d-4f99-a0fc-cee62ce7e5d7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.096175 May 03 09:20:17.567333 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 999/2163] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:17 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:17.644323 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-2336cac1-696b-4612-93af-25b80953103c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:17.653078 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-2336cac1-696b-4612-93af-25b80953103c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.175770 May 03 09:20:17.653655 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1165/2164] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:17 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:18.589491 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-8578bb66-5b9a-4901-ac8c-22f34be72566 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:18.590550 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-8578bb66-5b9a-4901-ac8c-22f34be72566 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:18.598826 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8578bb66-5b9a-4901-ac8c-22f34be72566 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:18.599393 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8578bb66-5b9a-4901-ac8c-22f34be72566 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:18.600392 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8578bb66-5b9a-4901-ac8c-22f34be72566 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:18.600937 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8578bb66-5b9a-4901-ac8c-22f34be72566 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:18.665009 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-8578bb66-5b9a-4901-ac8c-22f34be72566 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:18.670931 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5874c78f-cae3-4c3a-828b-fea4af784cbc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:18.671550 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5874c78f-cae3-4c3a-828b-fea4af784cbc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:18.673041 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-8578bb66-5b9a-4901-ac8c-22f34be72566 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.090473 May 03 09:20:18.673615 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1000/2165] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:18 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:18.677907 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5874c78f-cae3-4c3a-828b-fea4af784cbc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:18.678361 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5874c78f-cae3-4c3a-828b-fea4af784cbc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:18.679129 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5874c78f-cae3-4c3a-828b-fea4af784cbc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:18.679590 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5874c78f-cae3-4c3a-828b-fea4af784cbc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:18.812203 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5874c78f-cae3-4c3a-828b-fea4af784cbc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:18.820412 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5874c78f-cae3-4c3a-828b-fea4af784cbc tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.153898 May 03 09:20:18.821003 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1166/2166] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:18 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:19.693891 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2a382525-28c1-4575-8808-8037c57e0ecc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:19.694824 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-2a382525-28c1-4575-8808-8037c57e0ecc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:19.703433 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2a382525-28c1-4575-8808-8037c57e0ecc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:19.703990 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2a382525-28c1-4575-8808-8037c57e0ecc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:19.704753 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2a382525-28c1-4575-8808-8037c57e0ecc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:19.705184 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2a382525-28c1-4575-8808-8037c57e0ecc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:19.771303 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2a382525-28c1-4575-8808-8037c57e0ecc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:19.779651 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-2a382525-28c1-4575-8808-8037c57e0ecc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.092434 May 03 09:20:19.780259 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1001/2167] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:19 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:19.838933 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-7a3369ca-40e4-4197-8e32-7f902761642a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:19.839552 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-7a3369ca-40e4-4197-8e32-7f902761642a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:19.846435 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7a3369ca-40e4-4197-8e32-7f902761642a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:19.846886 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7a3369ca-40e4-4197-8e32-7f902761642a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:19.847650 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7a3369ca-40e4-4197-8e32-7f902761642a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:19.848119 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7a3369ca-40e4-4197-8e32-7f902761642a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:19.984624 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7a3369ca-40e4-4197-8e32-7f902761642a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:19.992717 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-7a3369ca-40e4-4197-8e32-7f902761642a tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.158099 May 03 09:20:19.993286 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1167/2168] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:19 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:20.800670 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b9e93e95-d387-4fb8-9764-60b4e7c99da6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:20.801622 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b9e93e95-d387-4fb8-9764-60b4e7c99da6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:20.811059 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b9e93e95-d387-4fb8-9764-60b4e7c99da6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:20.811508 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b9e93e95-d387-4fb8-9764-60b4e7c99da6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:20.812318 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b9e93e95-d387-4fb8-9764-60b4e7c99da6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:20.812754 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b9e93e95-d387-4fb8-9764-60b4e7c99da6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:20.877757 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b9e93e95-d387-4fb8-9764-60b4e7c99da6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:20.886128 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b9e93e95-d387-4fb8-9764-60b4e7c99da6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.092287 May 03 09:20:20.886813 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1002/2169] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:20 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:21.014194 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-313a617e-9c47-4dca-957a-f9a1b3165ca4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:21.015031 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-313a617e-9c47-4dca-957a-f9a1b3165ca4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:21.025726 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-313a617e-9c47-4dca-957a-f9a1b3165ca4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:21.026471 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-313a617e-9c47-4dca-957a-f9a1b3165ca4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:21.028226 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-313a617e-9c47-4dca-957a-f9a1b3165ca4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:21.028924 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-313a617e-9c47-4dca-957a-f9a1b3165ca4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:21.167124 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-313a617e-9c47-4dca-957a-f9a1b3165ca4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:21.179871 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-313a617e-9c47-4dca-957a-f9a1b3165ca4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.172334 May 03 09:20:21.180448 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1168/2170] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:21 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:21.907631 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-82ea57a1-2d9b-49c3-a658-af13d7b90a05 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:21.908645 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-82ea57a1-2d9b-49c3-a658-af13d7b90a05 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:21.918946 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-82ea57a1-2d9b-49c3-a658-af13d7b90a05 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:21.919396 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-82ea57a1-2d9b-49c3-a658-af13d7b90a05 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:21.920203 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-82ea57a1-2d9b-49c3-a658-af13d7b90a05 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:21.920635 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-82ea57a1-2d9b-49c3-a658-af13d7b90a05 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:21.991311 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-82ea57a1-2d9b-49c3-a658-af13d7b90a05 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:22.000503 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-82ea57a1-2d9b-49c3-a658-af13d7b90a05 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.099415 May 03 09:20:22.001083 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1003/2171] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:21 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:22.202664 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3fc569f8-9f6e-4356-941d-5abccd90fcba tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:22.203512 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-3fc569f8-9f6e-4356-941d-5abccd90fcba tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:22.214706 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3fc569f8-9f6e-4356-941d-5abccd90fcba tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:22.215902 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3fc569f8-9f6e-4356-941d-5abccd90fcba tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:22.216062 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3fc569f8-9f6e-4356-941d-5abccd90fcba tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:22.216514 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3fc569f8-9f6e-4356-941d-5abccd90fcba tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:22.363047 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-3fc569f8-9f6e-4356-941d-5abccd90fcba tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:22.371086 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-3fc569f8-9f6e-4356-941d-5abccd90fcba tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.175199 May 03 09:20:22.371644 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1169/2172] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:22 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:23.021850 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7a9d4cd2-bdef-4934-a027-734785d373d6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:23.022699 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7a9d4cd2-bdef-4934-a027-734785d373d6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:23.031274 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7a9d4cd2-bdef-4934-a027-734785d373d6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:23.031727 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7a9d4cd2-bdef-4934-a027-734785d373d6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:23.032530 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7a9d4cd2-bdef-4934-a027-734785d373d6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:23.032967 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7a9d4cd2-bdef-4934-a027-734785d373d6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:23.103482 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7a9d4cd2-bdef-4934-a027-734785d373d6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:23.111953 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7a9d4cd2-bdef-4934-a027-734785d373d6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.096819 May 03 09:20:23.112522 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1004/2173] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:23 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:23.390639 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-6d97527f-d1bf-4633-87a3-34e7fef321c6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:23.391442 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-6d97527f-d1bf-4633-87a3-34e7fef321c6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:23.399275 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6d97527f-d1bf-4633-87a3-34e7fef321c6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:23.399804 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6d97527f-d1bf-4633-87a3-34e7fef321c6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:23.400720 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6d97527f-d1bf-4633-87a3-34e7fef321c6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:23.401290 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6d97527f-d1bf-4633-87a3-34e7fef321c6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:23.533315 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-6d97527f-d1bf-4633-87a3-34e7fef321c6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:23.544106 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-6d97527f-d1bf-4633-87a3-34e7fef321c6 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.158317 May 03 09:20:23.544800 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1170/2174] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:23 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:24.133751 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6dcda4ea-439d-49dd-9259-99528120a5da tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:24.134698 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6dcda4ea-439d-49dd-9259-99528120a5da tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:24.142545 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6dcda4ea-439d-49dd-9259-99528120a5da tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:24.143044 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6dcda4ea-439d-49dd-9259-99528120a5da tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:24.143925 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6dcda4ea-439d-49dd-9259-99528120a5da tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:24.144409 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6dcda4ea-439d-49dd-9259-99528120a5da tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:24.217766 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6dcda4ea-439d-49dd-9259-99528120a5da tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:24.226236 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6dcda4ea-439d-49dd-9259-99528120a5da tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.099157 May 03 09:20:24.226812 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1005/2175] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:24 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:24.570812 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-bc02e66c-930e-4680-b26e-c3e12f57200c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:24.571961 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-bc02e66c-930e-4680-b26e-c3e12f57200c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:24.582695 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bc02e66c-930e-4680-b26e-c3e12f57200c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:24.583439 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bc02e66c-930e-4680-b26e-c3e12f57200c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:24.584766 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bc02e66c-930e-4680-b26e-c3e12f57200c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:24.585486 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bc02e66c-930e-4680-b26e-c3e12f57200c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:24.718485 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-bc02e66c-930e-4680-b26e-c3e12f57200c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:24.726890 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-bc02e66c-930e-4680-b26e-c3e12f57200c tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.162564 May 03 09:20:24.727472 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1171/2176] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:24 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:25.246598 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f22e96f0-27f7-4e8f-981f-65d490abfc6f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:25.247196 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f22e96f0-27f7-4e8f-981f-65d490abfc6f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:25.254050 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f22e96f0-27f7-4e8f-981f-65d490abfc6f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:25.254497 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f22e96f0-27f7-4e8f-981f-65d490abfc6f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:25.255259 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f22e96f0-27f7-4e8f-981f-65d490abfc6f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:25.255684 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f22e96f0-27f7-4e8f-981f-65d490abfc6f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:25.324447 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f22e96f0-27f7-4e8f-981f-65d490abfc6f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:25.332401 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f22e96f0-27f7-4e8f-981f-65d490abfc6f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.091918 May 03 09:20:25.333159 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1006/2177] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:25 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:25.747809 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-10dc8f1d-a871-4813-9572-bf187a0ce4a4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:25.748435 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-10dc8f1d-a871-4813-9572-bf187a0ce4a4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:25.754964 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-10dc8f1d-a871-4813-9572-bf187a0ce4a4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:25.755422 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-10dc8f1d-a871-4813-9572-bf187a0ce4a4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:25.756229 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-10dc8f1d-a871-4813-9572-bf187a0ce4a4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:25.756660 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-10dc8f1d-a871-4813-9572-bf187a0ce4a4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:25.896505 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-10dc8f1d-a871-4813-9572-bf187a0ce4a4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:25.904914 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-10dc8f1d-a871-4813-9572-bf187a0ce4a4 tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.163119 May 03 09:20:25.905491 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1172/2178] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:25 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:26.350218 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5c76311a-82db-46a4-b1f7-c63b0fa541ca tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:26.350835 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5c76311a-82db-46a4-b1f7-c63b0fa541ca tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:26.357724 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5c76311a-82db-46a4-b1f7-c63b0fa541ca tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:26.358173 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5c76311a-82db-46a4-b1f7-c63b0fa541ca tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:26.358935 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5c76311a-82db-46a4-b1f7-c63b0fa541ca tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:26.359359 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5c76311a-82db-46a4-b1f7-c63b0fa541ca tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:26.424955 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5c76311a-82db-46a4-b1f7-c63b0fa541ca tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:26.433438 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5c76311a-82db-46a4-b1f7-c63b0fa541ca tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.087078 May 03 09:20:26.434003 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1007/2179] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:26 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:26.923779 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d5cab7b8-3b40-44b0-8b3a-82762bd80bee tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:26.924394 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d5cab7b8-3b40-44b0-8b3a-82762bd80bee tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] [instance: 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:26.931138 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d5cab7b8-3b40-44b0-8b3a-82762bd80bee tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:26.931583 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d5cab7b8-3b40-44b0-8b3a-82762bd80bee tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:26.932369 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d5cab7b8-3b40-44b0-8b3a-82762bd80bee tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:26.932799 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d5cab7b8-3b40-44b0-8b3a-82762bd80bee tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:27.064908 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d5cab7b8-3b40-44b0-8b3a-82762bd80bee tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cb9871fdf14a16a12c3d73a951fb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cffdf9d4af6405dbc203be720191014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:27.072764 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d5cab7b8-3b40-44b0-8b3a-82762bd80bee tempest-VolumesSnapshotTestJSON-757164799 tempest-VolumesSnapshotTestJSON-757164799-project] 10.222.0.11 "GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5" status: 200 len: 1559 microversion: 2.1 time: 0.153525 May 03 09:20:27.073344 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1173/2180] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:26 2022] GET /compute/v2.1/servers/21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:27.460252 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-42fc0b03-76ea-40b0-8bb0-155335ad279a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:27.461294 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-42fc0b03-76ea-40b0-8bb0-155335ad279a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:27.469671 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-42fc0b03-76ea-40b0-8bb0-155335ad279a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:27.470113 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-42fc0b03-76ea-40b0-8bb0-155335ad279a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:27.470872 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-42fc0b03-76ea-40b0-8bb0-155335ad279a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:27.471298 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-42fc0b03-76ea-40b0-8bb0-155335ad279a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:27.700482 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-42fc0b03-76ea-40b0-8bb0-155335ad279a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:27.708823 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-42fc0b03-76ea-40b0-8bb0-155335ad279a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.255191 May 03 09:20:27.709372 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1008/2181] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:27 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:28.199383 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-be081333-ae5e-4afe-8b5e-89fb860e8be5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:28.200278 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-be081333-ae5e-4afe-8b5e-89fb860e8be5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:28.207031 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-be081333-ae5e-4afe-8b5e-89fb860e8be5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:28.207466 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-be081333-ae5e-4afe-8b5e-89fb860e8be5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:28.208387 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-be081333-ae5e-4afe-8b5e-89fb860e8be5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:28.208819 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-be081333-ae5e-4afe-8b5e-89fb860e8be5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:28.236542 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-be081333-ae5e-4afe-8b5e-89fb860e8be5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Going to try to terminate instance {{(pid=123391) delete /opt/stack/nova/nova/compute/api.py:2664}} May 03 09:20:28.315263 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-be081333-ae5e-4afe-8b5e-89fb860e8be5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "DELETE /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 204 len: 0 microversion: 2.1 time: 0.119733 May 03 09:20:28.316015 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1174/2182] 10.222.0.11 () {58 vars in 1238 bytes} [Tue May 3 09:20:28 2022] DELETE /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 03 09:20:28.324717 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-8837cc8e-a35d-4491-a790-b19baed3c50b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:28.325337 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-8837cc8e-a35d-4491-a790-b19baed3c50b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:28.331925 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8837cc8e-a35d-4491-a790-b19baed3c50b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:28.332382 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8837cc8e-a35d-4491-a790-b19baed3c50b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:28.333154 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8837cc8e-a35d-4491-a790-b19baed3c50b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:28.333592 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8837cc8e-a35d-4491-a790-b19baed3c50b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:28.469849 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-8837cc8e-a35d-4491-a790-b19baed3c50b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:28.477689 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-8837cc8e-a35d-4491-a790-b19baed3c50b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.156844 May 03 09:20:28.478250 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1009/2183] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:28 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:28.731205 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-72269cd1-85bb-4470-b477-874708e629f9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:28.732158 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-72269cd1-85bb-4470-b477-874708e629f9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:28.740556 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-72269cd1-85bb-4470-b477-874708e629f9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:28.741147 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-72269cd1-85bb-4470-b477-874708e629f9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:28.742203 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-72269cd1-85bb-4470-b477-874708e629f9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:28.742774 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-72269cd1-85bb-4470-b477-874708e629f9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:28.810908 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-72269cd1-85bb-4470-b477-874708e629f9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:28.820628 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-72269cd1-85bb-4470-b477-874708e629f9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.096455 May 03 09:20:28.821220 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1175/2184] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:28 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:29.497798 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-50049221-363c-4e21-a5a1-1a5f3af5ac80 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:29.498386 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-50049221-363c-4e21-a5a1-1a5f3af5ac80 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:29.505072 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-50049221-363c-4e21-a5a1-1a5f3af5ac80 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:29.505523 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-50049221-363c-4e21-a5a1-1a5f3af5ac80 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:29.506284 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-50049221-363c-4e21-a5a1-1a5f3af5ac80 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:29.506711 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-50049221-363c-4e21-a5a1-1a5f3af5ac80 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:29.637890 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-50049221-363c-4e21-a5a1-1a5f3af5ac80 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:29.646095 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-50049221-363c-4e21-a5a1-1a5f3af5ac80 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.153930 May 03 09:20:29.646661 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1010/2185] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:29 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:29.843616 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e9e750fc-72dc-4a3a-91c8-fb3359a9854a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:29.844544 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e9e750fc-72dc-4a3a-91c8-fb3359a9854a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:29.855240 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e9e750fc-72dc-4a3a-91c8-fb3359a9854a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:29.855684 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e9e750fc-72dc-4a3a-91c8-fb3359a9854a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:29.856488 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e9e750fc-72dc-4a3a-91c8-fb3359a9854a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:29.856912 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e9e750fc-72dc-4a3a-91c8-fb3359a9854a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:29.918692 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e9e750fc-72dc-4a3a-91c8-fb3359a9854a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:29.926636 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e9e750fc-72dc-4a3a-91c8-fb3359a9854a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.089096 May 03 09:20:29.927202 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1176/2186] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:29 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:30.667456 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0bd0aef7-d2c2-4730-a9cf-6277fb7f9888 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:30.668327 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0bd0aef7-d2c2-4730-a9cf-6277fb7f9888 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:30.676065 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0bd0aef7-d2c2-4730-a9cf-6277fb7f9888 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:30.676590 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0bd0aef7-d2c2-4730-a9cf-6277fb7f9888 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:30.677511 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0bd0aef7-d2c2-4730-a9cf-6277fb7f9888 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:30.677983 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0bd0aef7-d2c2-4730-a9cf-6277fb7f9888 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:30.809739 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0bd0aef7-d2c2-4730-a9cf-6277fb7f9888 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:30.817900 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0bd0aef7-d2c2-4730-a9cf-6277fb7f9888 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.156931 May 03 09:20:30.818470 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1011/2187] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:30 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:30.947747 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-35cd60d1-0cf1-428f-8557-61b8a5b361d7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:30.948636 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-35cd60d1-0cf1-428f-8557-61b8a5b361d7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:30.956018 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-35cd60d1-0cf1-428f-8557-61b8a5b361d7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:30.956496 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-35cd60d1-0cf1-428f-8557-61b8a5b361d7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:30.957312 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-35cd60d1-0cf1-428f-8557-61b8a5b361d7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:30.957775 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-35cd60d1-0cf1-428f-8557-61b8a5b361d7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:31.023586 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-35cd60d1-0cf1-428f-8557-61b8a5b361d7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:31.032063 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-35cd60d1-0cf1-428f-8557-61b8a5b361d7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.090953 May 03 09:20:31.032652 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1177/2188] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:30 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:31.840249 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e71f93a0-3ec5-4008-8970-d78e67ecdddb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:31.841022 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e71f93a0-3ec5-4008-8970-d78e67ecdddb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:31.849926 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e71f93a0-3ec5-4008-8970-d78e67ecdddb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:31.850541 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e71f93a0-3ec5-4008-8970-d78e67ecdddb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:31.851566 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e71f93a0-3ec5-4008-8970-d78e67ecdddb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:31.852191 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e71f93a0-3ec5-4008-8970-d78e67ecdddb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:31.986491 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e71f93a0-3ec5-4008-8970-d78e67ecdddb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:31.994949 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e71f93a0-3ec5-4008-8970-d78e67ecdddb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.161696 May 03 09:20:31.995525 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1012/2189] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:31 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:32.051724 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-da7bece9-f707-4925-bb58-57db8ffde11e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:32.052399 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-da7bece9-f707-4925-bb58-57db8ffde11e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:32.061186 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-da7bece9-f707-4925-bb58-57db8ffde11e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:32.061640 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-da7bece9-f707-4925-bb58-57db8ffde11e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:32.062415 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-da7bece9-f707-4925-bb58-57db8ffde11e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:32.062858 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-da7bece9-f707-4925-bb58-57db8ffde11e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:32.129031 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-da7bece9-f707-4925-bb58-57db8ffde11e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:32.137591 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-da7bece9-f707-4925-bb58-57db8ffde11e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.091958 May 03 09:20:32.138156 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1178/2190] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:32 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:33.016587 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-24c32d88-986d-4c82-adbf-a99ecf32c3d0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:33.017519 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-24c32d88-986d-4c82-adbf-a99ecf32c3d0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:33.028183 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-24c32d88-986d-4c82-adbf-a99ecf32c3d0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:33.028936 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-24c32d88-986d-4c82-adbf-a99ecf32c3d0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:33.030248 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-24c32d88-986d-4c82-adbf-a99ecf32c3d0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:33.030978 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-24c32d88-986d-4c82-adbf-a99ecf32c3d0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:33.160208 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3e234647-c561-4adc-82bf-40cc255d3aea tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:33.160779 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-3e234647-c561-4adc-82bf-40cc255d3aea tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:33.167398 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3e234647-c561-4adc-82bf-40cc255d3aea tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:33.169489 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3e234647-c561-4adc-82bf-40cc255d3aea tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:33.169752 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-24c32d88-986d-4c82-adbf-a99ecf32c3d0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:33.170264 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3e234647-c561-4adc-82bf-40cc255d3aea tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:33.170694 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3e234647-c561-4adc-82bf-40cc255d3aea tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:33.178133 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-24c32d88-986d-4c82-adbf-a99ecf32c3d0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.168288 May 03 09:20:33.178807 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1013/2191] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:33 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:33.237208 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-3e234647-c561-4adc-82bf-40cc255d3aea tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:33.245306 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-3e234647-c561-4adc-82bf-40cc255d3aea tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.089094 May 03 09:20:33.245925 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1179/2192] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:33 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:34.206472 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-fe61e944-4735-4f04-b13b-1d2f27c7bbfe tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:34.207829 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-fe61e944-4735-4f04-b13b-1d2f27c7bbfe tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:34.219520 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fe61e944-4735-4f04-b13b-1d2f27c7bbfe tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:34.220011 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fe61e944-4735-4f04-b13b-1d2f27c7bbfe tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:34.220788 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fe61e944-4735-4f04-b13b-1d2f27c7bbfe tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:34.221222 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fe61e944-4735-4f04-b13b-1d2f27c7bbfe tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:34.261758 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5bc24fe0-e70f-40d7-82d6-e9cb09694ed5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:34.262350 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5bc24fe0-e70f-40d7-82d6-e9cb09694ed5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:34.269106 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5bc24fe0-e70f-40d7-82d6-e9cb09694ed5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:34.269559 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5bc24fe0-e70f-40d7-82d6-e9cb09694ed5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:34.270331 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5bc24fe0-e70f-40d7-82d6-e9cb09694ed5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:34.270766 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5bc24fe0-e70f-40d7-82d6-e9cb09694ed5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:34.342700 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5bc24fe0-e70f-40d7-82d6-e9cb09694ed5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:34.351000 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5bc24fe0-e70f-40d7-82d6-e9cb09694ed5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.093185 May 03 09:20:34.351591 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1180/2193] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:34 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:34.381473 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-fe61e944-4735-4f04-b13b-1d2f27c7bbfe tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:34.389837 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-fe61e944-4735-4f04-b13b-1d2f27c7bbfe tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.195713 May 03 09:20:34.390416 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1014/2194] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:34 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:35.372399 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-aa1e2e26-1a65-4871-bd80-ff01ebd003f0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:35.373367 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-aa1e2e26-1a65-4871-bd80-ff01ebd003f0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:35.384242 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-aa1e2e26-1a65-4871-bd80-ff01ebd003f0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:35.384994 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-aa1e2e26-1a65-4871-bd80-ff01ebd003f0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:35.386245 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-aa1e2e26-1a65-4871-bd80-ff01ebd003f0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:35.386912 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-aa1e2e26-1a65-4871-bd80-ff01ebd003f0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:35.408020 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-be0478fd-a563-4b02-9351-d199a428652c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:35.408710 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-be0478fd-a563-4b02-9351-d199a428652c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:35.415463 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-be0478fd-a563-4b02-9351-d199a428652c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:35.415950 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-be0478fd-a563-4b02-9351-d199a428652c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:35.416718 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-be0478fd-a563-4b02-9351-d199a428652c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:35.417148 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-be0478fd-a563-4b02-9351-d199a428652c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:35.450664 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-aa1e2e26-1a65-4871-bd80-ff01ebd003f0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:35.459230 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-aa1e2e26-1a65-4871-bd80-ff01ebd003f0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.093378 May 03 09:20:35.459826 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1181/2195] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:35 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:35.547668 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-be0478fd-a563-4b02-9351-d199a428652c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:35.556278 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-be0478fd-a563-4b02-9351-d199a428652c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.152232 May 03 09:20:35.556849 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1015/2196] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:35 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:35.833298 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 09:20:35.833623 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: Tue May 3 09:20:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 03 09:20:36.480179 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f3fd4e21-23f9-46d9-83b8-1d15dcff9132 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:36.480875 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f3fd4e21-23f9-46d9-83b8-1d15dcff9132 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:36.491098 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f3fd4e21-23f9-46d9-83b8-1d15dcff9132 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:36.491827 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f3fd4e21-23f9-46d9-83b8-1d15dcff9132 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:36.492961 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f3fd4e21-23f9-46d9-83b8-1d15dcff9132 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:36.493660 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f3fd4e21-23f9-46d9-83b8-1d15dcff9132 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:36.554991 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f3fd4e21-23f9-46d9-83b8-1d15dcff9132 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:36.563189 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f3fd4e21-23f9-46d9-83b8-1d15dcff9132 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.089481 May 03 09:20:36.563788 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1182/2197] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:36 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:36.573494 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-29fcedf8-1e34-4688-9959-43843f7a36a5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:36.574110 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-29fcedf8-1e34-4688-9959-43843f7a36a5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:36.580605 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-29fcedf8-1e34-4688-9959-43843f7a36a5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:36.581047 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-29fcedf8-1e34-4688-9959-43843f7a36a5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:36.581849 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-29fcedf8-1e34-4688-9959-43843f7a36a5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:36.582282 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-29fcedf8-1e34-4688-9959-43843f7a36a5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:36.726846 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-29fcedf8-1e34-4688-9959-43843f7a36a5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:36.735186 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-29fcedf8-1e34-4688-9959-43843f7a36a5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.165517 May 03 09:20:36.735680 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1016/2198] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:36 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:37.584616 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3d9a1ff7-28b1-4c11-bde2-9a99073dc912 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:37.585547 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-3d9a1ff7-28b1-4c11-bde2-9a99073dc912 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:37.596836 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3d9a1ff7-28b1-4c11-bde2-9a99073dc912 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:37.597579 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3d9a1ff7-28b1-4c11-bde2-9a99073dc912 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:37.598821 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3d9a1ff7-28b1-4c11-bde2-9a99073dc912 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:37.599532 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3d9a1ff7-28b1-4c11-bde2-9a99073dc912 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:37.667980 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-3d9a1ff7-28b1-4c11-bde2-9a99073dc912 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:37.679045 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-3d9a1ff7-28b1-4c11-bde2-9a99073dc912 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.101115 May 03 09:20:37.679634 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1183/2199] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:37 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:37.755561 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4c292291-2da7-4d41-978b-55fe7c8642de tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:37.756591 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4c292291-2da7-4d41-978b-55fe7c8642de tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:37.767816 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4c292291-2da7-4d41-978b-55fe7c8642de tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:37.768638 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4c292291-2da7-4d41-978b-55fe7c8642de tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:37.769921 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4c292291-2da7-4d41-978b-55fe7c8642de tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:37.770648 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4c292291-2da7-4d41-978b-55fe7c8642de tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:37.909606 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-4c292291-2da7-4d41-978b-55fe7c8642de tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:37.918479 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-4c292291-2da7-4d41-978b-55fe7c8642de tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.169506 May 03 09:20:37.919208 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1017/2200] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:37 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:38.700420 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3383f3e4-5d14-4cb2-b04f-5f690072e519 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:38.701557 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-3383f3e4-5d14-4cb2-b04f-5f690072e519 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:38.712806 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3383f3e4-5d14-4cb2-b04f-5f690072e519 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:38.713565 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3383f3e4-5d14-4cb2-b04f-5f690072e519 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:38.714915 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3383f3e4-5d14-4cb2-b04f-5f690072e519 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:38.715594 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3383f3e4-5d14-4cb2-b04f-5f690072e519 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:38.781323 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-3383f3e4-5d14-4cb2-b04f-5f690072e519 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:38.793977 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-3383f3e4-5d14-4cb2-b04f-5f690072e519 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.099687 May 03 09:20:38.794801 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1184/2201] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:38 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:38.943605 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-33cc1928-d26a-45d8-8e31-bcc6820487c5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:38.944533 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-33cc1928-d26a-45d8-8e31-bcc6820487c5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:38.953236 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-33cc1928-d26a-45d8-8e31-bcc6820487c5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:38.953625 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-33cc1928-d26a-45d8-8e31-bcc6820487c5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:38.954397 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-33cc1928-d26a-45d8-8e31-bcc6820487c5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:38.954832 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-33cc1928-d26a-45d8-8e31-bcc6820487c5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:39.094677 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-33cc1928-d26a-45d8-8e31-bcc6820487c5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:39.103488 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-33cc1928-d26a-45d8-8e31-bcc6820487c5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.165955 May 03 09:20:39.104109 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1018/2202] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:38 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:39.820844 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-826320b3-2b62-4676-8d59-087992101920 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:39.821843 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-826320b3-2b62-4676-8d59-087992101920 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:39.830518 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-826320b3-2b62-4676-8d59-087992101920 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:39.830963 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-826320b3-2b62-4676-8d59-087992101920 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:39.831716 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-826320b3-2b62-4676-8d59-087992101920 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:39.832183 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-826320b3-2b62-4676-8d59-087992101920 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:39.902582 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-826320b3-2b62-4676-8d59-087992101920 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:39.910561 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-826320b3-2b62-4676-8d59-087992101920 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.096295 May 03 09:20:39.911128 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1185/2203] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:39 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:40.125566 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-aed2b64b-4b18-4c88-aca9-c9c6f487fb55 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:40.126427 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-aed2b64b-4b18-4c88-aca9-c9c6f487fb55 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:40.137140 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aed2b64b-4b18-4c88-aca9-c9c6f487fb55 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:40.137895 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aed2b64b-4b18-4c88-aca9-c9c6f487fb55 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:40.139169 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aed2b64b-4b18-4c88-aca9-c9c6f487fb55 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:40.139954 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aed2b64b-4b18-4c88-aca9-c9c6f487fb55 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:40.276068 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-aed2b64b-4b18-4c88-aca9-c9c6f487fb55 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:40.284702 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-aed2b64b-4b18-4c88-aca9-c9c6f487fb55 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.166137 May 03 09:20:40.285284 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1019/2204] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:40 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:40.928947 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f4f56c26-8f38-4b3a-991e-9d892a18a5b5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:40.929646 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f4f56c26-8f38-4b3a-991e-9d892a18a5b5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:40.937454 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f4f56c26-8f38-4b3a-991e-9d892a18a5b5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:40.937897 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f4f56c26-8f38-4b3a-991e-9d892a18a5b5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:40.938656 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f4f56c26-8f38-4b3a-991e-9d892a18a5b5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:40.939081 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f4f56c26-8f38-4b3a-991e-9d892a18a5b5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:41.014423 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f4f56c26-8f38-4b3a-991e-9d892a18a5b5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:41.022775 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f4f56c26-8f38-4b3a-991e-9d892a18a5b5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.098470 May 03 09:20:41.023341 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1186/2205] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:40 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:41.304033 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a9361dca-d962-4997-a3b5-e5125ca01f30 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:41.304665 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a9361dca-d962-4997-a3b5-e5125ca01f30 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:41.313148 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a9361dca-d962-4997-a3b5-e5125ca01f30 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:41.313707 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a9361dca-d962-4997-a3b5-e5125ca01f30 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:41.314663 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a9361dca-d962-4997-a3b5-e5125ca01f30 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:41.315198 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a9361dca-d962-4997-a3b5-e5125ca01f30 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:41.450903 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a9361dca-d962-4997-a3b5-e5125ca01f30 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:41.459542 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a9361dca-d962-4997-a3b5-e5125ca01f30 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.160620 May 03 09:20:41.460157 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1020/2206] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:41 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:42.044324 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-bb19e4da-6645-4173-97e3-7eb5b37573f9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:42.045292 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-bb19e4da-6645-4173-97e3-7eb5b37573f9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:42.052837 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bb19e4da-6645-4173-97e3-7eb5b37573f9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:42.053358 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bb19e4da-6645-4173-97e3-7eb5b37573f9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:42.054168 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bb19e4da-6645-4173-97e3-7eb5b37573f9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:42.054644 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bb19e4da-6645-4173-97e3-7eb5b37573f9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:42.130372 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-bb19e4da-6645-4173-97e3-7eb5b37573f9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:42.141089 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-bb19e4da-6645-4173-97e3-7eb5b37573f9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.103357 May 03 09:20:42.141664 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1187/2207] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:42 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:42.481590 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-706fb0c5-4abb-4aad-8c91-15e8b2e6e819 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:42.482546 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-706fb0c5-4abb-4aad-8c91-15e8b2e6e819 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:42.493242 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-706fb0c5-4abb-4aad-8c91-15e8b2e6e819 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:42.493981 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-706fb0c5-4abb-4aad-8c91-15e8b2e6e819 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:42.495248 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-706fb0c5-4abb-4aad-8c91-15e8b2e6e819 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:42.496015 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-706fb0c5-4abb-4aad-8c91-15e8b2e6e819 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:42.631411 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-706fb0c5-4abb-4aad-8c91-15e8b2e6e819 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:42.640065 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-706fb0c5-4abb-4aad-8c91-15e8b2e6e819 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.165001 May 03 09:20:42.640694 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1021/2208] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:42 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:43.166893 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-0eb173b5-0937-480e-920d-d8aa3118accc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:43.167880 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-0eb173b5-0937-480e-920d-d8aa3118accc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:43.178320 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0eb173b5-0937-480e-920d-d8aa3118accc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:43.179031 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0eb173b5-0937-480e-920d-d8aa3118accc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:43.180321 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0eb173b5-0937-480e-920d-d8aa3118accc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:43.181043 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0eb173b5-0937-480e-920d-d8aa3118accc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:43.244796 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-0eb173b5-0937-480e-920d-d8aa3118accc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:43.252973 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-0eb173b5-0937-480e-920d-d8aa3118accc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.092671 May 03 09:20:43.253554 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1188/2209] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:43 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:43.661689 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b5eb25cd-a328-428f-9337-5d2b8c614dba tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:43.662699 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b5eb25cd-a328-428f-9337-5d2b8c614dba tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:43.673352 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b5eb25cd-a328-428f-9337-5d2b8c614dba tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:43.674103 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b5eb25cd-a328-428f-9337-5d2b8c614dba tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:43.675384 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b5eb25cd-a328-428f-9337-5d2b8c614dba tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:43.676171 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b5eb25cd-a328-428f-9337-5d2b8c614dba tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:43.833107 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b5eb25cd-a328-428f-9337-5d2b8c614dba tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:43.842166 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b5eb25cd-a328-428f-9337-5d2b8c614dba tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.187313 May 03 09:20:43.842751 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1022/2210] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:43 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:44.271567 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-69471479-5016-4525-b9d3-499204908f6a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:44.272685 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-69471479-5016-4525-b9d3-499204908f6a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:44.283464 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-69471479-5016-4525-b9d3-499204908f6a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:44.284254 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-69471479-5016-4525-b9d3-499204908f6a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:44.285500 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-69471479-5016-4525-b9d3-499204908f6a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:44.286222 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-69471479-5016-4525-b9d3-499204908f6a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:44.352439 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-69471479-5016-4525-b9d3-499204908f6a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:44.360805 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-69471479-5016-4525-b9d3-499204908f6a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.095263 May 03 09:20:44.361369 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1189/2211] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:44 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:44.863699 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-650613f3-62dd-47d1-8b77-613b0c9bdb00 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:44.864766 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-650613f3-62dd-47d1-8b77-613b0c9bdb00 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:44.875504 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-650613f3-62dd-47d1-8b77-613b0c9bdb00 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:44.876311 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-650613f3-62dd-47d1-8b77-613b0c9bdb00 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:44.877595 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-650613f3-62dd-47d1-8b77-613b0c9bdb00 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:44.878325 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-650613f3-62dd-47d1-8b77-613b0c9bdb00 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:45.013022 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-650613f3-62dd-47d1-8b77-613b0c9bdb00 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:45.021545 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-650613f3-62dd-47d1-8b77-613b0c9bdb00 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.164647 May 03 09:20:45.022126 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1023/2212] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:44 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:45.381885 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-978c8b5f-e2a3-49b1-950a-2416107b0a9d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:45.382864 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-978c8b5f-e2a3-49b1-950a-2416107b0a9d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:45.393651 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-978c8b5f-e2a3-49b1-950a-2416107b0a9d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:45.394389 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-978c8b5f-e2a3-49b1-950a-2416107b0a9d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:45.395630 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-978c8b5f-e2a3-49b1-950a-2416107b0a9d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:45.396396 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-978c8b5f-e2a3-49b1-950a-2416107b0a9d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:45.471040 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-978c8b5f-e2a3-49b1-950a-2416107b0a9d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:45.479661 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-978c8b5f-e2a3-49b1-950a-2416107b0a9d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.104326 May 03 09:20:45.480268 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1190/2213] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:45 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:46.042574 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b08c7592-9073-4b2a-9dcb-7f2104dece83 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:46.043647 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b08c7592-9073-4b2a-9dcb-7f2104dece83 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:46.054301 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b08c7592-9073-4b2a-9dcb-7f2104dece83 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:46.055061 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b08c7592-9073-4b2a-9dcb-7f2104dece83 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:46.056396 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b08c7592-9073-4b2a-9dcb-7f2104dece83 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:46.057223 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b08c7592-9073-4b2a-9dcb-7f2104dece83 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:46.201813 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b08c7592-9073-4b2a-9dcb-7f2104dece83 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:46.213976 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b08c7592-9073-4b2a-9dcb-7f2104dece83 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.177957 May 03 09:20:46.214583 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1024/2214] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:46 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:46.502633 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a855fc4a-6a3e-444b-8a76-8162e2bdc0c6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:46.503611 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a855fc4a-6a3e-444b-8a76-8162e2bdc0c6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:46.514685 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a855fc4a-6a3e-444b-8a76-8162e2bdc0c6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:46.515432 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a855fc4a-6a3e-444b-8a76-8162e2bdc0c6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:46.516720 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a855fc4a-6a3e-444b-8a76-8162e2bdc0c6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:46.517191 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a855fc4a-6a3e-444b-8a76-8162e2bdc0c6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:46.579173 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a855fc4a-6a3e-444b-8a76-8162e2bdc0c6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:46.591970 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a855fc4a-6a3e-444b-8a76-8162e2bdc0c6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.095631 May 03 09:20:46.592814 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1191/2215] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:46 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:47.236557 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-1b0d9145-9245-483e-881e-1712686dbcca tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:47.237176 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-1b0d9145-9245-483e-881e-1712686dbcca tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:47.243942 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1b0d9145-9245-483e-881e-1712686dbcca tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:47.244384 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1b0d9145-9245-483e-881e-1712686dbcca tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:47.245157 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1b0d9145-9245-483e-881e-1712686dbcca tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:47.245589 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1b0d9145-9245-483e-881e-1712686dbcca tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:47.385196 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-1b0d9145-9245-483e-881e-1712686dbcca tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:47.393680 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-1b0d9145-9245-483e-881e-1712686dbcca tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.163439 May 03 09:20:47.394233 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1025/2216] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:47 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:47.614074 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-daa32a36-57a9-490b-b074-15ad8317bbfd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:47.615088 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-daa32a36-57a9-490b-b074-15ad8317bbfd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:47.625630 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-daa32a36-57a9-490b-b074-15ad8317bbfd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:47.626389 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-daa32a36-57a9-490b-b074-15ad8317bbfd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:47.627158 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-daa32a36-57a9-490b-b074-15ad8317bbfd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:47.627596 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-daa32a36-57a9-490b-b074-15ad8317bbfd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:47.687983 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-daa32a36-57a9-490b-b074-15ad8317bbfd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:47.696388 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-daa32a36-57a9-490b-b074-15ad8317bbfd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.088993 May 03 09:20:47.696957 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1192/2217] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:47 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:48.412723 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-888ca415-d922-4bc2-81dc-fe5a93949c7b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:48.413313 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-888ca415-d922-4bc2-81dc-fe5a93949c7b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:48.420471 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-888ca415-d922-4bc2-81dc-fe5a93949c7b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:48.420941 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-888ca415-d922-4bc2-81dc-fe5a93949c7b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:48.421743 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-888ca415-d922-4bc2-81dc-fe5a93949c7b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:48.422199 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-888ca415-d922-4bc2-81dc-fe5a93949c7b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:48.553375 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-888ca415-d922-4bc2-81dc-fe5a93949c7b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:48.565533 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-888ca415-d922-4bc2-81dc-fe5a93949c7b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.157198 May 03 09:20:48.566275 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1026/2218] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:48 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:48.718407 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3f342e36-25d5-46a8-92ea-87f8eff07de7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:48.719469 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-3f342e36-25d5-46a8-92ea-87f8eff07de7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:48.730274 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3f342e36-25d5-46a8-92ea-87f8eff07de7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:48.731024 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3f342e36-25d5-46a8-92ea-87f8eff07de7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:48.732355 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3f342e36-25d5-46a8-92ea-87f8eff07de7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:48.733080 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3f342e36-25d5-46a8-92ea-87f8eff07de7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:48.801194 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-3f342e36-25d5-46a8-92ea-87f8eff07de7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:48.813310 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-3f342e36-25d5-46a8-92ea-87f8eff07de7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.101770 May 03 09:20:48.814095 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1193/2219] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:48 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:49.594512 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d739e2db-af5e-4312-842c-fa36048a64b2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:49.595383 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d739e2db-af5e-4312-842c-fa36048a64b2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:49.602975 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d739e2db-af5e-4312-842c-fa36048a64b2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:49.603425 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d739e2db-af5e-4312-842c-fa36048a64b2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:49.604227 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d739e2db-af5e-4312-842c-fa36048a64b2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:49.604661 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d739e2db-af5e-4312-842c-fa36048a64b2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:49.830956 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-633b19ba-7f27-4070-b3e8-da1069c9474e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:49.831558 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-633b19ba-7f27-4070-b3e8-da1069c9474e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:49.839162 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-633b19ba-7f27-4070-b3e8-da1069c9474e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:49.839616 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-633b19ba-7f27-4070-b3e8-da1069c9474e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:49.840445 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-633b19ba-7f27-4070-b3e8-da1069c9474e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:49.840876 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-633b19ba-7f27-4070-b3e8-da1069c9474e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:49.968954 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-633b19ba-7f27-4070-b3e8-da1069c9474e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:49.977418 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-633b19ba-7f27-4070-b3e8-da1069c9474e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.150581 May 03 09:20:49.978007 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1194/2220] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:49 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:50.021668 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d739e2db-af5e-4312-842c-fa36048a64b2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:50.030273 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d739e2db-af5e-4312-842c-fa36048a64b2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.444207 May 03 09:20:50.030853 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1027/2221] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:49 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:50.995758 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-1144c690-1057-4a4f-b315-c5c59d35d6a1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:50.996414 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-1144c690-1057-4a4f-b315-c5c59d35d6a1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:51.003693 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1144c690-1057-4a4f-b315-c5c59d35d6a1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:51.004221 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1144c690-1057-4a4f-b315-c5c59d35d6a1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:51.005057 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1144c690-1057-4a4f-b315-c5c59d35d6a1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:51.005552 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1144c690-1057-4a4f-b315-c5c59d35d6a1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:51.046529 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-8ec96864-ad2f-412f-9519-0c0b054535a4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:51.047110 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-8ec96864-ad2f-412f-9519-0c0b054535a4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:51.053927 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8ec96864-ad2f-412f-9519-0c0b054535a4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:51.054376 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8ec96864-ad2f-412f-9519-0c0b054535a4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:51.055148 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8ec96864-ad2f-412f-9519-0c0b054535a4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:51.055577 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8ec96864-ad2f-412f-9519-0c0b054535a4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:51.071727 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-1144c690-1057-4a4f-b315-c5c59d35d6a1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:51.079805 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-1144c690-1057-4a4f-b315-c5c59d35d6a1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.088524 May 03 09:20:51.080410 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1195/2222] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:50 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:51.180127 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-8ec96864-ad2f-412f-9519-0c0b054535a4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:51.188401 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-8ec96864-ad2f-412f-9519-0c0b054535a4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.145751 May 03 09:20:51.188988 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1028/2223] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:51 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:52.100091 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-2e23032e-3895-43e8-9c29-c38418f30a1b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:52.100741 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-2e23032e-3895-43e8-9c29-c38418f30a1b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:52.107666 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2e23032e-3895-43e8-9c29-c38418f30a1b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:52.108149 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2e23032e-3895-43e8-9c29-c38418f30a1b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:52.108913 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2e23032e-3895-43e8-9c29-c38418f30a1b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:52.109348 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2e23032e-3895-43e8-9c29-c38418f30a1b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:52.171152 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-2e23032e-3895-43e8-9c29-c38418f30a1b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:52.179523 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-2e23032e-3895-43e8-9c29-c38418f30a1b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.084608 May 03 09:20:52.180148 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1196/2224] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:52 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:52.206817 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ef391a08-c692-41ff-a1f7-735593e72435 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:52.207394 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ef391a08-c692-41ff-a1f7-735593e72435 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:52.214672 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ef391a08-c692-41ff-a1f7-735593e72435 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:52.215118 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ef391a08-c692-41ff-a1f7-735593e72435 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:52.216040 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ef391a08-c692-41ff-a1f7-735593e72435 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:52.216478 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ef391a08-c692-41ff-a1f7-735593e72435 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:52.349561 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ef391a08-c692-41ff-a1f7-735593e72435 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:52.358004 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ef391a08-c692-41ff-a1f7-735593e72435 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.155150 May 03 09:20:52.358557 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1029/2225] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:52 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:53.200848 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5ec06e69-c717-4a53-a7cb-eea1fc44872f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:53.201831 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5ec06e69-c717-4a53-a7cb-eea1fc44872f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:53.210627 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5ec06e69-c717-4a53-a7cb-eea1fc44872f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:53.211084 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5ec06e69-c717-4a53-a7cb-eea1fc44872f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:53.211887 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5ec06e69-c717-4a53-a7cb-eea1fc44872f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:53.212928 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5ec06e69-c717-4a53-a7cb-eea1fc44872f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:53.274015 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5ec06e69-c717-4a53-a7cb-eea1fc44872f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:53.282586 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5ec06e69-c717-4a53-a7cb-eea1fc44872f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.088365 May 03 09:20:53.283163 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1197/2226] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:53 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:53.379387 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5779ccac-046b-401c-9f94-ad8d6855d745 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:53.380331 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5779ccac-046b-401c-9f94-ad8d6855d745 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:53.388044 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5779ccac-046b-401c-9f94-ad8d6855d745 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:53.388489 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5779ccac-046b-401c-9f94-ad8d6855d745 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:53.389249 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5779ccac-046b-401c-9f94-ad8d6855d745 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:53.389681 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5779ccac-046b-401c-9f94-ad8d6855d745 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:53.522879 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5779ccac-046b-401c-9f94-ad8d6855d745 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:53.530851 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5779ccac-046b-401c-9f94-ad8d6855d745 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.158337 May 03 09:20:53.531436 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1030/2227] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:53 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:54.303994 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-69e8a2e8-e524-423a-b019-195b6e7d2463 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:54.305095 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-69e8a2e8-e524-423a-b019-195b6e7d2463 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:54.315836 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-69e8a2e8-e524-423a-b019-195b6e7d2463 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:54.316464 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-69e8a2e8-e524-423a-b019-195b6e7d2463 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:54.317231 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-69e8a2e8-e524-423a-b019-195b6e7d2463 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:54.317674 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-69e8a2e8-e524-423a-b019-195b6e7d2463 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:54.381725 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-69e8a2e8-e524-423a-b019-195b6e7d2463 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:54.390179 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-69e8a2e8-e524-423a-b019-195b6e7d2463 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.092891 May 03 09:20:54.390862 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1198/2228] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:54 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:54.552492 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-712f8517-1c1a-4eb8-a987-6f5abdd73f87 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:54.553004 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-712f8517-1c1a-4eb8-a987-6f5abdd73f87 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:54.559445 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-712f8517-1c1a-4eb8-a987-6f5abdd73f87 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:54.559931 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-712f8517-1c1a-4eb8-a987-6f5abdd73f87 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:54.560700 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-712f8517-1c1a-4eb8-a987-6f5abdd73f87 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:54.561139 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-712f8517-1c1a-4eb8-a987-6f5abdd73f87 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:54.701762 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-712f8517-1c1a-4eb8-a987-6f5abdd73f87 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:54.711954 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-712f8517-1c1a-4eb8-a987-6f5abdd73f87 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.166376 May 03 09:20:54.712897 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1031/2229] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:54 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:55.411686 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-05f6652b-85a9-47c5-ab91-76ef9fd3ab09 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:55.412689 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-05f6652b-85a9-47c5-ab91-76ef9fd3ab09 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:55.423467 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-05f6652b-85a9-47c5-ab91-76ef9fd3ab09 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:55.424360 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-05f6652b-85a9-47c5-ab91-76ef9fd3ab09 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:55.425618 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-05f6652b-85a9-47c5-ab91-76ef9fd3ab09 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:55.426398 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-05f6652b-85a9-47c5-ab91-76ef9fd3ab09 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:55.492097 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-05f6652b-85a9-47c5-ab91-76ef9fd3ab09 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:55.504196 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-05f6652b-85a9-47c5-ab91-76ef9fd3ab09 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.098841 May 03 09:20:55.505221 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1199/2230] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:55 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:55.730285 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a68b1602-1cc0-47ad-8448-1c6296948b7f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:55.730860 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a68b1602-1cc0-47ad-8448-1c6296948b7f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:55.737518 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a68b1602-1cc0-47ad-8448-1c6296948b7f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:55.737972 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a68b1602-1cc0-47ad-8448-1c6296948b7f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:55.738799 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a68b1602-1cc0-47ad-8448-1c6296948b7f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:55.739177 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a68b1602-1cc0-47ad-8448-1c6296948b7f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:55.872079 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a68b1602-1cc0-47ad-8448-1c6296948b7f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:55.883993 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a68b1602-1cc0-47ad-8448-1c6296948b7f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.157325 May 03 09:20:55.884787 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1032/2231] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:55 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:56.525990 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-1ce3cf15-0739-4e80-b15e-11c2d775e4ab tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:56.526868 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-1ce3cf15-0739-4e80-b15e-11c2d775e4ab tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:56.537051 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1ce3cf15-0739-4e80-b15e-11c2d775e4ab tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:56.537491 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1ce3cf15-0739-4e80-b15e-11c2d775e4ab tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:56.538244 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1ce3cf15-0739-4e80-b15e-11c2d775e4ab tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:56.538669 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1ce3cf15-0739-4e80-b15e-11c2d775e4ab tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:56.600933 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-1ce3cf15-0739-4e80-b15e-11c2d775e4ab tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:56.612715 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-1ce3cf15-0739-4e80-b15e-11c2d775e4ab tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.093381 May 03 09:20:56.613658 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1200/2232] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:56 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:56.909872 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-dab04b75-9ca6-4521-929a-ed3509b964aa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:56.910869 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-dab04b75-9ca6-4521-929a-ed3509b964aa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:56.921551 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dab04b75-9ca6-4521-929a-ed3509b964aa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:56.922301 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dab04b75-9ca6-4521-929a-ed3509b964aa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:56.923624 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dab04b75-9ca6-4521-929a-ed3509b964aa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:56.924390 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dab04b75-9ca6-4521-929a-ed3509b964aa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:57.081595 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-dab04b75-9ca6-4521-929a-ed3509b964aa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:57.094404 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-dab04b75-9ca6-4521-929a-ed3509b964aa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.190937 May 03 09:20:57.095242 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1033/2233] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:56 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:57.630668 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-aed39aca-a933-4bbd-86ed-15b02e94bd7c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:57.631278 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-aed39aca-a933-4bbd-86ed-15b02e94bd7c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:57.637684 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-aed39aca-a933-4bbd-86ed-15b02e94bd7c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:57.638131 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-aed39aca-a933-4bbd-86ed-15b02e94bd7c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:57.638885 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-aed39aca-a933-4bbd-86ed-15b02e94bd7c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:57.639312 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-aed39aca-a933-4bbd-86ed-15b02e94bd7c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:57.707417 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-aed39aca-a933-4bbd-86ed-15b02e94bd7c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:57.716530 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-aed39aca-a933-4bbd-86ed-15b02e94bd7c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.089967 May 03 09:20:57.717102 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1201/2234] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:57 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:58.112431 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-beeb9eb2-73c6-4c62-ba18-8e8ebc9ce4b8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:58.113057 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-beeb9eb2-73c6-4c62-ba18-8e8ebc9ce4b8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:58.120144 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-beeb9eb2-73c6-4c62-ba18-8e8ebc9ce4b8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:58.124794 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-beeb9eb2-73c6-4c62-ba18-8e8ebc9ce4b8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:58.125580 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-beeb9eb2-73c6-4c62-ba18-8e8ebc9ce4b8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:58.126014 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-beeb9eb2-73c6-4c62-ba18-8e8ebc9ce4b8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:58.276259 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-beeb9eb2-73c6-4c62-ba18-8e8ebc9ce4b8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:58.288460 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-beeb9eb2-73c6-4c62-ba18-8e8ebc9ce4b8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.179787 May 03 09:20:58.289253 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1034/2235] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:58 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:58.735231 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ca6fdd36-e721-41ea-b88e-1c7e3efc8aaf tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:58.736027 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ca6fdd36-e721-41ea-b88e-1c7e3efc8aaf tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:58.744224 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ca6fdd36-e721-41ea-b88e-1c7e3efc8aaf tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:58.744783 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ca6fdd36-e721-41ea-b88e-1c7e3efc8aaf tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:58.745718 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ca6fdd36-e721-41ea-b88e-1c7e3efc8aaf tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:58.746252 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ca6fdd36-e721-41ea-b88e-1c7e3efc8aaf tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:58.808812 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ca6fdd36-e721-41ea-b88e-1c7e3efc8aaf tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:58.817219 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ca6fdd36-e721-41ea-b88e-1c7e3efc8aaf tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.086904 May 03 09:20:58.817837 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1202/2236] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:58 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:59.314471 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9b01e2e5-9142-4b17-b1ed-92dc8054d5ee tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:59.315534 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9b01e2e5-9142-4b17-b1ed-92dc8054d5ee tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:59.323334 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9b01e2e5-9142-4b17-b1ed-92dc8054d5ee tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:59.323809 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9b01e2e5-9142-4b17-b1ed-92dc8054d5ee tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:59.324577 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9b01e2e5-9142-4b17-b1ed-92dc8054d5ee tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:59.325010 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9b01e2e5-9142-4b17-b1ed-92dc8054d5ee tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:59.467695 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9b01e2e5-9142-4b17-b1ed-92dc8054d5ee tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:59.476226 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9b01e2e5-9142-4b17-b1ed-92dc8054d5ee tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.168281 May 03 09:20:59.476773 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1035/2237] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:59 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:20:59.839126 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-0eb5cff6-a345-4897-995e-7ddbad97f877 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:20:59.840095 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-0eb5cff6-a345-4897-995e-7ddbad97f877 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:20:59.850610 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0eb5cff6-a345-4897-995e-7ddbad97f877 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:59.851366 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0eb5cff6-a345-4897-995e-7ddbad97f877 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:59.852680 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0eb5cff6-a345-4897-995e-7ddbad97f877 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:20:59.853404 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0eb5cff6-a345-4897-995e-7ddbad97f877 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:20:59.924335 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-0eb5cff6-a345-4897-995e-7ddbad97f877 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:20:59.932718 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-0eb5cff6-a345-4897-995e-7ddbad97f877 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.100721 May 03 09:20:59.933287 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1203/2238] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:20:59 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:00.497912 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b4c111e0-58d7-4259-aa5d-e965218e6a06 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:00.498811 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b4c111e0-58d7-4259-aa5d-e965218e6a06 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:00.509493 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b4c111e0-58d7-4259-aa5d-e965218e6a06 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:00.510240 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b4c111e0-58d7-4259-aa5d-e965218e6a06 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:00.511514 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b4c111e0-58d7-4259-aa5d-e965218e6a06 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:00.512278 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b4c111e0-58d7-4259-aa5d-e965218e6a06 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:00.643472 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b4c111e0-58d7-4259-aa5d-e965218e6a06 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:00.651482 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b4c111e0-58d7-4259-aa5d-e965218e6a06 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.160362 May 03 09:21:00.652103 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1036/2239] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:00 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:00.953703 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c7d971cf-18e1-4422-a695-9d61a1297d67 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:00.954699 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c7d971cf-18e1-4422-a695-9d61a1297d67 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:00.966156 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c7d971cf-18e1-4422-a695-9d61a1297d67 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:00.966900 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c7d971cf-18e1-4422-a695-9d61a1297d67 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:00.968222 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c7d971cf-18e1-4422-a695-9d61a1297d67 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:00.968937 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c7d971cf-18e1-4422-a695-9d61a1297d67 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:01.036284 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c7d971cf-18e1-4422-a695-9d61a1297d67 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:01.046816 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c7d971cf-18e1-4422-a695-9d61a1297d67 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.099587 May 03 09:21:01.047389 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1204/2240] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:00 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:01.671581 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-11b74b82-8226-469d-8490-89716603925c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:01.672335 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-11b74b82-8226-469d-8490-89716603925c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:01.680397 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-11b74b82-8226-469d-8490-89716603925c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:01.680828 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-11b74b82-8226-469d-8490-89716603925c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:01.682083 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-11b74b82-8226-469d-8490-89716603925c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:01.682609 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-11b74b82-8226-469d-8490-89716603925c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:01.825415 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-11b74b82-8226-469d-8490-89716603925c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:01.835707 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-11b74b82-8226-469d-8490-89716603925c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.170350 May 03 09:21:01.836317 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1037/2241] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:01 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:02.064884 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-bdd9697d-1aff-4dfd-93bc-7325964845fb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:02.065509 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-bdd9697d-1aff-4dfd-93bc-7325964845fb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:02.074648 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bdd9697d-1aff-4dfd-93bc-7325964845fb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:02.075028 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bdd9697d-1aff-4dfd-93bc-7325964845fb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:02.075805 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bdd9697d-1aff-4dfd-93bc-7325964845fb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:02.076257 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bdd9697d-1aff-4dfd-93bc-7325964845fb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:02.141937 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-bdd9697d-1aff-4dfd-93bc-7325964845fb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:02.150347 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-bdd9697d-1aff-4dfd-93bc-7325964845fb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.089417 May 03 09:21:02.150942 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1205/2242] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:02 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:02.927593 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b486b0e9-fec1-41ad-950f-edad85a3b3a0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:02.928306 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b486b0e9-fec1-41ad-950f-edad85a3b3a0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:02.934504 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b486b0e9-fec1-41ad-950f-edad85a3b3a0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:02.934958 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b486b0e9-fec1-41ad-950f-edad85a3b3a0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:02.935720 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b486b0e9-fec1-41ad-950f-edad85a3b3a0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:02.936182 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b486b0e9-fec1-41ad-950f-edad85a3b3a0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:03.093171 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b486b0e9-fec1-41ad-950f-edad85a3b3a0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:03.101615 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b486b0e9-fec1-41ad-950f-edad85a3b3a0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.251180 May 03 09:21:03.102234 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1038/2243] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:02 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:03.170445 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-20060316-ada3-43dd-8910-5a9a9b717bac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:03.171518 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-20060316-ada3-43dd-8910-5a9a9b717bac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:03.182134 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-20060316-ada3-43dd-8910-5a9a9b717bac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:03.182882 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-20060316-ada3-43dd-8910-5a9a9b717bac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:03.184230 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-20060316-ada3-43dd-8910-5a9a9b717bac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:03.184957 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-20060316-ada3-43dd-8910-5a9a9b717bac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:03.251442 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-20060316-ada3-43dd-8910-5a9a9b717bac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:03.259620 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-20060316-ada3-43dd-8910-5a9a9b717bac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.095656 May 03 09:21:03.260228 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1206/2244] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:03 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:04.123250 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-27a728da-2797-4983-9508-f076fd3b8f06 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:04.124197 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-27a728da-2797-4983-9508-f076fd3b8f06 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:04.134947 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-27a728da-2797-4983-9508-f076fd3b8f06 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:04.135830 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-27a728da-2797-4983-9508-f076fd3b8f06 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:04.137104 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-27a728da-2797-4983-9508-f076fd3b8f06 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:04.137828 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-27a728da-2797-4983-9508-f076fd3b8f06 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:04.272809 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-27a728da-2797-4983-9508-f076fd3b8f06 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:04.276959 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a37d9fbe-f2cc-4a2b-8b96-d41bc9f664bb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:04.277581 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a37d9fbe-f2cc-4a2b-8b96-d41bc9f664bb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:04.280898 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-27a728da-2797-4983-9508-f076fd3b8f06 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.164286 May 03 09:21:04.281428 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1039/2245] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:04 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:04.284086 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a37d9fbe-f2cc-4a2b-8b96-d41bc9f664bb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:04.284538 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a37d9fbe-f2cc-4a2b-8b96-d41bc9f664bb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:04.285305 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a37d9fbe-f2cc-4a2b-8b96-d41bc9f664bb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:04.285740 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a37d9fbe-f2cc-4a2b-8b96-d41bc9f664bb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:04.351226 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a37d9fbe-f2cc-4a2b-8b96-d41bc9f664bb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:04.359227 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a37d9fbe-f2cc-4a2b-8b96-d41bc9f664bb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.086218 May 03 09:21:04.359792 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1207/2246] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:04 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:05.301881 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-fba680ea-d04b-456f-ad8f-1c386db9c1ac tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:05.302900 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-fba680ea-d04b-456f-ad8f-1c386db9c1ac tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:05.313454 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fba680ea-d04b-456f-ad8f-1c386db9c1ac tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:05.314204 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fba680ea-d04b-456f-ad8f-1c386db9c1ac tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:05.315461 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fba680ea-d04b-456f-ad8f-1c386db9c1ac tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:05.316230 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fba680ea-d04b-456f-ad8f-1c386db9c1ac tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:05.435222 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-92dd9df4-3840-43bc-8707-4a7c63bf4961 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:05.435972 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-92dd9df4-3840-43bc-8707-4a7c63bf4961 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:05.442073 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-92dd9df4-3840-43bc-8707-4a7c63bf4961 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:05.442597 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-92dd9df4-3840-43bc-8707-4a7c63bf4961 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:05.443481 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-92dd9df4-3840-43bc-8707-4a7c63bf4961 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:05.444018 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-92dd9df4-3840-43bc-8707-4a7c63bf4961 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:05.452457 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-fba680ea-d04b-456f-ad8f-1c386db9c1ac tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:05.460233 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-fba680ea-d04b-456f-ad8f-1c386db9c1ac tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.164849 May 03 09:21:05.460803 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1040/2247] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:05 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:05.504331 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-92dd9df4-3840-43bc-8707-4a7c63bf4961 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:05.512866 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-92dd9df4-3840-43bc-8707-4a7c63bf4961 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.140411 May 03 09:21:05.513466 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1208/2248] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:05 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:21:06.481712 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-1d02db52-ad33-4d5e-853c-6d086232326d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:06.482570 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-1d02db52-ad33-4d5e-853c-6d086232326d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:06.492155 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1d02db52-ad33-4d5e-853c-6d086232326d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:06.492615 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1d02db52-ad33-4d5e-853c-6d086232326d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:06.493395 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1d02db52-ad33-4d5e-853c-6d086232326d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:06.493837 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1d02db52-ad33-4d5e-853c-6d086232326d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:06.529895 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e1247768-8091-47c6-8da0-6c18eb419aab tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:06.530510 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e1247768-8091-47c6-8da0-6c18eb419aab tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:06.537376 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e1247768-8091-47c6-8da0-6c18eb419aab tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:06.537833 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e1247768-8091-47c6-8da0-6c18eb419aab tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:06.538616 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e1247768-8091-47c6-8da0-6c18eb419aab tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:06.539025 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e1247768-8091-47c6-8da0-6c18eb419aab tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:06.614654 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e1247768-8091-47c6-8da0-6c18eb419aab tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:06.622721 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e1247768-8091-47c6-8da0-6c18eb419aab tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.096655 May 03 09:21:06.623304 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1209/2249] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:06 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:06.644011 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-1d02db52-ad33-4d5e-853c-6d086232326d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:06.652118 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-1d02db52-ad33-4d5e-853c-6d086232326d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.177192 May 03 09:21:06.652722 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1041/2250] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:06 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:07.644163 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-02642203-cad6-4537-8d96-a824a746ec9f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:07.645184 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-02642203-cad6-4537-8d96-a824a746ec9f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:07.656220 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-02642203-cad6-4537-8d96-a824a746ec9f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:07.656970 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-02642203-cad6-4537-8d96-a824a746ec9f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:07.658248 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-02642203-cad6-4537-8d96-a824a746ec9f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:07.658979 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-02642203-cad6-4537-8d96-a824a746ec9f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:07.669116 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5c434034-6d8a-430f-8838-384f6aebddb8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:07.669714 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5c434034-6d8a-430f-8838-384f6aebddb8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:07.676658 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5c434034-6d8a-430f-8838-384f6aebddb8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:07.677087 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5c434034-6d8a-430f-8838-384f6aebddb8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:07.677904 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5c434034-6d8a-430f-8838-384f6aebddb8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:07.678325 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5c434034-6d8a-430f-8838-384f6aebddb8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:07.728666 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-02642203-cad6-4537-8d96-a824a746ec9f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:07.736708 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-02642203-cad6-4537-8d96-a824a746ec9f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.099233 May 03 09:21:07.737291 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1210/2251] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:07 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:07.842857 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5c434034-6d8a-430f-8838-384f6aebddb8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:07.854460 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5c434034-6d8a-430f-8838-384f6aebddb8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.188946 May 03 09:21:07.855310 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1042/2252] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:07 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:08.757602 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-84f1db08-3e35-4d1f-8cfa-dbe942f0f79d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:08.758239 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-84f1db08-3e35-4d1f-8cfa-dbe942f0f79d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:08.768394 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-84f1db08-3e35-4d1f-8cfa-dbe942f0f79d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:08.768977 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-84f1db08-3e35-4d1f-8cfa-dbe942f0f79d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:08.770037 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-84f1db08-3e35-4d1f-8cfa-dbe942f0f79d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:08.770667 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-84f1db08-3e35-4d1f-8cfa-dbe942f0f79d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:08.835181 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-84f1db08-3e35-4d1f-8cfa-dbe942f0f79d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:08.847639 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-84f1db08-3e35-4d1f-8cfa-dbe942f0f79d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.096095 May 03 09:21:08.848450 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1211/2253] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:08 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:08.874614 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9e295f4d-9de8-46c4-b79e-55b06ed3ef49 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:08.875221 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9e295f4d-9de8-46c4-b79e-55b06ed3ef49 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:08.881848 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9e295f4d-9de8-46c4-b79e-55b06ed3ef49 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:08.882309 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9e295f4d-9de8-46c4-b79e-55b06ed3ef49 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:08.883054 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9e295f4d-9de8-46c4-b79e-55b06ed3ef49 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:08.883486 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9e295f4d-9de8-46c4-b79e-55b06ed3ef49 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:09.021447 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9e295f4d-9de8-46c4-b79e-55b06ed3ef49 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:09.030086 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9e295f4d-9de8-46c4-b79e-55b06ed3ef49 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.159350 May 03 09:21:09.030683 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1043/2254] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:08 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:09.872975 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-58eb2ae5-2118-40d5-b525-9ae99319b2b2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:09.874062 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-58eb2ae5-2118-40d5-b525-9ae99319b2b2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:09.883208 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-58eb2ae5-2118-40d5-b525-9ae99319b2b2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:09.883673 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-58eb2ae5-2118-40d5-b525-9ae99319b2b2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:09.884468 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-58eb2ae5-2118-40d5-b525-9ae99319b2b2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:09.884929 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-58eb2ae5-2118-40d5-b525-9ae99319b2b2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:09.956833 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-58eb2ae5-2118-40d5-b525-9ae99319b2b2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:09.965780 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-58eb2ae5-2118-40d5-b525-9ae99319b2b2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.099356 May 03 09:21:09.966351 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1212/2255] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:09 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:10.051837 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-50a052c3-3383-4d5e-a775-8ef2fd0d9c77 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:10.052830 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-50a052c3-3383-4d5e-a775-8ef2fd0d9c77 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:10.063637 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-50a052c3-3383-4d5e-a775-8ef2fd0d9c77 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:10.064428 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-50a052c3-3383-4d5e-a775-8ef2fd0d9c77 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:10.065681 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-50a052c3-3383-4d5e-a775-8ef2fd0d9c77 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:10.066396 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-50a052c3-3383-4d5e-a775-8ef2fd0d9c77 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:10.207264 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-50a052c3-3383-4d5e-a775-8ef2fd0d9c77 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:10.216297 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-50a052c3-3383-4d5e-a775-8ef2fd0d9c77 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.171021 May 03 09:21:10.216875 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1044/2256] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:10 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:10.984418 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d85cbcf5-0693-4d89-bcb8-e2935b163e8f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:10.985078 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d85cbcf5-0693-4d89-bcb8-e2935b163e8f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:10.992754 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d85cbcf5-0693-4d89-bcb8-e2935b163e8f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:10.993229 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d85cbcf5-0693-4d89-bcb8-e2935b163e8f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:10.993998 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d85cbcf5-0693-4d89-bcb8-e2935b163e8f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:10.994435 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d85cbcf5-0693-4d89-bcb8-e2935b163e8f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:11.054500 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d85cbcf5-0693-4d89-bcb8-e2935b163e8f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:11.062601 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d85cbcf5-0693-4d89-bcb8-e2935b163e8f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.083225 May 03 09:21:11.063198 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1213/2257] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:10 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:11.233399 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9f524072-8c3e-40d6-b0f0-d60b6b861371 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:11.234028 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9f524072-8c3e-40d6-b0f0-d60b6b861371 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:11.240945 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9f524072-8c3e-40d6-b0f0-d60b6b861371 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:11.241333 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9f524072-8c3e-40d6-b0f0-d60b6b861371 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:11.242102 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9f524072-8c3e-40d6-b0f0-d60b6b861371 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:11.242538 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9f524072-8c3e-40d6-b0f0-d60b6b861371 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:11.375143 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9f524072-8c3e-40d6-b0f0-d60b6b861371 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:11.384808 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9f524072-8c3e-40d6-b0f0-d60b6b861371 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.155357 May 03 09:21:11.385384 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1045/2258] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:11 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:12.089888 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f638363a-1388-4475-a169-dafa4b1c66e9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:12.090838 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f638363a-1388-4475-a169-dafa4b1c66e9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:12.100703 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f638363a-1388-4475-a169-dafa4b1c66e9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:12.101149 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f638363a-1388-4475-a169-dafa4b1c66e9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:12.101899 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f638363a-1388-4475-a169-dafa4b1c66e9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:12.102326 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f638363a-1388-4475-a169-dafa4b1c66e9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:12.175693 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f638363a-1388-4475-a169-dafa4b1c66e9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:12.183690 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f638363a-1388-4475-a169-dafa4b1c66e9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.100911 May 03 09:21:12.184286 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1214/2259] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:12 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:12.405763 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d31bf8f9-05c4-45a2-b18e-b528c23911f6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:12.406720 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d31bf8f9-05c4-45a2-b18e-b528c23911f6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:12.417411 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d31bf8f9-05c4-45a2-b18e-b528c23911f6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:12.418164 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d31bf8f9-05c4-45a2-b18e-b528c23911f6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:12.420808 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d31bf8f9-05c4-45a2-b18e-b528c23911f6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:12.420808 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d31bf8f9-05c4-45a2-b18e-b528c23911f6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:12.558358 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d31bf8f9-05c4-45a2-b18e-b528c23911f6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:12.566212 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d31bf8f9-05c4-45a2-b18e-b528c23911f6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.167269 May 03 09:21:12.567124 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1046/2260] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:12 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:13.204084 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-6225ad8b-713b-422a-b981-fcff181c9d01 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:13.204859 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-6225ad8b-713b-422a-b981-fcff181c9d01 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:13.213149 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6225ad8b-713b-422a-b981-fcff181c9d01 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:13.213417 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6225ad8b-713b-422a-b981-fcff181c9d01 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:13.214181 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6225ad8b-713b-422a-b981-fcff181c9d01 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:13.214610 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6225ad8b-713b-422a-b981-fcff181c9d01 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:13.277239 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-6225ad8b-713b-422a-b981-fcff181c9d01 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:13.285376 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-6225ad8b-713b-422a-b981-fcff181c9d01 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.086907 May 03 09:21:13.285956 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1215/2261] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:13 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:13.588501 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f4910fd5-e530-4217-8baf-ed2ce39d5412 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:13.589362 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f4910fd5-e530-4217-8baf-ed2ce39d5412 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:13.599936 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f4910fd5-e530-4217-8baf-ed2ce39d5412 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:13.600386 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f4910fd5-e530-4217-8baf-ed2ce39d5412 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:13.601155 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f4910fd5-e530-4217-8baf-ed2ce39d5412 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:13.601586 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f4910fd5-e530-4217-8baf-ed2ce39d5412 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:13.752138 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f4910fd5-e530-4217-8baf-ed2ce39d5412 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:13.765273 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f4910fd5-e530-4217-8baf-ed2ce39d5412 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.183998 May 03 09:21:13.765847 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1047/2262] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:13 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:14.306621 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-4a488e41-23b4-472e-b2e6-11c1f1381d72 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:14.307594 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-4a488e41-23b4-472e-b2e6-11c1f1381d72 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:14.318261 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4a488e41-23b4-472e-b2e6-11c1f1381d72 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:14.318710 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4a488e41-23b4-472e-b2e6-11c1f1381d72 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:14.319474 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4a488e41-23b4-472e-b2e6-11c1f1381d72 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:14.319950 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4a488e41-23b4-472e-b2e6-11c1f1381d72 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:14.381162 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-4a488e41-23b4-472e-b2e6-11c1f1381d72 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:14.389104 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-4a488e41-23b4-472e-b2e6-11c1f1381d72 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.089045 May 03 09:21:14.389669 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1216/2263] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:14 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:14.786706 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0fa207d2-6197-4f40-8eff-34bd63f7644c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:14.787750 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0fa207d2-6197-4f40-8eff-34bd63f7644c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:14.798467 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0fa207d2-6197-4f40-8eff-34bd63f7644c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:14.799206 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0fa207d2-6197-4f40-8eff-34bd63f7644c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:14.800519 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0fa207d2-6197-4f40-8eff-34bd63f7644c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:14.801238 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0fa207d2-6197-4f40-8eff-34bd63f7644c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:14.943598 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0fa207d2-6197-4f40-8eff-34bd63f7644c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:14.952155 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0fa207d2-6197-4f40-8eff-34bd63f7644c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.172106 May 03 09:21:14.952733 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1048/2264] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:14 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:15.409641 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-635d56f5-dbfc-4809-89a4-5283da9b5537 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:15.410608 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-635d56f5-dbfc-4809-89a4-5283da9b5537 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:15.421344 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-635d56f5-dbfc-4809-89a4-5283da9b5537 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:15.422091 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-635d56f5-dbfc-4809-89a4-5283da9b5537 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:15.423402 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-635d56f5-dbfc-4809-89a4-5283da9b5537 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:15.424129 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-635d56f5-dbfc-4809-89a4-5283da9b5537 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:15.493155 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-635d56f5-dbfc-4809-89a4-5283da9b5537 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:15.501845 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-635d56f5-dbfc-4809-89a4-5283da9b5537 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.098784 May 03 09:21:15.502478 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1217/2265] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:15 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:15.972685 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-363c29a5-2771-4a94-92db-236c4e69504a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:15.973323 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-363c29a5-2771-4a94-92db-236c4e69504a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:15.981834 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-363c29a5-2771-4a94-92db-236c4e69504a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:15.982401 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-363c29a5-2771-4a94-92db-236c4e69504a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:15.983354 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-363c29a5-2771-4a94-92db-236c4e69504a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:15.983957 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-363c29a5-2771-4a94-92db-236c4e69504a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:16.122342 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-363c29a5-2771-4a94-92db-236c4e69504a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:16.134505 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-363c29a5-2771-4a94-92db-236c4e69504a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.167961 May 03 09:21:16.135272 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1049/2266] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:15 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:16.527850 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-22f55ccb-7cda-40ba-9a0f-6a81a284a6da tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:16.528883 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-22f55ccb-7cda-40ba-9a0f-6a81a284a6da tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:16.538506 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-22f55ccb-7cda-40ba-9a0f-6a81a284a6da tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:16.538954 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-22f55ccb-7cda-40ba-9a0f-6a81a284a6da tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:16.539730 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-22f55ccb-7cda-40ba-9a0f-6a81a284a6da tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:16.540201 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-22f55ccb-7cda-40ba-9a0f-6a81a284a6da tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:16.611737 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-22f55ccb-7cda-40ba-9a0f-6a81a284a6da tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:16.620191 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-22f55ccb-7cda-40ba-9a0f-6a81a284a6da tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.098927 May 03 09:21:16.620772 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1218/2267] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:16 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:17.159988 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-8b312ba7-ceae-4e91-a06d-9b0fe61bef57 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:17.160935 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-8b312ba7-ceae-4e91-a06d-9b0fe61bef57 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:17.171527 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8b312ba7-ceae-4e91-a06d-9b0fe61bef57 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:17.172322 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8b312ba7-ceae-4e91-a06d-9b0fe61bef57 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:17.173566 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8b312ba7-ceae-4e91-a06d-9b0fe61bef57 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:17.174279 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8b312ba7-ceae-4e91-a06d-9b0fe61bef57 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:17.316569 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-8b312ba7-ceae-4e91-a06d-9b0fe61bef57 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:17.324786 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-8b312ba7-ceae-4e91-a06d-9b0fe61bef57 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.171450 May 03 09:21:17.325386 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1050/2268] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:17 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:17.644481 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-6aec091c-3a9f-449b-b5ee-a1741761e87a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:17.645499 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-6aec091c-3a9f-449b-b5ee-a1741761e87a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:17.653049 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6aec091c-3a9f-449b-b5ee-a1741761e87a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:17.653542 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6aec091c-3a9f-449b-b5ee-a1741761e87a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:17.654376 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6aec091c-3a9f-449b-b5ee-a1741761e87a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:17.654849 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6aec091c-3a9f-449b-b5ee-a1741761e87a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:17.728417 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-6aec091c-3a9f-449b-b5ee-a1741761e87a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:17.740564 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-6aec091c-3a9f-449b-b5ee-a1741761e87a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.102540 May 03 09:21:17.741118 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1219/2269] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:17 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:18.346623 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d3aa6274-5e19-4500-b196-1eab11d0ae25 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:18.347611 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d3aa6274-5e19-4500-b196-1eab11d0ae25 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:18.358167 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d3aa6274-5e19-4500-b196-1eab11d0ae25 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:18.358913 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d3aa6274-5e19-4500-b196-1eab11d0ae25 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:18.360213 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d3aa6274-5e19-4500-b196-1eab11d0ae25 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:18.360944 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d3aa6274-5e19-4500-b196-1eab11d0ae25 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:18.490757 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d3aa6274-5e19-4500-b196-1eab11d0ae25 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:18.498739 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d3aa6274-5e19-4500-b196-1eab11d0ae25 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.158636 May 03 09:21:18.499318 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1051/2270] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:18 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:18.764188 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3928e7a7-6e50-47ad-a9b4-bc99c24b26dd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:18.764830 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-3928e7a7-6e50-47ad-a9b4-bc99c24b26dd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:18.772614 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3928e7a7-6e50-47ad-a9b4-bc99c24b26dd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:18.773139 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3928e7a7-6e50-47ad-a9b4-bc99c24b26dd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:18.774046 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3928e7a7-6e50-47ad-a9b4-bc99c24b26dd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:18.774544 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3928e7a7-6e50-47ad-a9b4-bc99c24b26dd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:18.849378 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-3928e7a7-6e50-47ad-a9b4-bc99c24b26dd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:18.857919 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-3928e7a7-6e50-47ad-a9b4-bc99c24b26dd tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.098414 May 03 09:21:18.858487 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1220/2271] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:18 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:19.520437 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d132aa22-da6a-4ffa-9e46-27aac4904464 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:19.521308 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d132aa22-da6a-4ffa-9e46-27aac4904464 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:19.532250 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d132aa22-da6a-4ffa-9e46-27aac4904464 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:19.533008 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d132aa22-da6a-4ffa-9e46-27aac4904464 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:19.534263 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d132aa22-da6a-4ffa-9e46-27aac4904464 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:19.534990 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d132aa22-da6a-4ffa-9e46-27aac4904464 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:19.668087 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d132aa22-da6a-4ffa-9e46-27aac4904464 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:19.680118 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d132aa22-da6a-4ffa-9e46-27aac4904464 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.166077 May 03 09:21:19.680911 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1052/2272] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:19 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:19.880296 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-da4f89dd-3f06-4ef6-93c7-ba1840710ab9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:19.881176 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-da4f89dd-3f06-4ef6-93c7-ba1840710ab9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:19.892056 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-da4f89dd-3f06-4ef6-93c7-ba1840710ab9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:19.892805 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-da4f89dd-3f06-4ef6-93c7-ba1840710ab9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:19.894067 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-da4f89dd-3f06-4ef6-93c7-ba1840710ab9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:19.894786 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-da4f89dd-3f06-4ef6-93c7-ba1840710ab9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:19.957265 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-da4f89dd-3f06-4ef6-93c7-ba1840710ab9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:19.966501 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-da4f89dd-3f06-4ef6-93c7-ba1840710ab9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.093324 May 03 09:21:19.967078 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1221/2273] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:19 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:20.705994 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-552ef236-8302-491e-a7b4-d85f12b9e168 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:20.706914 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-552ef236-8302-491e-a7b4-d85f12b9e168 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:20.715141 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-552ef236-8302-491e-a7b4-d85f12b9e168 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:20.715589 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-552ef236-8302-491e-a7b4-d85f12b9e168 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:20.716382 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-552ef236-8302-491e-a7b4-d85f12b9e168 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:20.716812 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-552ef236-8302-491e-a7b4-d85f12b9e168 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:20.860171 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-552ef236-8302-491e-a7b4-d85f12b9e168 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:20.870138 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-552ef236-8302-491e-a7b4-d85f12b9e168 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.170663 May 03 09:21:20.870723 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1053/2274] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:20 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:20.987658 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5cd1b547-61f9-4277-9ad2-a1568059847c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:20.988611 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5cd1b547-61f9-4277-9ad2-a1568059847c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:20.999238 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5cd1b547-61f9-4277-9ad2-a1568059847c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:21.000056 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5cd1b547-61f9-4277-9ad2-a1568059847c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:21.001362 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5cd1b547-61f9-4277-9ad2-a1568059847c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:21.002087 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5cd1b547-61f9-4277-9ad2-a1568059847c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:21.075113 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5cd1b547-61f9-4277-9ad2-a1568059847c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:21.087271 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5cd1b547-61f9-4277-9ad2-a1568059847c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.105615 May 03 09:21:21.088079 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1222/2275] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:20 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:21.889443 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9a6c27fe-64be-4361-b134-c0a76c016597 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:21.890144 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9a6c27fe-64be-4361-b134-c0a76c016597 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:21.898126 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9a6c27fe-64be-4361-b134-c0a76c016597 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:21.898647 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9a6c27fe-64be-4361-b134-c0a76c016597 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:21.899536 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9a6c27fe-64be-4361-b134-c0a76c016597 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:21.900087 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9a6c27fe-64be-4361-b134-c0a76c016597 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:22.034251 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9a6c27fe-64be-4361-b134-c0a76c016597 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:22.047169 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9a6c27fe-64be-4361-b134-c0a76c016597 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.162088 May 03 09:21:22.048014 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1054/2276] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:21 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:22.107462 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-281c5ba0-0e99-4e0e-8bf2-e4ca41508f2b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:22.108480 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-281c5ba0-0e99-4e0e-8bf2-e4ca41508f2b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:22.117691 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-281c5ba0-0e99-4e0e-8bf2-e4ca41508f2b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:22.118180 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-281c5ba0-0e99-4e0e-8bf2-e4ca41508f2b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:22.118943 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-281c5ba0-0e99-4e0e-8bf2-e4ca41508f2b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:22.119374 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-281c5ba0-0e99-4e0e-8bf2-e4ca41508f2b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:22.200855 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-281c5ba0-0e99-4e0e-8bf2-e4ca41508f2b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:22.209853 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-281c5ba0-0e99-4e0e-8bf2-e4ca41508f2b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.108289 May 03 09:21:22.210436 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1223/2277] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:22 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:23.071108 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e905e8f1-e3ad-4940-954f-ed38a4b7744d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:23.072012 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e905e8f1-e3ad-4940-954f-ed38a4b7744d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:23.082683 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e905e8f1-e3ad-4940-954f-ed38a4b7744d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:23.083431 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e905e8f1-e3ad-4940-954f-ed38a4b7744d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:23.084932 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e905e8f1-e3ad-4940-954f-ed38a4b7744d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:23.085362 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e905e8f1-e3ad-4940-954f-ed38a4b7744d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:23.222329 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e905e8f1-e3ad-4940-954f-ed38a4b7744d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:23.226612 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-0e7d3b6c-ee67-45cb-8f43-bcb52b5220b9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:23.227223 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-0e7d3b6c-ee67-45cb-8f43-bcb52b5220b9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:23.232792 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e905e8f1-e3ad-4940-954f-ed38a4b7744d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.168407 May 03 09:21:23.233783 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1055/2278] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:23 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:23.233980 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0e7d3b6c-ee67-45cb-8f43-bcb52b5220b9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:23.234445 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0e7d3b6c-ee67-45cb-8f43-bcb52b5220b9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:23.235274 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0e7d3b6c-ee67-45cb-8f43-bcb52b5220b9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:23.235706 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0e7d3b6c-ee67-45cb-8f43-bcb52b5220b9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:23.296261 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-0e7d3b6c-ee67-45cb-8f43-bcb52b5220b9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:23.304184 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-0e7d3b6c-ee67-45cb-8f43-bcb52b5220b9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.081486 May 03 09:21:23.304755 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1224/2279] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:23 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:24.250861 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c912ea0d-405a-4bb4-8464-e45d23e396e1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:24.251477 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c912ea0d-405a-4bb4-8464-e45d23e396e1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:24.258030 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c912ea0d-405a-4bb4-8464-e45d23e396e1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:24.258475 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c912ea0d-405a-4bb4-8464-e45d23e396e1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:24.259231 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c912ea0d-405a-4bb4-8464-e45d23e396e1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:24.259659 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c912ea0d-405a-4bb4-8464-e45d23e396e1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:24.321222 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-56780c53-ffc9-4343-be8c-77ba83c3bb0c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:24.321858 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-56780c53-ffc9-4343-be8c-77ba83c3bb0c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:24.328551 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-56780c53-ffc9-4343-be8c-77ba83c3bb0c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:24.328999 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-56780c53-ffc9-4343-be8c-77ba83c3bb0c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:24.329995 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-56780c53-ffc9-4343-be8c-77ba83c3bb0c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:24.330493 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-56780c53-ffc9-4343-be8c-77ba83c3bb0c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:24.403801 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-56780c53-ffc9-4343-be8c-77ba83c3bb0c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:24.415820 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-56780c53-ffc9-4343-be8c-77ba83c3bb0c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.098174 May 03 09:21:24.416645 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1225/2280] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:24 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:24.428232 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c912ea0d-405a-4bb4-8464-e45d23e396e1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:24.436891 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c912ea0d-405a-4bb4-8464-e45d23e396e1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.190159 May 03 09:21:24.437452 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1056/2281] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:24 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:25.440177 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-0213daff-3bde-41eb-af64-7126ba798d87 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:25.441164 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-0213daff-3bde-41eb-af64-7126ba798d87 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:25.449777 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0213daff-3bde-41eb-af64-7126ba798d87 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:25.450221 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0213daff-3bde-41eb-af64-7126ba798d87 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:25.451000 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0213daff-3bde-41eb-af64-7126ba798d87 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:25.451430 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0213daff-3bde-41eb-af64-7126ba798d87 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:25.454306 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-16b9ad84-5023-419b-88be-2c16d69e644f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:25.454950 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-16b9ad84-5023-419b-88be-2c16d69e644f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:25.461851 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-16b9ad84-5023-419b-88be-2c16d69e644f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:25.462301 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-16b9ad84-5023-419b-88be-2c16d69e644f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:25.463062 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-16b9ad84-5023-419b-88be-2c16d69e644f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:25.463498 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-16b9ad84-5023-419b-88be-2c16d69e644f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:25.528671 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-0213daff-3bde-41eb-af64-7126ba798d87 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:25.536972 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-0213daff-3bde-41eb-af64-7126ba798d87 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.103307 May 03 09:21:25.537589 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1226/2282] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:25 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:25.611917 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-16b9ad84-5023-419b-88be-2c16d69e644f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:25.620142 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-16b9ad84-5023-419b-88be-2c16d69e644f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.169717 May 03 09:21:25.620683 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1057/2283] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:25 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:26.559032 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-1b0ad536-8430-4867-a750-e80682e71bc2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:26.559893 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-1b0ad536-8430-4867-a750-e80682e71bc2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:26.570190 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1b0ad536-8430-4867-a750-e80682e71bc2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:26.570942 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1b0ad536-8430-4867-a750-e80682e71bc2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:26.572271 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1b0ad536-8430-4867-a750-e80682e71bc2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:26.572993 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1b0ad536-8430-4867-a750-e80682e71bc2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:26.637566 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c8ff96d0-fd6f-4cf2-a27d-658dcee89f54 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:26.638228 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c8ff96d0-fd6f-4cf2-a27d-658dcee89f54 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:26.644802 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-1b0ad536-8430-4867-a750-e80682e71bc2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:26.644970 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c8ff96d0-fd6f-4cf2-a27d-658dcee89f54 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:26.645228 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c8ff96d0-fd6f-4cf2-a27d-658dcee89f54 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:26.645999 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c8ff96d0-fd6f-4cf2-a27d-658dcee89f54 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:26.646432 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c8ff96d0-fd6f-4cf2-a27d-658dcee89f54 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:26.653531 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-1b0ad536-8430-4867-a750-e80682e71bc2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.101574 May 03 09:21:26.654238 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1227/2284] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:26 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:26.778942 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c8ff96d0-fd6f-4cf2-a27d-658dcee89f54 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:26.787344 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c8ff96d0-fd6f-4cf2-a27d-658dcee89f54 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.153933 May 03 09:21:26.787967 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1058/2285] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:26 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:27.676166 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-93167201-cdf8-4648-b6c0-6fe24dc9e3f1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:27.676931 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-93167201-cdf8-4648-b6c0-6fe24dc9e3f1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:27.687584 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-93167201-cdf8-4648-b6c0-6fe24dc9e3f1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:27.688379 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-93167201-cdf8-4648-b6c0-6fe24dc9e3f1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:27.689631 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-93167201-cdf8-4648-b6c0-6fe24dc9e3f1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:27.690290 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-93167201-cdf8-4648-b6c0-6fe24dc9e3f1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:27.755165 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-93167201-cdf8-4648-b6c0-6fe24dc9e3f1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:27.763505 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-93167201-cdf8-4648-b6c0-6fe24dc9e3f1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.094229 May 03 09:21:27.764124 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1228/2286] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:27 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:27.805127 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-72b16d5f-375d-4791-b9d2-24ed04c8a91d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:27.805772 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-72b16d5f-375d-4791-b9d2-24ed04c8a91d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:27.812292 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-72b16d5f-375d-4791-b9d2-24ed04c8a91d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:27.812762 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-72b16d5f-375d-4791-b9d2-24ed04c8a91d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:27.813529 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-72b16d5f-375d-4791-b9d2-24ed04c8a91d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:27.813965 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-72b16d5f-375d-4791-b9d2-24ed04c8a91d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:27.961687 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-72b16d5f-375d-4791-b9d2-24ed04c8a91d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:27.970013 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-72b16d5f-375d-4791-b9d2-24ed04c8a91d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.168880 May 03 09:21:27.970584 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1059/2287] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:27 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:28.784232 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-0dc11253-0f10-4f27-aecf-515d7b45b349 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:28.785228 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-0dc11253-0f10-4f27-aecf-515d7b45b349 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:28.796087 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0dc11253-0f10-4f27-aecf-515d7b45b349 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:28.796834 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0dc11253-0f10-4f27-aecf-515d7b45b349 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:28.798080 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0dc11253-0f10-4f27-aecf-515d7b45b349 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:28.798804 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0dc11253-0f10-4f27-aecf-515d7b45b349 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:28.862204 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-0dc11253-0f10-4f27-aecf-515d7b45b349 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:28.870259 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-0dc11253-0f10-4f27-aecf-515d7b45b349 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.092708 May 03 09:21:28.870818 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1229/2288] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:28 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:28.991381 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-1e330a1b-7b86-4bda-b658-c903a72ddb5b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:28.992412 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-1e330a1b-7b86-4bda-b658-c903a72ddb5b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:28.999992 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1e330a1b-7b86-4bda-b658-c903a72ddb5b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:29.000521 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1e330a1b-7b86-4bda-b658-c903a72ddb5b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:29.001403 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1e330a1b-7b86-4bda-b658-c903a72ddb5b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:29.001918 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1e330a1b-7b86-4bda-b658-c903a72ddb5b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:29.133680 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-1e330a1b-7b86-4bda-b658-c903a72ddb5b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:29.141559 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-1e330a1b-7b86-4bda-b658-c903a72ddb5b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.156746 May 03 09:21:29.142110 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1060/2289] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:28 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:29.891475 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-361f7a6e-a3c3-4218-a122-d3ea5a2e4403 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:29.892478 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-361f7a6e-a3c3-4218-a122-d3ea5a2e4403 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:29.903970 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-361f7a6e-a3c3-4218-a122-d3ea5a2e4403 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:29.904776 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-361f7a6e-a3c3-4218-a122-d3ea5a2e4403 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:29.906100 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-361f7a6e-a3c3-4218-a122-d3ea5a2e4403 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:29.906803 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-361f7a6e-a3c3-4218-a122-d3ea5a2e4403 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:29.982018 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-361f7a6e-a3c3-4218-a122-d3ea5a2e4403 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:29.994508 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-361f7a6e-a3c3-4218-a122-d3ea5a2e4403 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.109162 May 03 09:21:29.995404 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1230/2290] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:29 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:30.162669 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-1c3e95e5-d5c4-4db4-99b3-f4b2519fea24 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:30.163513 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-1c3e95e5-d5c4-4db4-99b3-f4b2519fea24 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:30.171590 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1c3e95e5-d5c4-4db4-99b3-f4b2519fea24 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:30.172157 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1c3e95e5-d5c4-4db4-99b3-f4b2519fea24 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:30.173060 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1c3e95e5-d5c4-4db4-99b3-f4b2519fea24 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:30.173576 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1c3e95e5-d5c4-4db4-99b3-f4b2519fea24 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:30.316328 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-1c3e95e5-d5c4-4db4-99b3-f4b2519fea24 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:30.325680 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-1c3e95e5-d5c4-4db4-99b3-f4b2519fea24 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.169721 May 03 09:21:30.326258 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1061/2291] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:30 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:31.017076 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e38f14a8-ac4b-475f-b8bf-bd64138cffa1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:31.017960 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e38f14a8-ac4b-475f-b8bf-bd64138cffa1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:31.026666 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e38f14a8-ac4b-475f-b8bf-bd64138cffa1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:31.027111 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e38f14a8-ac4b-475f-b8bf-bd64138cffa1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:31.027895 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e38f14a8-ac4b-475f-b8bf-bd64138cffa1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:31.028328 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e38f14a8-ac4b-475f-b8bf-bd64138cffa1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:31.090817 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e38f14a8-ac4b-475f-b8bf-bd64138cffa1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:31.098764 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e38f14a8-ac4b-475f-b8bf-bd64138cffa1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.088413 May 03 09:21:31.099326 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1231/2292] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:31 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:31.346173 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-fa74e3eb-a9da-4ddd-ab84-201de12e102e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:31.346773 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-fa74e3eb-a9da-4ddd-ab84-201de12e102e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:31.353449 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fa74e3eb-a9da-4ddd-ab84-201de12e102e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:31.353893 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fa74e3eb-a9da-4ddd-ab84-201de12e102e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:31.354674 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fa74e3eb-a9da-4ddd-ab84-201de12e102e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:31.355114 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fa74e3eb-a9da-4ddd-ab84-201de12e102e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:31.486207 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-fa74e3eb-a9da-4ddd-ab84-201de12e102e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:31.498955 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-fa74e3eb-a9da-4ddd-ab84-201de12e102e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.156608 May 03 09:21:31.499738 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1062/2293] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:31 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:32.116085 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9956f307-bb37-4a3e-a0fd-0a24c29eefbf tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:32.116709 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9956f307-bb37-4a3e-a0fd-0a24c29eefbf tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:32.127446 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9956f307-bb37-4a3e-a0fd-0a24c29eefbf tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:32.128256 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9956f307-bb37-4a3e-a0fd-0a24c29eefbf tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:32.129504 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9956f307-bb37-4a3e-a0fd-0a24c29eefbf tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:32.130235 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9956f307-bb37-4a3e-a0fd-0a24c29eefbf tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:32.195327 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9956f307-bb37-4a3e-a0fd-0a24c29eefbf tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:32.203416 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9956f307-bb37-4a3e-a0fd-0a24c29eefbf tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.091322 May 03 09:21:32.204323 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1232/2294] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:32 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:32.522787 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-932613f8-2deb-4f94-97bf-f0311fec735f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:32.523693 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-932613f8-2deb-4f94-97bf-f0311fec735f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:32.531417 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-932613f8-2deb-4f94-97bf-f0311fec735f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:32.532113 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-932613f8-2deb-4f94-97bf-f0311fec735f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:32.533300 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-932613f8-2deb-4f94-97bf-f0311fec735f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:32.533897 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-932613f8-2deb-4f94-97bf-f0311fec735f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:32.668557 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-932613f8-2deb-4f94-97bf-f0311fec735f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:32.677114 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-932613f8-2deb-4f94-97bf-f0311fec735f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.160897 May 03 09:21:32.677700 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1063/2295] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:32 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:33.225204 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-dda88757-ba0a-49a8-8fd9-0f65bf4b65b6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:33.226206 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-dda88757-ba0a-49a8-8fd9-0f65bf4b65b6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:33.233177 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dda88757-ba0a-49a8-8fd9-0f65bf4b65b6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:33.233622 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dda88757-ba0a-49a8-8fd9-0f65bf4b65b6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:33.234414 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dda88757-ba0a-49a8-8fd9-0f65bf4b65b6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:33.234818 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dda88757-ba0a-49a8-8fd9-0f65bf4b65b6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:33.298480 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-dda88757-ba0a-49a8-8fd9-0f65bf4b65b6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:33.306689 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-dda88757-ba0a-49a8-8fd9-0f65bf4b65b6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.087910 May 03 09:21:33.307310 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1233/2296] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:33 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:33.698845 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-fd4508dd-e50c-434a-be97-f404518c5d98 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:33.699951 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-fd4508dd-e50c-434a-be97-f404518c5d98 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:33.710714 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fd4508dd-e50c-434a-be97-f404518c5d98 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:33.712109 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fd4508dd-e50c-434a-be97-f404518c5d98 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:33.713903 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fd4508dd-e50c-434a-be97-f404518c5d98 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:33.714931 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fd4508dd-e50c-434a-be97-f404518c5d98 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:33.856363 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-fd4508dd-e50c-434a-be97-f404518c5d98 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:33.869430 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-fd4508dd-e50c-434a-be97-f404518c5d98 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.176890 May 03 09:21:33.870166 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1064/2297] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:33 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:34.328132 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-073295dc-37c7-4999-a844-7a12b816de43 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:34.329180 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-073295dc-37c7-4999-a844-7a12b816de43 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:34.338941 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-073295dc-37c7-4999-a844-7a12b816de43 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:34.339388 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-073295dc-37c7-4999-a844-7a12b816de43 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:34.340167 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-073295dc-37c7-4999-a844-7a12b816de43 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:34.340593 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-073295dc-37c7-4999-a844-7a12b816de43 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:34.401736 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-073295dc-37c7-4999-a844-7a12b816de43 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:34.410095 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-073295dc-37c7-4999-a844-7a12b816de43 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.088569 May 03 09:21:34.410662 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1234/2298] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:34 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:34.895684 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6ce5fee2-2bc1-408b-afbc-1eab0f61eacb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:34.896742 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6ce5fee2-2bc1-408b-afbc-1eab0f61eacb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:34.904927 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6ce5fee2-2bc1-408b-afbc-1eab0f61eacb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:34.905430 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6ce5fee2-2bc1-408b-afbc-1eab0f61eacb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:34.906295 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6ce5fee2-2bc1-408b-afbc-1eab0f61eacb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:34.906782 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6ce5fee2-2bc1-408b-afbc-1eab0f61eacb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:35.049446 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6ce5fee2-2bc1-408b-afbc-1eab0f61eacb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:35.058045 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6ce5fee2-2bc1-408b-afbc-1eab0f61eacb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.168860 May 03 09:21:35.058630 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1065/2299] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:34 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:35.431474 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-afefc629-ba63-436f-933b-080e2bdc5ecb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:35.432481 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-afefc629-ba63-436f-933b-080e2bdc5ecb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:35.443158 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-afefc629-ba63-436f-933b-080e2bdc5ecb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:35.443950 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-afefc629-ba63-436f-933b-080e2bdc5ecb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:35.445196 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-afefc629-ba63-436f-933b-080e2bdc5ecb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:35.445789 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-afefc629-ba63-436f-933b-080e2bdc5ecb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:35.510671 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-afefc629-ba63-436f-933b-080e2bdc5ecb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:35.518951 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-afefc629-ba63-436f-933b-080e2bdc5ecb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.094188 May 03 09:21:35.519530 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1235/2300] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:35 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:36.079465 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5e962043-d267-4a31-a53c-47e0de8334dc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:36.080509 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5e962043-d267-4a31-a53c-47e0de8334dc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:36.091823 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5e962043-d267-4a31-a53c-47e0de8334dc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:36.092636 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5e962043-d267-4a31-a53c-47e0de8334dc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:36.093872 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5e962043-d267-4a31-a53c-47e0de8334dc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:36.094592 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5e962043-d267-4a31-a53c-47e0de8334dc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:36.238962 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5e962043-d267-4a31-a53c-47e0de8334dc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:36.247557 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5e962043-d267-4a31-a53c-47e0de8334dc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.174659 May 03 09:21:36.248141 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1066/2301] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:36 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:36.541154 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a842fb62-5332-4500-8a53-f15a0a150db3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:36.542212 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a842fb62-5332-4500-8a53-f15a0a150db3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:36.552944 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a842fb62-5332-4500-8a53-f15a0a150db3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:36.553692 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a842fb62-5332-4500-8a53-f15a0a150db3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:36.554985 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a842fb62-5332-4500-8a53-f15a0a150db3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:36.555420 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a842fb62-5332-4500-8a53-f15a0a150db3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:36.623334 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a842fb62-5332-4500-8a53-f15a0a150db3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:36.634563 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a842fb62-5332-4500-8a53-f15a0a150db3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.100126 May 03 09:21:36.635133 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1236/2302] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:36 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:37.276428 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c77cfb12-234e-4d6d-b8e2-17f6576c71c2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:37.277184 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c77cfb12-234e-4d6d-b8e2-17f6576c71c2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:37.283984 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c77cfb12-234e-4d6d-b8e2-17f6576c71c2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:37.284436 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c77cfb12-234e-4d6d-b8e2-17f6576c71c2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:37.285205 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c77cfb12-234e-4d6d-b8e2-17f6576c71c2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:37.285644 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c77cfb12-234e-4d6d-b8e2-17f6576c71c2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:37.435731 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c77cfb12-234e-4d6d-b8e2-17f6576c71c2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:37.444037 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c77cfb12-234e-4d6d-b8e2-17f6576c71c2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.177375 May 03 09:21:37.444612 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1067/2303] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:37 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:37.655968 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a41ecec7-fc63-44a3-9998-284bc75ae8cc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:37.656991 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a41ecec7-fc63-44a3-9998-284bc75ae8cc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:37.666805 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a41ecec7-fc63-44a3-9998-284bc75ae8cc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:37.667257 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a41ecec7-fc63-44a3-9998-284bc75ae8cc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:37.668075 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a41ecec7-fc63-44a3-9998-284bc75ae8cc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:37.668513 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a41ecec7-fc63-44a3-9998-284bc75ae8cc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:37.735647 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a41ecec7-fc63-44a3-9998-284bc75ae8cc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:37.744443 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a41ecec7-fc63-44a3-9998-284bc75ae8cc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.094997 May 03 09:21:37.744977 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1237/2304] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:37 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:38.463152 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-1ccba07f-44a2-4982-9a50-313be2dbd962 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:38.463737 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-1ccba07f-44a2-4982-9a50-313be2dbd962 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:38.470599 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1ccba07f-44a2-4982-9a50-313be2dbd962 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:38.470985 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1ccba07f-44a2-4982-9a50-313be2dbd962 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:38.471754 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1ccba07f-44a2-4982-9a50-313be2dbd962 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:38.472224 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1ccba07f-44a2-4982-9a50-313be2dbd962 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:38.623188 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-1ccba07f-44a2-4982-9a50-313be2dbd962 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:38.634792 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-1ccba07f-44a2-4982-9a50-313be2dbd962 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.175949 May 03 09:21:38.635700 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1068/2305] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:38 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:38.766176 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c4de572c-a367-4925-ae75-6cfd4f04c0d6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:38.767143 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c4de572c-a367-4925-ae75-6cfd4f04c0d6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:38.776911 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c4de572c-a367-4925-ae75-6cfd4f04c0d6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:38.777368 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c4de572c-a367-4925-ae75-6cfd4f04c0d6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:38.778111 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c4de572c-a367-4925-ae75-6cfd4f04c0d6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:38.778582 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c4de572c-a367-4925-ae75-6cfd4f04c0d6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:38.848573 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c4de572c-a367-4925-ae75-6cfd4f04c0d6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:38.857042 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c4de572c-a367-4925-ae75-6cfd4f04c0d6 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.097703 May 03 09:21:38.857633 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1238/2306] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:38 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:39.661069 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b083dc2e-0580-4211-a09c-d03716848762 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:39.661991 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b083dc2e-0580-4211-a09c-d03716848762 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:39.670254 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b083dc2e-0580-4211-a09c-d03716848762 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:39.670705 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b083dc2e-0580-4211-a09c-d03716848762 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:39.671470 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b083dc2e-0580-4211-a09c-d03716848762 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:39.671949 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b083dc2e-0580-4211-a09c-d03716848762 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:39.797255 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b083dc2e-0580-4211-a09c-d03716848762 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:39.805841 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b083dc2e-0580-4211-a09c-d03716848762 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.151465 May 03 09:21:39.806401 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1069/2307] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:39 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:39.878596 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-8b01ea64-d73c-4baa-9f99-bfd39b2f4879 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:39.879667 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-8b01ea64-d73c-4baa-9f99-bfd39b2f4879 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:39.888318 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8b01ea64-d73c-4baa-9f99-bfd39b2f4879 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:39.888764 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8b01ea64-d73c-4baa-9f99-bfd39b2f4879 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:39.889534 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8b01ea64-d73c-4baa-9f99-bfd39b2f4879 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:39.889966 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8b01ea64-d73c-4baa-9f99-bfd39b2f4879 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:39.964112 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-8b01ea64-d73c-4baa-9f99-bfd39b2f4879 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:39.972726 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-8b01ea64-d73c-4baa-9f99-bfd39b2f4879 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.100704 May 03 09:21:39.973294 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1239/2308] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:39 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:40.826754 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c8fa1f9e-78f1-4a23-b5db-78fe4acb9897 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:40.827818 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c8fa1f9e-78f1-4a23-b5db-78fe4acb9897 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:40.838369 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c8fa1f9e-78f1-4a23-b5db-78fe4acb9897 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:40.838811 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c8fa1f9e-78f1-4a23-b5db-78fe4acb9897 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:40.839571 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c8fa1f9e-78f1-4a23-b5db-78fe4acb9897 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:40.840039 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c8fa1f9e-78f1-4a23-b5db-78fe4acb9897 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:40.979881 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c8fa1f9e-78f1-4a23-b5db-78fe4acb9897 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:40.990406 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-33c5ea53-a772-438a-9e7b-c666815d57c3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:40.991066 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-33c5ea53-a772-438a-9e7b-c666815d57c3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:40.991528 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c8fa1f9e-78f1-4a23-b5db-78fe4acb9897 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.171248 May 03 09:21:40.992141 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1070/2309] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:40 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:40.998104 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-33c5ea53-a772-438a-9e7b-c666815d57c3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:40.998464 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-33c5ea53-a772-438a-9e7b-c666815d57c3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:40.999273 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-33c5ea53-a772-438a-9e7b-c666815d57c3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:40.999709 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-33c5ea53-a772-438a-9e7b-c666815d57c3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:41.068983 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-33c5ea53-a772-438a-9e7b-c666815d57c3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:41.077718 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-33c5ea53-a772-438a-9e7b-c666815d57c3 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.091235 May 03 09:21:41.078304 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1240/2310] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:40 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:42.013248 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b9cc0135-666e-4a8c-ab48-1a82b3fd7247 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:42.015028 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b9cc0135-666e-4a8c-ab48-1a82b3fd7247 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:42.026039 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b9cc0135-666e-4a8c-ab48-1a82b3fd7247 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:42.026800 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b9cc0135-666e-4a8c-ab48-1a82b3fd7247 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:42.028123 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b9cc0135-666e-4a8c-ab48-1a82b3fd7247 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:42.028846 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b9cc0135-666e-4a8c-ab48-1a82b3fd7247 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:42.094645 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c2d765e2-a80a-427f-9a56-17a731bdd4e7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:42.095255 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c2d765e2-a80a-427f-9a56-17a731bdd4e7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:42.101772 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c2d765e2-a80a-427f-9a56-17a731bdd4e7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:42.102213 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c2d765e2-a80a-427f-9a56-17a731bdd4e7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:42.103031 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c2d765e2-a80a-427f-9a56-17a731bdd4e7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:42.103477 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c2d765e2-a80a-427f-9a56-17a731bdd4e7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:42.165833 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c2d765e2-a80a-427f-9a56-17a731bdd4e7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:42.173684 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c2d765e2-a80a-427f-9a56-17a731bdd4e7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.082949 May 03 09:21:42.174254 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1241/2311] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:42 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:21:42.188279 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b9cc0135-666e-4a8c-ab48-1a82b3fd7247 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:42.198505 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b9cc0135-666e-4a8c-ab48-1a82b3fd7247 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.192443 May 03 09:21:42.199072 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1071/2312] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:42 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:43.194888 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b43c0b45-e8e0-4fdb-97f9-630f3817c820 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:43.195877 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b43c0b45-e8e0-4fdb-97f9-630f3817c820 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:43.206621 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b43c0b45-e8e0-4fdb-97f9-630f3817c820 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:43.207354 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b43c0b45-e8e0-4fdb-97f9-630f3817c820 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:43.211263 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b43c0b45-e8e0-4fdb-97f9-630f3817c820 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:43.211263 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b43c0b45-e8e0-4fdb-97f9-630f3817c820 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:43.217182 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a37ce493-668e-4d33-bd22-bea6736998ea tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:43.217876 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a37ce493-668e-4d33-bd22-bea6736998ea tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:43.224720 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a37ce493-668e-4d33-bd22-bea6736998ea tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:43.225171 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a37ce493-668e-4d33-bd22-bea6736998ea tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:43.225945 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a37ce493-668e-4d33-bd22-bea6736998ea tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:43.226389 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a37ce493-668e-4d33-bd22-bea6736998ea tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:43.282599 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b43c0b45-e8e0-4fdb-97f9-630f3817c820 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:43.290727 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b43c0b45-e8e0-4fdb-97f9-630f3817c820 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.102566 May 03 09:21:43.291299 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1242/2313] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:43 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:43.366949 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a37ce493-668e-4d33-bd22-bea6736998ea tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:43.374977 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a37ce493-668e-4d33-bd22-bea6736998ea tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.161790 May 03 09:21:43.375560 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1072/2314] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:43 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:44.308055 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-fdbc9683-0576-459a-8332-25a5028312d8 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:44.308673 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-fdbc9683-0576-459a-8332-25a5028312d8 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:44.315389 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fdbc9683-0576-459a-8332-25a5028312d8 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:44.315872 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fdbc9683-0576-459a-8332-25a5028312d8 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:44.316639 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fdbc9683-0576-459a-8332-25a5028312d8 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:44.317074 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fdbc9683-0576-459a-8332-25a5028312d8 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:44.383195 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-fdbc9683-0576-459a-8332-25a5028312d8 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:44.392344 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-fdbc9683-0576-459a-8332-25a5028312d8 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.088269 May 03 09:21:44.392558 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-065322c1-eb3c-4436-8a2e-cb2a4429c571 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:44.393008 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1243/2315] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:44 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:44.393103 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-065322c1-eb3c-4436-8a2e-cb2a4429c571 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:44.399933 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-065322c1-eb3c-4436-8a2e-cb2a4429c571 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:44.400385 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-065322c1-eb3c-4436-8a2e-cb2a4429c571 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:44.401202 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-065322c1-eb3c-4436-8a2e-cb2a4429c571 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:44.401590 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-065322c1-eb3c-4436-8a2e-cb2a4429c571 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:44.532051 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-065322c1-eb3c-4436-8a2e-cb2a4429c571 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:44.540616 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-065322c1-eb3c-4436-8a2e-cb2a4429c571 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.152067 May 03 09:21:44.541202 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1073/2316] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:44 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:45.417164 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-515c3de6-6c64-467f-8f16-1e744b29c8f9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:45.418279 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-515c3de6-6c64-467f-8f16-1e744b29c8f9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:45.429012 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-515c3de6-6c64-467f-8f16-1e744b29c8f9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:45.429750 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-515c3de6-6c64-467f-8f16-1e744b29c8f9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:45.431095 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-515c3de6-6c64-467f-8f16-1e744b29c8f9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:45.431523 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-515c3de6-6c64-467f-8f16-1e744b29c8f9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:45.502297 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-515c3de6-6c64-467f-8f16-1e744b29c8f9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:45.511008 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-515c3de6-6c64-467f-8f16-1e744b29c8f9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.102057 May 03 09:21:45.511582 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1244/2317] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:45 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:45.562080 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-26628b51-ee12-4336-8d98-d1f6f4f38b21 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:45.563253 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-26628b51-ee12-4336-8d98-d1f6f4f38b21 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:45.573097 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-26628b51-ee12-4336-8d98-d1f6f4f38b21 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:45.573541 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-26628b51-ee12-4336-8d98-d1f6f4f38b21 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:45.574286 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-26628b51-ee12-4336-8d98-d1f6f4f38b21 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:45.574721 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-26628b51-ee12-4336-8d98-d1f6f4f38b21 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:45.723459 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-26628b51-ee12-4336-8d98-d1f6f4f38b21 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:45.732335 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-26628b51-ee12-4336-8d98-d1f6f4f38b21 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.176813 May 03 09:21:45.732908 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1074/2318] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:45 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:46.532410 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-148e7c0b-433e-4329-aa5d-fdffb0fb7a16 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:46.533277 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-148e7c0b-433e-4329-aa5d-fdffb0fb7a16 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:46.542718 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-148e7c0b-433e-4329-aa5d-fdffb0fb7a16 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:46.543174 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-148e7c0b-433e-4329-aa5d-fdffb0fb7a16 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:46.543988 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-148e7c0b-433e-4329-aa5d-fdffb0fb7a16 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:46.544421 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-148e7c0b-433e-4329-aa5d-fdffb0fb7a16 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:46.618183 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-148e7c0b-433e-4329-aa5d-fdffb0fb7a16 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:46.630316 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-148e7c0b-433e-4329-aa5d-fdffb0fb7a16 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.104328 May 03 09:21:46.631108 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1245/2319] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:46 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:46.755540 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d510c734-5f02-48ae-9561-ce9790619d4b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:46.756662 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d510c734-5f02-48ae-9561-ce9790619d4b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:46.768616 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d510c734-5f02-48ae-9561-ce9790619d4b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:46.769363 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d510c734-5f02-48ae-9561-ce9790619d4b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:46.770625 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d510c734-5f02-48ae-9561-ce9790619d4b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:46.771351 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d510c734-5f02-48ae-9561-ce9790619d4b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:46.907557 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d510c734-5f02-48ae-9561-ce9790619d4b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:46.915492 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d510c734-5f02-48ae-9561-ce9790619d4b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.166425 May 03 09:21:46.916094 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1075/2320] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:46 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:47.651963 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-092d5c7e-f706-44af-be79-1acaf6d3c095 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:47.652899 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-092d5c7e-f706-44af-be79-1acaf6d3c095 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:47.663669 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-092d5c7e-f706-44af-be79-1acaf6d3c095 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:47.664470 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-092d5c7e-f706-44af-be79-1acaf6d3c095 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:47.665728 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-092d5c7e-f706-44af-be79-1acaf6d3c095 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:47.666459 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-092d5c7e-f706-44af-be79-1acaf6d3c095 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:47.741469 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-092d5c7e-f706-44af-be79-1acaf6d3c095 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:47.749510 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-092d5c7e-f706-44af-be79-1acaf6d3c095 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.104390 May 03 09:21:47.750082 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1246/2321] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:47 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:47.935964 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ea6201aa-8ebc-48f9-914b-fe15dc9880a0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:47.936857 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ea6201aa-8ebc-48f9-914b-fe15dc9880a0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:47.947241 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ea6201aa-8ebc-48f9-914b-fe15dc9880a0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:47.947681 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ea6201aa-8ebc-48f9-914b-fe15dc9880a0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:47.948472 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ea6201aa-8ebc-48f9-914b-fe15dc9880a0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:47.948911 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ea6201aa-8ebc-48f9-914b-fe15dc9880a0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:48.089466 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ea6201aa-8ebc-48f9-914b-fe15dc9880a0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:48.101656 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ea6201aa-8ebc-48f9-914b-fe15dc9880a0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.172032 May 03 09:21:48.102433 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1076/2322] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:47 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:48.768324 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-6904f8e4-f3a3-4012-b74f-f7a48dd08913 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:48.769006 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-6904f8e4-f3a3-4012-b74f-f7a48dd08913 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:48.777375 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6904f8e4-f3a3-4012-b74f-f7a48dd08913 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:48.777938 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6904f8e4-f3a3-4012-b74f-f7a48dd08913 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:48.778910 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6904f8e4-f3a3-4012-b74f-f7a48dd08913 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:48.779457 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6904f8e4-f3a3-4012-b74f-f7a48dd08913 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:48.849124 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-6904f8e4-f3a3-4012-b74f-f7a48dd08913 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:48.857305 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-6904f8e4-f3a3-4012-b74f-f7a48dd08913 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.094055 May 03 09:21:48.857874 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1247/2323] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:48 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:49.124965 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e0acb13d-de17-4a49-98c8-3b7bbf8432a0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:49.125833 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e0acb13d-de17-4a49-98c8-3b7bbf8432a0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:49.136567 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e0acb13d-de17-4a49-98c8-3b7bbf8432a0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:49.137281 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e0acb13d-de17-4a49-98c8-3b7bbf8432a0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:49.138523 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e0acb13d-de17-4a49-98c8-3b7bbf8432a0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:49.139235 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e0acb13d-de17-4a49-98c8-3b7bbf8432a0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:49.274028 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e0acb13d-de17-4a49-98c8-3b7bbf8432a0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:49.282233 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e0acb13d-de17-4a49-98c8-3b7bbf8432a0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.164512 May 03 09:21:49.282805 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1077/2324] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:49 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:49.878735 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-2693e149-826c-4359-9df3-05faede4a4d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:49.879681 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-2693e149-826c-4359-9df3-05faede4a4d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:49.890655 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2693e149-826c-4359-9df3-05faede4a4d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:49.891405 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2693e149-826c-4359-9df3-05faede4a4d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:49.892735 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2693e149-826c-4359-9df3-05faede4a4d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:49.893464 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2693e149-826c-4359-9df3-05faede4a4d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:49.960528 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-2693e149-826c-4359-9df3-05faede4a4d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:49.969020 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-2693e149-826c-4359-9df3-05faede4a4d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.096866 May 03 09:21:49.969597 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1248/2325] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:49 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:50.303533 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-71bb0bef-51cf-4012-b4e7-55940bbf7f67 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:50.304610 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-71bb0bef-51cf-4012-b4e7-55940bbf7f67 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:50.315296 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-71bb0bef-51cf-4012-b4e7-55940bbf7f67 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:50.316118 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-71bb0bef-51cf-4012-b4e7-55940bbf7f67 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:50.317388 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-71bb0bef-51cf-4012-b4e7-55940bbf7f67 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:50.318112 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-71bb0bef-51cf-4012-b4e7-55940bbf7f67 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:50.452383 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-71bb0bef-51cf-4012-b4e7-55940bbf7f67 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:50.463890 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-71bb0bef-51cf-4012-b4e7-55940bbf7f67 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.166944 May 03 09:21:50.464463 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1078/2326] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:50 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:50.990072 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-67200d50-ebbc-488c-bba8-99e109ea782b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:50.991002 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-67200d50-ebbc-488c-bba8-99e109ea782b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:51.001711 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-67200d50-ebbc-488c-bba8-99e109ea782b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:51.002476 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-67200d50-ebbc-488c-bba8-99e109ea782b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:51.003746 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-67200d50-ebbc-488c-bba8-99e109ea782b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:51.004525 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-67200d50-ebbc-488c-bba8-99e109ea782b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:51.069742 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-67200d50-ebbc-488c-bba8-99e109ea782b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:51.079152 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-67200d50-ebbc-488c-bba8-99e109ea782b tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.095654 May 03 09:21:51.079915 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1249/2327] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:50 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:51.482457 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a7db09b1-9f82-4f3c-93b2-3bd90523d1c2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:51.483267 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a7db09b1-9f82-4f3c-93b2-3bd90523d1c2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:51.491792 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a7db09b1-9f82-4f3c-93b2-3bd90523d1c2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:51.492411 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a7db09b1-9f82-4f3c-93b2-3bd90523d1c2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:51.493447 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a7db09b1-9f82-4f3c-93b2-3bd90523d1c2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:51.493883 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a7db09b1-9f82-4f3c-93b2-3bd90523d1c2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:51.626186 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a7db09b1-9f82-4f3c-93b2-3bd90523d1c2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:51.634273 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a7db09b1-9f82-4f3c-93b2-3bd90523d1c2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.156736 May 03 09:21:51.634818 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1079/2328] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:51 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:52.100905 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-7f184fbc-9b1d-4dcb-8550-5c8dcc075995 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:52.101875 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-7f184fbc-9b1d-4dcb-8550-5c8dcc075995 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:52.112574 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7f184fbc-9b1d-4dcb-8550-5c8dcc075995 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:52.113316 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7f184fbc-9b1d-4dcb-8550-5c8dcc075995 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:52.114567 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7f184fbc-9b1d-4dcb-8550-5c8dcc075995 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:52.115286 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7f184fbc-9b1d-4dcb-8550-5c8dcc075995 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:52.178109 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7f184fbc-9b1d-4dcb-8550-5c8dcc075995 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:52.186108 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-7f184fbc-9b1d-4dcb-8550-5c8dcc075995 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.091820 May 03 09:21:52.186677 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1250/2329] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:52 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:52.655545 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-86955a87-5541-44be-b733-09808b07625d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:52.656533 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-86955a87-5541-44be-b733-09808b07625d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:52.666784 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-86955a87-5541-44be-b733-09808b07625d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:52.667234 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-86955a87-5541-44be-b733-09808b07625d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:52.668047 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-86955a87-5541-44be-b733-09808b07625d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:52.668484 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-86955a87-5541-44be-b733-09808b07625d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:52.804954 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-86955a87-5541-44be-b733-09808b07625d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:52.813420 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-86955a87-5541-44be-b733-09808b07625d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.164470 May 03 09:21:52.813991 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1080/2330] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:52 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:53.206667 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-bf52a848-936d-4e7d-8d2f-1c8d3230fb7d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:53.207798 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-bf52a848-936d-4e7d-8d2f-1c8d3230fb7d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:53.218890 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bf52a848-936d-4e7d-8d2f-1c8d3230fb7d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:53.219625 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bf52a848-936d-4e7d-8d2f-1c8d3230fb7d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:53.220952 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bf52a848-936d-4e7d-8d2f-1c8d3230fb7d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:53.221709 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bf52a848-936d-4e7d-8d2f-1c8d3230fb7d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:53.286227 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-bf52a848-936d-4e7d-8d2f-1c8d3230fb7d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:53.294286 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-bf52a848-936d-4e7d-8d2f-1c8d3230fb7d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.094088 May 03 09:21:53.294830 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1251/2331] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:53 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:53.834885 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0a19d4aa-a986-4375-a790-f436d24b3595 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:53.836331 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0a19d4aa-a986-4375-a790-f436d24b3595 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:53.846615 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0a19d4aa-a986-4375-a790-f436d24b3595 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:53.847363 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0a19d4aa-a986-4375-a790-f436d24b3595 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:53.848680 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0a19d4aa-a986-4375-a790-f436d24b3595 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:53.849402 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0a19d4aa-a986-4375-a790-f436d24b3595 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:53.983967 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0a19d4aa-a986-4375-a790-f436d24b3595 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:53.995599 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0a19d4aa-a986-4375-a790-f436d24b3595 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.167428 May 03 09:21:53.996485 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1081/2332] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:53 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:54.312503 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-414fa6c6-7d27-4f01-a146-5fa3647ed246 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:54.313174 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-414fa6c6-7d27-4f01-a146-5fa3647ed246 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:54.321235 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-414fa6c6-7d27-4f01-a146-5fa3647ed246 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:54.321762 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-414fa6c6-7d27-4f01-a146-5fa3647ed246 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:54.322669 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-414fa6c6-7d27-4f01-a146-5fa3647ed246 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:54.323217 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-414fa6c6-7d27-4f01-a146-5fa3647ed246 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:54.393171 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-414fa6c6-7d27-4f01-a146-5fa3647ed246 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:54.401276 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-414fa6c6-7d27-4f01-a146-5fa3647ed246 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.093451 May 03 09:21:54.401846 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1252/2333] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:54 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:55.018418 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-42f8fa36-86eb-497c-9cca-9e626cc4ca7c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:55.019124 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-42f8fa36-86eb-497c-9cca-9e626cc4ca7c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:55.026647 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-42f8fa36-86eb-497c-9cca-9e626cc4ca7c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:55.027097 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-42f8fa36-86eb-497c-9cca-9e626cc4ca7c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:55.027901 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-42f8fa36-86eb-497c-9cca-9e626cc4ca7c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:55.028337 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-42f8fa36-86eb-497c-9cca-9e626cc4ca7c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:55.161766 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-42f8fa36-86eb-497c-9cca-9e626cc4ca7c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:55.173970 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-42f8fa36-86eb-497c-9cca-9e626cc4ca7c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.160467 May 03 09:21:55.174813 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1082/2334] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:55 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:55.417460 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9be86949-3786-4ca9-becf-7422ca6cc2ff tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:55.418096 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9be86949-3786-4ca9-becf-7422ca6cc2ff tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:55.424844 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9be86949-3786-4ca9-becf-7422ca6cc2ff tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:55.425292 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9be86949-3786-4ca9-becf-7422ca6cc2ff tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:55.426062 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9be86949-3786-4ca9-becf-7422ca6cc2ff tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:55.426505 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9be86949-3786-4ca9-becf-7422ca6cc2ff tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:55.488066 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9be86949-3786-4ca9-becf-7422ca6cc2ff tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:55.496610 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9be86949-3786-4ca9-becf-7422ca6cc2ff tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.083104 May 03 09:21:55.497195 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1253/2335] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:55 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:56.194808 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-41c7040b-49e4-40cd-b2d6-1c13ef5db79f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:56.195839 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-41c7040b-49e4-40cd-b2d6-1c13ef5db79f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:56.204093 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-41c7040b-49e4-40cd-b2d6-1c13ef5db79f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:56.204621 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-41c7040b-49e4-40cd-b2d6-1c13ef5db79f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:56.205555 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-41c7040b-49e4-40cd-b2d6-1c13ef5db79f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:56.206030 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-41c7040b-49e4-40cd-b2d6-1c13ef5db79f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:56.340861 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-41c7040b-49e4-40cd-b2d6-1c13ef5db79f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:56.348991 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-41c7040b-49e4-40cd-b2d6-1c13ef5db79f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.160823 May 03 09:21:56.349564 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1083/2336] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:56 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:56.517655 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-7645fd22-6ec2-4881-b867-ccb23252fb09 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:56.518503 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-7645fd22-6ec2-4881-b867-ccb23252fb09 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:56.527426 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7645fd22-6ec2-4881-b867-ccb23252fb09 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:56.527915 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7645fd22-6ec2-4881-b867-ccb23252fb09 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:56.528678 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7645fd22-6ec2-4881-b867-ccb23252fb09 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:56.529116 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7645fd22-6ec2-4881-b867-ccb23252fb09 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:56.598719 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7645fd22-6ec2-4881-b867-ccb23252fb09 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:56.606764 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-7645fd22-6ec2-4881-b867-ccb23252fb09 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.095774 May 03 09:21:56.607311 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1254/2337] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:56 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:57.370016 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-48648c33-4a29-47b7-a669-b7334561caf9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:57.370782 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-48648c33-4a29-47b7-a669-b7334561caf9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:57.379023 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-48648c33-4a29-47b7-a669-b7334561caf9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:57.379587 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-48648c33-4a29-47b7-a669-b7334561caf9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:57.380575 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-48648c33-4a29-47b7-a669-b7334561caf9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:57.381121 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-48648c33-4a29-47b7-a669-b7334561caf9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:57.517031 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-48648c33-4a29-47b7-a669-b7334561caf9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:57.525068 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-48648c33-4a29-47b7-a669-b7334561caf9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.161247 May 03 09:21:57.525644 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1084/2338] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:57 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:57.623504 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a4ff9c82-005f-42fb-8686-e16237c370b4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:57.624143 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a4ff9c82-005f-42fb-8686-e16237c370b4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:57.630802 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a4ff9c82-005f-42fb-8686-e16237c370b4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:57.631248 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a4ff9c82-005f-42fb-8686-e16237c370b4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:57.632035 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a4ff9c82-005f-42fb-8686-e16237c370b4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:57.632462 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a4ff9c82-005f-42fb-8686-e16237c370b4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:57.712622 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a4ff9c82-005f-42fb-8686-e16237c370b4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:57.720995 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a4ff9c82-005f-42fb-8686-e16237c370b4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.101397 May 03 09:21:57.721569 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1255/2339] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:57 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:58.432849 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 09:21:58.433247 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: Tue May 3 09:21:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 03 09:21:58.546574 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2d12b263-dded-4bcc-88c5-341db4131eda tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:58.547454 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-2d12b263-dded-4bcc-88c5-341db4131eda tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:58.558045 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2d12b263-dded-4bcc-88c5-341db4131eda tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:58.558782 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2d12b263-dded-4bcc-88c5-341db4131eda tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:58.560152 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2d12b263-dded-4bcc-88c5-341db4131eda tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:58.560882 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2d12b263-dded-4bcc-88c5-341db4131eda tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:58.703756 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2d12b263-dded-4bcc-88c5-341db4131eda tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:58.712782 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-2d12b263-dded-4bcc-88c5-341db4131eda tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.173007 May 03 09:21:58.713373 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1085/2340] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:58 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:58.741304 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-13e9ab9b-4ddc-4fc3-9767-e74b55f49563 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:58.741900 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-13e9ab9b-4ddc-4fc3-9767-e74b55f49563 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:58.749252 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-13e9ab9b-4ddc-4fc3-9767-e74b55f49563 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:58.749706 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-13e9ab9b-4ddc-4fc3-9767-e74b55f49563 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:58.750472 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-13e9ab9b-4ddc-4fc3-9767-e74b55f49563 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:58.750904 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-13e9ab9b-4ddc-4fc3-9767-e74b55f49563 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:58.811293 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-13e9ab9b-4ddc-4fc3-9767-e74b55f49563 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:58.822673 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-13e9ab9b-4ddc-4fc3-9767-e74b55f49563 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.087396 May 03 09:21:58.823542 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1256/2341] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:58 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:59.733684 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7b77361f-1315-44d7-937f-110cb7c5ce44 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:59.734745 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7b77361f-1315-44d7-937f-110cb7c5ce44 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:59.744754 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7b77361f-1315-44d7-937f-110cb7c5ce44 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:59.745198 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7b77361f-1315-44d7-937f-110cb7c5ce44 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:59.745951 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7b77361f-1315-44d7-937f-110cb7c5ce44 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:59.746383 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7b77361f-1315-44d7-937f-110cb7c5ce44 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:59.845200 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-fbe6ea94-9299-4d08-ad70-c25f32f9a7eb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:21:59.845891 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-fbe6ea94-9299-4d08-ad70-c25f32f9a7eb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:21:59.852847 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fbe6ea94-9299-4d08-ad70-c25f32f9a7eb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:59.853292 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fbe6ea94-9299-4d08-ad70-c25f32f9a7eb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:59.854057 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fbe6ea94-9299-4d08-ad70-c25f32f9a7eb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:21:59.854475 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fbe6ea94-9299-4d08-ad70-c25f32f9a7eb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:21:59.880809 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7b77361f-1315-44d7-937f-110cb7c5ce44 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:59.889184 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7b77361f-1315-44d7-937f-110cb7c5ce44 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.162013 May 03 09:21:59.889762 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1086/2342] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:59 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:21:59.914817 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-fbe6ea94-9299-4d08-ad70-c25f32f9a7eb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:21:59.924449 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-fbe6ea94-9299-4d08-ad70-c25f32f9a7eb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.083090 May 03 09:21:59.925022 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1257/2343] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:21:59 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:22:00.909757 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-1307ee67-4928-4024-b381-ee26286f6fbe tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:00.910783 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-1307ee67-4928-4024-b381-ee26286f6fbe tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:00.919308 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1307ee67-4928-4024-b381-ee26286f6fbe tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:00.919812 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1307ee67-4928-4024-b381-ee26286f6fbe tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:00.920673 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1307ee67-4928-4024-b381-ee26286f6fbe tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:00.921114 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1307ee67-4928-4024-b381-ee26286f6fbe tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:00.941685 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-57bbf07e-bbd1-4f01-8a84-b45ed4df7157 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:00.942240 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-57bbf07e-bbd1-4f01-8a84-b45ed4df7157 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:00.948920 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-57bbf07e-bbd1-4f01-8a84-b45ed4df7157 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:00.949362 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-57bbf07e-bbd1-4f01-8a84-b45ed4df7157 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:00.950126 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-57bbf07e-bbd1-4f01-8a84-b45ed4df7157 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:00.950548 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-57bbf07e-bbd1-4f01-8a84-b45ed4df7157 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:01.018586 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-57bbf07e-bbd1-4f01-8a84-b45ed4df7157 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:01.027028 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-57bbf07e-bbd1-4f01-8a84-b45ed4df7157 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.089188 May 03 09:22:01.027586 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1258/2344] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:00 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:01.077327 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-1307ee67-4928-4024-b381-ee26286f6fbe tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:01.085836 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-1307ee67-4928-4024-b381-ee26286f6fbe tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.182266 May 03 09:22:01.086416 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1087/2345] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:00 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:02.047507 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b25d1a40-0cd3-4ea9-b7ee-0fddcbadddb2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:02.048494 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b25d1a40-0cd3-4ea9-b7ee-0fddcbadddb2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:02.058184 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b25d1a40-0cd3-4ea9-b7ee-0fddcbadddb2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:02.058638 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b25d1a40-0cd3-4ea9-b7ee-0fddcbadddb2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:02.059402 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b25d1a40-0cd3-4ea9-b7ee-0fddcbadddb2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:02.059862 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b25d1a40-0cd3-4ea9-b7ee-0fddcbadddb2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:02.104883 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-54a8b43e-b930-462d-b9a5-968c431c1f8f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:02.105455 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-54a8b43e-b930-462d-b9a5-968c431c1f8f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:02.112066 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-54a8b43e-b930-462d-b9a5-968c431c1f8f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:02.112529 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-54a8b43e-b930-462d-b9a5-968c431c1f8f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:02.113299 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-54a8b43e-b930-462d-b9a5-968c431c1f8f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:02.113738 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-54a8b43e-b930-462d-b9a5-968c431c1f8f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:02.124746 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b25d1a40-0cd3-4ea9-b7ee-0fddcbadddb2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:02.132964 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b25d1a40-0cd3-4ea9-b7ee-0fddcbadddb2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.091872 May 03 09:22:02.133501 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1259/2346] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:02 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:02.261722 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-54a8b43e-b930-462d-b9a5-968c431c1f8f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:02.273459 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-54a8b43e-b930-462d-b9a5-968c431c1f8f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.173635 May 03 09:22:02.274235 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1088/2347] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:02 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:03.154430 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-bd79089a-9e04-41d5-9ce4-fe3f46503853 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:03.155515 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-bd79089a-9e04-41d5-9ce4-fe3f46503853 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:03.166188 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bd79089a-9e04-41d5-9ce4-fe3f46503853 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:03.166770 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bd79089a-9e04-41d5-9ce4-fe3f46503853 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:03.167555 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bd79089a-9e04-41d5-9ce4-fe3f46503853 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:03.168036 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bd79089a-9e04-41d5-9ce4-fe3f46503853 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:03.232405 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-bd79089a-9e04-41d5-9ce4-fe3f46503853 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:03.240647 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-bd79089a-9e04-41d5-9ce4-fe3f46503853 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.092963 May 03 09:22:03.241230 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1260/2348] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:03 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:03.291350 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6483d780-1acb-4650-b1f7-229695e8ec05 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:03.291983 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6483d780-1acb-4650-b1f7-229695e8ec05 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:03.298892 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6483d780-1acb-4650-b1f7-229695e8ec05 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:03.299353 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6483d780-1acb-4650-b1f7-229695e8ec05 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:03.300143 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6483d780-1acb-4650-b1f7-229695e8ec05 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:03.300601 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6483d780-1acb-4650-b1f7-229695e8ec05 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:03.459221 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6483d780-1acb-4650-b1f7-229695e8ec05 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:03.468204 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6483d780-1acb-4650-b1f7-229695e8ec05 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.180783 May 03 09:22:03.468768 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1089/2349] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:03 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:04.261138 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b9d00dcd-d5a1-46e7-b9ae-f648a97572c0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:04.261926 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b9d00dcd-d5a1-46e7-b9ae-f648a97572c0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:04.270994 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b9d00dcd-d5a1-46e7-b9ae-f648a97572c0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:04.271508 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b9d00dcd-d5a1-46e7-b9ae-f648a97572c0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:04.272439 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b9d00dcd-d5a1-46e7-b9ae-f648a97572c0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:04.273173 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b9d00dcd-d5a1-46e7-b9ae-f648a97572c0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:04.394756 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b9d00dcd-d5a1-46e7-b9ae-f648a97572c0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:04.403124 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b9d00dcd-d5a1-46e7-b9ae-f648a97572c0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.148077 May 03 09:22:04.403698 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1261/2350] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:04 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:04.489712 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f441ad5a-ea95-409e-ac3f-44490dac1d28 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:04.490634 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f441ad5a-ea95-409e-ac3f-44490dac1d28 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:04.501371 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f441ad5a-ea95-409e-ac3f-44490dac1d28 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:04.502132 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f441ad5a-ea95-409e-ac3f-44490dac1d28 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:04.503397 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f441ad5a-ea95-409e-ac3f-44490dac1d28 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:04.504186 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f441ad5a-ea95-409e-ac3f-44490dac1d28 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:04.645585 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f441ad5a-ea95-409e-ac3f-44490dac1d28 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:04.653795 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f441ad5a-ea95-409e-ac3f-44490dac1d28 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.170844 May 03 09:22:04.654357 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1090/2351] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:04 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:05.421012 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e3ff0a25-d26d-4053-9665-43967e755165 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:05.421600 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e3ff0a25-d26d-4053-9665-43967e755165 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:05.428387 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e3ff0a25-d26d-4053-9665-43967e755165 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:05.428831 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e3ff0a25-d26d-4053-9665-43967e755165 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:05.429589 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e3ff0a25-d26d-4053-9665-43967e755165 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:05.430025 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e3ff0a25-d26d-4053-9665-43967e755165 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:05.490889 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e3ff0a25-d26d-4053-9665-43967e755165 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:05.498779 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e3ff0a25-d26d-4053-9665-43967e755165 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.081768 May 03 09:22:05.499558 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1262/2352] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:05 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:05.670782 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f70005ea-9163-425c-9a7d-b19b283860fd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:05.671406 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f70005ea-9163-425c-9a7d-b19b283860fd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:05.677870 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f70005ea-9163-425c-9a7d-b19b283860fd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:05.678328 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f70005ea-9163-425c-9a7d-b19b283860fd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:05.679170 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f70005ea-9163-425c-9a7d-b19b283860fd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:05.679613 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f70005ea-9163-425c-9a7d-b19b283860fd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:05.812901 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f70005ea-9163-425c-9a7d-b19b283860fd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:05.821451 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f70005ea-9163-425c-9a7d-b19b283860fd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.154703 May 03 09:22:05.822028 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1091/2353] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:05 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:06.520142 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5a205e50-e9d0-44b5-bca0-4c00375fc9a8 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:06.521028 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5a205e50-e9d0-44b5-bca0-4c00375fc9a8 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:06.529093 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5a205e50-e9d0-44b5-bca0-4c00375fc9a8 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:06.529536 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5a205e50-e9d0-44b5-bca0-4c00375fc9a8 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:06.530287 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5a205e50-e9d0-44b5-bca0-4c00375fc9a8 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:06.530711 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5a205e50-e9d0-44b5-bca0-4c00375fc9a8 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:06.595838 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5a205e50-e9d0-44b5-bca0-4c00375fc9a8 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:06.606339 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5a205e50-e9d0-44b5-bca0-4c00375fc9a8 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.092889 May 03 09:22:06.606921 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1263/2354] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:06 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:06.843205 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-407077d4-2155-40e3-ad65-9171466781db tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:06.844260 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-407077d4-2155-40e3-ad65-9171466781db tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:06.854182 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-407077d4-2155-40e3-ad65-9171466781db tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:06.854631 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-407077d4-2155-40e3-ad65-9171466781db tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:06.855406 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-407077d4-2155-40e3-ad65-9171466781db tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:06.855883 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-407077d4-2155-40e3-ad65-9171466781db tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:06.996934 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-407077d4-2155-40e3-ad65-9171466781db tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:07.005140 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-407077d4-2155-40e3-ad65-9171466781db tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.168635 May 03 09:22:07.005711 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1092/2355] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:06 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:07.624788 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-8fab2f24-91ee-4fa6-9e0e-204b544d2399 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:07.625445 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-8fab2f24-91ee-4fa6-9e0e-204b544d2399 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:07.633407 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8fab2f24-91ee-4fa6-9e0e-204b544d2399 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:07.634011 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8fab2f24-91ee-4fa6-9e0e-204b544d2399 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:07.634777 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8fab2f24-91ee-4fa6-9e0e-204b544d2399 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:07.635216 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8fab2f24-91ee-4fa6-9e0e-204b544d2399 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:07.700769 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-8fab2f24-91ee-4fa6-9e0e-204b544d2399 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:07.711319 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-8fab2f24-91ee-4fa6-9e0e-204b544d2399 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.091005 May 03 09:22:07.712203 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1264/2356] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:07 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:08.025686 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b5a48cc6-7dcb-46ea-9245-448c16a480b8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:08.026264 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b5a48cc6-7dcb-46ea-9245-448c16a480b8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:08.033048 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b5a48cc6-7dcb-46ea-9245-448c16a480b8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:08.033506 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b5a48cc6-7dcb-46ea-9245-448c16a480b8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:08.034277 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b5a48cc6-7dcb-46ea-9245-448c16a480b8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:08.034711 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b5a48cc6-7dcb-46ea-9245-448c16a480b8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:08.179702 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b5a48cc6-7dcb-46ea-9245-448c16a480b8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:08.188461 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b5a48cc6-7dcb-46ea-9245-448c16a480b8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.168804 May 03 09:22:08.189036 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1093/2357] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:08 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:08.732865 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ce74a322-80b5-4bdc-80d4-873a2941b35e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:08.733819 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ce74a322-80b5-4bdc-80d4-873a2941b35e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:08.744626 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ce74a322-80b5-4bdc-80d4-873a2941b35e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:08.745366 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ce74a322-80b5-4bdc-80d4-873a2941b35e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:08.746616 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ce74a322-80b5-4bdc-80d4-873a2941b35e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:08.747324 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ce74a322-80b5-4bdc-80d4-873a2941b35e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:08.814085 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ce74a322-80b5-4bdc-80d4-873a2941b35e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:08.821896 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ce74a322-80b5-4bdc-80d4-873a2941b35e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.095635 May 03 09:22:08.822465 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1265/2358] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:08 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:09.209619 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-704a0975-947a-49d6-bf5f-50dc191c32bb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:09.210916 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-704a0975-947a-49d6-bf5f-50dc191c32bb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:09.221665 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-704a0975-947a-49d6-bf5f-50dc191c32bb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:09.222421 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-704a0975-947a-49d6-bf5f-50dc191c32bb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:09.223723 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-704a0975-947a-49d6-bf5f-50dc191c32bb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:09.224526 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-704a0975-947a-49d6-bf5f-50dc191c32bb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:09.351305 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-704a0975-947a-49d6-bf5f-50dc191c32bb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:09.359607 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-704a0975-947a-49d6-bf5f-50dc191c32bb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.156674 May 03 09:22:09.360453 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1094/2359] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:09 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:09.841625 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-02115ca2-f0c2-4184-b24e-ae1d0f4e0b6d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:09.842361 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-02115ca2-f0c2-4184-b24e-ae1d0f4e0b6d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:09.851441 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-02115ca2-f0c2-4184-b24e-ae1d0f4e0b6d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:09.852129 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-02115ca2-f0c2-4184-b24e-ae1d0f4e0b6d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:09.853148 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-02115ca2-f0c2-4184-b24e-ae1d0f4e0b6d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:09.853752 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-02115ca2-f0c2-4184-b24e-ae1d0f4e0b6d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:09.918682 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-02115ca2-f0c2-4184-b24e-ae1d0f4e0b6d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:09.926571 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-02115ca2-f0c2-4184-b24e-ae1d0f4e0b6d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.090338 May 03 09:22:09.927150 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1266/2360] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:09 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:10.378885 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-eb9d554e-61e1-44c8-9080-5f55bb01f692 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:10.379486 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-eb9d554e-61e1-44c8-9080-5f55bb01f692 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:10.386342 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-eb9d554e-61e1-44c8-9080-5f55bb01f692 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:10.386793 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-eb9d554e-61e1-44c8-9080-5f55bb01f692 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:10.387568 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-eb9d554e-61e1-44c8-9080-5f55bb01f692 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:10.388043 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-eb9d554e-61e1-44c8-9080-5f55bb01f692 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:10.523139 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-eb9d554e-61e1-44c8-9080-5f55bb01f692 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:10.531281 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-eb9d554e-61e1-44c8-9080-5f55bb01f692 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.156390 May 03 09:22:10.531851 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1095/2361] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:10 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:10.942712 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e263f3ed-c3b2-4c68-a00e-71615ad6bca1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:10.943359 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e263f3ed-c3b2-4c68-a00e-71615ad6bca1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:10.950371 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e263f3ed-c3b2-4c68-a00e-71615ad6bca1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:10.950819 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e263f3ed-c3b2-4c68-a00e-71615ad6bca1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:10.951586 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e263f3ed-c3b2-4c68-a00e-71615ad6bca1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:10.952054 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e263f3ed-c3b2-4c68-a00e-71615ad6bca1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:11.015005 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e263f3ed-c3b2-4c68-a00e-71615ad6bca1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:11.026017 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e263f3ed-c3b2-4c68-a00e-71615ad6bca1 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.086800 May 03 09:22:11.026915 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1267/2362] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:10 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:11.553031 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4ad0d5c4-d8f9-47a6-b59b-5c21dab28ca3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:11.554020 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4ad0d5c4-d8f9-47a6-b59b-5c21dab28ca3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:11.564849 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4ad0d5c4-d8f9-47a6-b59b-5c21dab28ca3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:11.565601 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4ad0d5c4-d8f9-47a6-b59b-5c21dab28ca3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:11.566857 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4ad0d5c4-d8f9-47a6-b59b-5c21dab28ca3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:11.567583 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4ad0d5c4-d8f9-47a6-b59b-5c21dab28ca3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:11.708700 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-4ad0d5c4-d8f9-47a6-b59b-5c21dab28ca3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:11.717396 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-4ad0d5c4-d8f9-47a6-b59b-5c21dab28ca3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.171026 May 03 09:22:11.717960 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1096/2363] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:11 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:12.047538 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ef76413c-5188-4869-be1d-c065f9429fe0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:12.048521 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ef76413c-5188-4869-be1d-c065f9429fe0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:12.058677 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ef76413c-5188-4869-be1d-c065f9429fe0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:12.059120 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ef76413c-5188-4869-be1d-c065f9429fe0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:12.059943 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ef76413c-5188-4869-be1d-c065f9429fe0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:12.060374 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ef76413c-5188-4869-be1d-c065f9429fe0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:12.132827 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ef76413c-5188-4869-be1d-c065f9429fe0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:12.141219 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ef76413c-5188-4869-be1d-c065f9429fe0 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.100139 May 03 09:22:12.141805 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1268/2364] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:12 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:12.734783 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e9960381-634d-4aa9-b0c1-78ce2c143864 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:12.735437 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e9960381-634d-4aa9-b0c1-78ce2c143864 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:12.742195 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e9960381-634d-4aa9-b0c1-78ce2c143864 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:12.742645 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e9960381-634d-4aa9-b0c1-78ce2c143864 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:12.743415 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e9960381-634d-4aa9-b0c1-78ce2c143864 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:12.743882 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e9960381-634d-4aa9-b0c1-78ce2c143864 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:12.872209 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e9960381-634d-4aa9-b0c1-78ce2c143864 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:12.880535 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e9960381-634d-4aa9-b0c1-78ce2c143864 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.149692 May 03 09:22:12.881140 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1097/2365] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:12 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:13.158692 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-218dadb2-51c0-4586-a10a-2c77e698e290 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:13.159325 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-218dadb2-51c0-4586-a10a-2c77e698e290 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:13.167106 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-218dadb2-51c0-4586-a10a-2c77e698e290 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:13.167556 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-218dadb2-51c0-4586-a10a-2c77e698e290 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:13.168384 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-218dadb2-51c0-4586-a10a-2c77e698e290 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:13.169007 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-218dadb2-51c0-4586-a10a-2c77e698e290 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:13.233170 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-218dadb2-51c0-4586-a10a-2c77e698e290 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:13.241838 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-218dadb2-51c0-4586-a10a-2c77e698e290 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.087120 May 03 09:22:13.242428 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1269/2366] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:13 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:13.901886 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-23ec4e78-245a-401b-9f5f-f7f013922f4d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:13.902841 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-23ec4e78-245a-401b-9f5f-f7f013922f4d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:13.913571 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-23ec4e78-245a-401b-9f5f-f7f013922f4d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:13.914316 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-23ec4e78-245a-401b-9f5f-f7f013922f4d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:13.915573 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-23ec4e78-245a-401b-9f5f-f7f013922f4d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:13.916345 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-23ec4e78-245a-401b-9f5f-f7f013922f4d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:14.049725 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-23ec4e78-245a-401b-9f5f-f7f013922f4d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:14.058177 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-23ec4e78-245a-401b-9f5f-f7f013922f4d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.162858 May 03 09:22:14.058757 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1098/2367] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:13 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:14.261290 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c0972912-1f2f-445e-b216-da35ff362d2c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:14.262154 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c0972912-1f2f-445e-b216-da35ff362d2c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:14.271554 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c0972912-1f2f-445e-b216-da35ff362d2c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:14.272231 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c0972912-1f2f-445e-b216-da35ff362d2c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:14.273306 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c0972912-1f2f-445e-b216-da35ff362d2c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:14.273917 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c0972912-1f2f-445e-b216-da35ff362d2c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:14.336746 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c0972912-1f2f-445e-b216-da35ff362d2c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:14.345099 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c0972912-1f2f-445e-b216-da35ff362d2c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.089639 May 03 09:22:14.345653 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1270/2368] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:14 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:15.075677 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0cb65755-015c-42e8-ac98-0a464c0dab7e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:15.076304 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0cb65755-015c-42e8-ac98-0a464c0dab7e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:15.083068 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0cb65755-015c-42e8-ac98-0a464c0dab7e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:15.083525 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0cb65755-015c-42e8-ac98-0a464c0dab7e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:15.084349 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0cb65755-015c-42e8-ac98-0a464c0dab7e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:15.084793 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0cb65755-015c-42e8-ac98-0a464c0dab7e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:15.229017 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0cb65755-015c-42e8-ac98-0a464c0dab7e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:15.237380 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0cb65755-015c-42e8-ac98-0a464c0dab7e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.165752 May 03 09:22:15.237954 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1099/2369] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:15 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:15.365695 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-489d6ae9-1e88-4205-b58d-84548e4a103c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:15.366611 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-489d6ae9-1e88-4205-b58d-84548e4a103c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:15.377243 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-489d6ae9-1e88-4205-b58d-84548e4a103c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:15.377982 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-489d6ae9-1e88-4205-b58d-84548e4a103c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:15.379221 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-489d6ae9-1e88-4205-b58d-84548e4a103c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:15.379974 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-489d6ae9-1e88-4205-b58d-84548e4a103c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:15.445133 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-489d6ae9-1e88-4205-b58d-84548e4a103c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:15.453190 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-489d6ae9-1e88-4205-b58d-84548e4a103c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.094244 May 03 09:22:15.453759 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1271/2370] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:15 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:16.258847 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0a488d6b-009b-4ef1-9c4e-9ca72fa1e259 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:16.259576 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0a488d6b-009b-4ef1-9c4e-9ca72fa1e259 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:16.270128 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0a488d6b-009b-4ef1-9c4e-9ca72fa1e259 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:16.270858 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0a488d6b-009b-4ef1-9c4e-9ca72fa1e259 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:16.272200 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0a488d6b-009b-4ef1-9c4e-9ca72fa1e259 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:16.272879 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0a488d6b-009b-4ef1-9c4e-9ca72fa1e259 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:16.416171 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0a488d6b-009b-4ef1-9c4e-9ca72fa1e259 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:16.428895 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0a488d6b-009b-4ef1-9c4e-9ca72fa1e259 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.176582 May 03 09:22:16.429763 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1100/2371] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:16 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:16.469856 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d5d40c0d-1ef1-4321-a2cc-0f802e357831 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:16.470443 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d5d40c0d-1ef1-4321-a2cc-0f802e357831 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:16.477416 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d5d40c0d-1ef1-4321-a2cc-0f802e357831 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:16.477866 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d5d40c0d-1ef1-4321-a2cc-0f802e357831 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:16.478618 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d5d40c0d-1ef1-4321-a2cc-0f802e357831 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:16.479044 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d5d40c0d-1ef1-4321-a2cc-0f802e357831 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:16.545930 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d5d40c0d-1ef1-4321-a2cc-0f802e357831 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:16.554127 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d5d40c0d-1ef1-4321-a2cc-0f802e357831 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.088268 May 03 09:22:16.554685 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1272/2372] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:16 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:17.451469 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d98988f0-239f-48db-8534-7f22d57b0568 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:17.452301 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d98988f0-239f-48db-8534-7f22d57b0568 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:17.461408 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d98988f0-239f-48db-8534-7f22d57b0568 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:17.461992 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d98988f0-239f-48db-8534-7f22d57b0568 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:17.463005 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d98988f0-239f-48db-8534-7f22d57b0568 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:17.463582 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d98988f0-239f-48db-8534-7f22d57b0568 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:17.571375 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e52005e0-d796-4f98-beb1-905802ee8a29 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:17.572128 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e52005e0-d796-4f98-beb1-905802ee8a29 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:17.578827 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e52005e0-d796-4f98-beb1-905802ee8a29 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:17.579281 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e52005e0-d796-4f98-beb1-905802ee8a29 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:17.580133 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e52005e0-d796-4f98-beb1-905802ee8a29 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:17.580572 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e52005e0-d796-4f98-beb1-905802ee8a29 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:17.610597 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d98988f0-239f-48db-8534-7f22d57b0568 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:17.618724 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d98988f0-239f-48db-8534-7f22d57b0568 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.173680 May 03 09:22:17.619333 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1101/2373] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:17 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:17.642374 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e52005e0-d796-4f98-beb1-905802ee8a29 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:17.650427 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e52005e0-d796-4f98-beb1-905802ee8a29 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.083359 May 03 09:22:17.650963 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1273/2374] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:17 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:18.635421 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e7eb9008-7264-4c1a-8d15-a32a8d4d50e6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:18.636026 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e7eb9008-7264-4c1a-8d15-a32a8d4d50e6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:18.642839 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e7eb9008-7264-4c1a-8d15-a32a8d4d50e6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:18.643283 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e7eb9008-7264-4c1a-8d15-a32a8d4d50e6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:18.644086 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e7eb9008-7264-4c1a-8d15-a32a8d4d50e6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:18.644514 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e7eb9008-7264-4c1a-8d15-a32a8d4d50e6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:18.667397 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a88d119e-8b28-4dbe-ab1f-50ca4a96d840 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:18.668085 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a88d119e-8b28-4dbe-ab1f-50ca4a96d840 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:18.674846 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a88d119e-8b28-4dbe-ab1f-50ca4a96d840 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:18.675299 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a88d119e-8b28-4dbe-ab1f-50ca4a96d840 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:18.676096 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a88d119e-8b28-4dbe-ab1f-50ca4a96d840 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:18.676528 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a88d119e-8b28-4dbe-ab1f-50ca4a96d840 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:18.758518 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a88d119e-8b28-4dbe-ab1f-50ca4a96d840 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:18.767059 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a88d119e-8b28-4dbe-ab1f-50ca4a96d840 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.103492 May 03 09:22:18.767749 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1274/2375] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:18 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:18.794904 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e7eb9008-7264-4c1a-8d15-a32a8d4d50e6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:18.803176 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e7eb9008-7264-4c1a-8d15-a32a8d4d50e6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.171780 May 03 09:22:18.803747 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1102/2376] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:18 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:19.785547 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c4640ae3-3d7f-43d7-97c7-9bf8f874902a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:19.786495 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c4640ae3-3d7f-43d7-97c7-9bf8f874902a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:19.793821 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c4640ae3-3d7f-43d7-97c7-9bf8f874902a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:19.794293 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c4640ae3-3d7f-43d7-97c7-9bf8f874902a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:19.795088 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c4640ae3-3d7f-43d7-97c7-9bf8f874902a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:19.795511 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c4640ae3-3d7f-43d7-97c7-9bf8f874902a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:19.820710 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0cfd4ab9-3d0b-4f32-9700-c035138e4005 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:19.821292 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0cfd4ab9-3d0b-4f32-9700-c035138e4005 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:19.828618 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0cfd4ab9-3d0b-4f32-9700-c035138e4005 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:19.829075 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0cfd4ab9-3d0b-4f32-9700-c035138e4005 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:19.829841 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0cfd4ab9-3d0b-4f32-9700-c035138e4005 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:19.830271 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0cfd4ab9-3d0b-4f32-9700-c035138e4005 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:19.861236 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c4640ae3-3d7f-43d7-97c7-9bf8f874902a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:19.870542 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c4640ae3-3d7f-43d7-97c7-9bf8f874902a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.089255 May 03 09:22:19.871163 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1275/2377] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:19 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:19.973846 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0cfd4ab9-3d0b-4f32-9700-c035138e4005 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:19.982541 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0cfd4ab9-3d0b-4f32-9700-c035138e4005 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.165852 May 03 09:22:19.983159 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1103/2378] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:19 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:20.888713 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a5464193-fde6-40a2-b0fa-9670b1fc5f55 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:20.889372 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a5464193-fde6-40a2-b0fa-9670b1fc5f55 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:20.896458 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a5464193-fde6-40a2-b0fa-9670b1fc5f55 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:20.896904 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a5464193-fde6-40a2-b0fa-9670b1fc5f55 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:20.897684 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a5464193-fde6-40a2-b0fa-9670b1fc5f55 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:20.898099 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a5464193-fde6-40a2-b0fa-9670b1fc5f55 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:21.001652 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-22d15bd1-4eeb-4b5a-93b0-49de06696b05 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:21.002522 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-22d15bd1-4eeb-4b5a-93b0-49de06696b05 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:21.010114 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-22d15bd1-4eeb-4b5a-93b0-49de06696b05 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:21.010560 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-22d15bd1-4eeb-4b5a-93b0-49de06696b05 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:21.011386 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-22d15bd1-4eeb-4b5a-93b0-49de06696b05 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:21.011860 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-22d15bd1-4eeb-4b5a-93b0-49de06696b05 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:21.266299 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a5464193-fde6-40a2-b0fa-9670b1fc5f55 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:21.274450 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a5464193-fde6-40a2-b0fa-9670b1fc5f55 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.389908 May 03 09:22:21.275057 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1276/2379] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:20 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:21.353507 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-22d15bd1-4eeb-4b5a-93b0-49de06696b05 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:21.361576 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-22d15bd1-4eeb-4b5a-93b0-49de06696b05 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.364347 May 03 09:22:21.362147 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1104/2380] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:20 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:22.290815 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d71b3366-3760-45c8-b0a5-27b22cedcd85 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:22.291409 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d71b3366-3760-45c8-b0a5-27b22cedcd85 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:22.298192 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d71b3366-3760-45c8-b0a5-27b22cedcd85 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:22.298639 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d71b3366-3760-45c8-b0a5-27b22cedcd85 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:22.299395 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d71b3366-3760-45c8-b0a5-27b22cedcd85 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:22.299921 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d71b3366-3760-45c8-b0a5-27b22cedcd85 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:22.365548 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d71b3366-3760-45c8-b0a5-27b22cedcd85 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:22.374242 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d71b3366-3760-45c8-b0a5-27b22cedcd85 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.087367 May 03 09:22:22.374796 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1277/2381] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:22 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:22.378707 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-eaac12d4-44d2-4edf-947b-05261bfe4430 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:22.379316 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-eaac12d4-44d2-4edf-947b-05261bfe4430 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:22.386126 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-eaac12d4-44d2-4edf-947b-05261bfe4430 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:22.386577 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-eaac12d4-44d2-4edf-947b-05261bfe4430 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:22.387335 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-eaac12d4-44d2-4edf-947b-05261bfe4430 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:22.387797 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-eaac12d4-44d2-4edf-947b-05261bfe4430 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:22.518517 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-eaac12d4-44d2-4edf-947b-05261bfe4430 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:22.526870 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-eaac12d4-44d2-4edf-947b-05261bfe4430 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.152133 May 03 09:22:22.527448 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1105/2382] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:22 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:22.588545 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 09:22:22.588732 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: Tue May 3 09:22:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 03 09:22:23.391650 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b487f2eb-eb22-497f-805f-8e44f80f575e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:23.392666 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b487f2eb-eb22-497f-805f-8e44f80f575e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:23.400543 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b487f2eb-eb22-497f-805f-8e44f80f575e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:23.401155 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b487f2eb-eb22-497f-805f-8e44f80f575e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:23.402293 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b487f2eb-eb22-497f-805f-8e44f80f575e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:23.402930 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b487f2eb-eb22-497f-805f-8e44f80f575e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:23.470330 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b487f2eb-eb22-497f-805f-8e44f80f575e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:23.478409 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b487f2eb-eb22-497f-805f-8e44f80f575e tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.091484 May 03 09:22:23.478986 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1278/2383] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:23 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:23.544955 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-92b99477-4312-41e2-9106-3b27e7338966 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:23.545561 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-92b99477-4312-41e2-9106-3b27e7338966 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:23.552138 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-92b99477-4312-41e2-9106-3b27e7338966 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:23.552597 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-92b99477-4312-41e2-9106-3b27e7338966 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:23.553369 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-92b99477-4312-41e2-9106-3b27e7338966 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:23.553809 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-92b99477-4312-41e2-9106-3b27e7338966 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:23.684500 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-92b99477-4312-41e2-9106-3b27e7338966 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:23.694440 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-92b99477-4312-41e2-9106-3b27e7338966 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.153706 May 03 09:22:23.695024 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1106/2384] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:23 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:24.495029 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-6263c663-5c91-4c51-a2bd-1c5eb41b4856 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:24.495608 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-6263c663-5c91-4c51-a2bd-1c5eb41b4856 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:24.502427 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6263c663-5c91-4c51-a2bd-1c5eb41b4856 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:24.502880 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6263c663-5c91-4c51-a2bd-1c5eb41b4856 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:24.503656 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6263c663-5c91-4c51-a2bd-1c5eb41b4856 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:24.504156 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6263c663-5c91-4c51-a2bd-1c5eb41b4856 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:24.567607 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-6263c663-5c91-4c51-a2bd-1c5eb41b4856 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:24.575694 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-6263c663-5c91-4c51-a2bd-1c5eb41b4856 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.084697 May 03 09:22:24.576310 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1279/2385] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:24 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:24.712237 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-31a76d9c-89a0-4b2c-99cb-a93b64746157 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:24.712829 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-31a76d9c-89a0-4b2c-99cb-a93b64746157 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:24.719802 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-31a76d9c-89a0-4b2c-99cb-a93b64746157 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:24.720265 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-31a76d9c-89a0-4b2c-99cb-a93b64746157 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:24.721038 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-31a76d9c-89a0-4b2c-99cb-a93b64746157 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:24.721469 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-31a76d9c-89a0-4b2c-99cb-a93b64746157 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:24.849501 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-31a76d9c-89a0-4b2c-99cb-a93b64746157 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:24.857615 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-31a76d9c-89a0-4b2c-99cb-a93b64746157 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.149987 May 03 09:22:24.858185 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1107/2386] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:24 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:25.593744 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-562ddfc6-cfbf-41ec-96ce-4bd0b9124274 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:25.594300 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-562ddfc6-cfbf-41ec-96ce-4bd0b9124274 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:25.601029 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-562ddfc6-cfbf-41ec-96ce-4bd0b9124274 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:25.601508 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-562ddfc6-cfbf-41ec-96ce-4bd0b9124274 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:25.602243 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-562ddfc6-cfbf-41ec-96ce-4bd0b9124274 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:25.602674 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-562ddfc6-cfbf-41ec-96ce-4bd0b9124274 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:25.663879 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-562ddfc6-cfbf-41ec-96ce-4bd0b9124274 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:25.672041 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-562ddfc6-cfbf-41ec-96ce-4bd0b9124274 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.082473 May 03 09:22:25.672605 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1280/2387] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:25 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:25.876612 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-15129cee-fc19-4139-a39b-ff17c98e756c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:25.877457 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-15129cee-fc19-4139-a39b-ff17c98e756c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:25.887972 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-15129cee-fc19-4139-a39b-ff17c98e756c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:25.888726 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-15129cee-fc19-4139-a39b-ff17c98e756c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:25.889499 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-15129cee-fc19-4139-a39b-ff17c98e756c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:25.889930 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-15129cee-fc19-4139-a39b-ff17c98e756c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:26.037044 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-15129cee-fc19-4139-a39b-ff17c98e756c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:26.048964 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-15129cee-fc19-4139-a39b-ff17c98e756c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.177556 May 03 09:22:26.049707 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1108/2388] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:25 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:26.689221 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a2c2778a-e170-497d-b9b5-ee64c4261836 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:26.689883 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a2c2778a-e170-497d-b9b5-ee64c4261836 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:26.696512 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a2c2778a-e170-497d-b9b5-ee64c4261836 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:26.696954 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a2c2778a-e170-497d-b9b5-ee64c4261836 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:26.697701 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a2c2778a-e170-497d-b9b5-ee64c4261836 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:26.698141 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a2c2778a-e170-497d-b9b5-ee64c4261836 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:26.759789 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a2c2778a-e170-497d-b9b5-ee64c4261836 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:26.767885 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a2c2778a-e170-497d-b9b5-ee64c4261836 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1369 microversion: 2.1 time: 0.082679 May 03 09:22:26.768456 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1281/2389] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:26 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:26.785374 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a93a10e0-802e-4b99-9603-55dec462a9bb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '.version_select at 0x7f09cdfbd700>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:26.805001 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a93a10e0-802e-4b99-9603-55dec462a9bb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1925447370" status: 202 len: 0 microversion: 2.1 time: 0.023526 May 03 09:22:26.805567 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1109/2390] 10.222.0.11 () {58 vars in 1220 bytes} [Tue May 3 09:22:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1925447370 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 09:22:27.070153 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-26726744-ed96-402b-a7df-b6f8001826ab tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:27.071025 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-26726744-ed96-402b-a7df-b6f8001826ab tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:27.077420 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-26726744-ed96-402b-a7df-b6f8001826ab tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:27.077874 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-26726744-ed96-402b-a7df-b6f8001826ab tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:27.078644 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-26726744-ed96-402b-a7df-b6f8001826ab tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:27.079078 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-26726744-ed96-402b-a7df-b6f8001826ab tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:27.210636 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-26726744-ed96-402b-a7df-b6f8001826ab tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:27.218802 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-26726744-ed96-402b-a7df-b6f8001826ab tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.152651 May 03 09:22:27.219442 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1282/2391] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:27 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:27.594098 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b8eda77f-7bcb-445c-a835-522146f86651 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Action: 'create', calling method: .version_select at 0x7f09cdc81040>, body: {"keypair": {"name": "tempest-keypair-2030153821"}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:22:27.609982 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-b8eda77f-7bcb-445c-a835-522146f86651 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Getting quotas for project d9159d65c5ca43edadaa60281f20c2ae. Resources: {'key_pairs'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 03 09:22:27.614078 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-b8eda77f-7bcb-445c-a835-522146f86651 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Getting quotas for user 027eeadca01b4c4f93b892ef0fbcb195 and project d9159d65c5ca43edadaa60281f20c2ae. Resources: {'key_pairs'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 03 09:22:27.765677 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-b8eda77f-7bcb-445c-a835-522146f86651 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Getting quotas for project d9159d65c5ca43edadaa60281f20c2ae. Resources: {'key_pairs'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 03 09:22:27.769335 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-b8eda77f-7bcb-445c-a835-522146f86651 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Getting quotas for user 027eeadca01b4c4f93b892ef0fbcb195 and project d9159d65c5ca43edadaa60281f20c2ae. Resources: {'key_pairs'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 03 09:22:27.782206 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b8eda77f-7bcb-445c-a835-522146f86651 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.192402 May 03 09:22:27.782799 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1110/2392] 10.222.0.11 () {60 vars in 1157 bytes} [Tue May 3 09:22:27 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:28.236134 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e8d29913-4f9b-48a2-9290-12f4781713d6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:28.237297 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e8d29913-4f9b-48a2-9290-12f4781713d6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:28.243910 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e8d29913-4f9b-48a2-9290-12f4781713d6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:28.244359 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e8d29913-4f9b-48a2-9290-12f4781713d6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:28.245159 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e8d29913-4f9b-48a2-9290-12f4781713d6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:28.245612 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e8d29913-4f9b-48a2-9290-12f4781713d6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:28.464401 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e8d29913-4f9b-48a2-9290-12f4781713d6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:28.479421 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e8d29913-4f9b-48a2-9290-12f4781713d6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.247240 May 03 09:22:28.480156 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1283/2393] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:28 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:29.090818 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c3b466c9-28d7-4c07-91a1-d02d809194d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2095374155", "imageRef": "bd46d67a-108d-4c0c-9f0b-cb6d41c82a32", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d58d27bc-7779-478c-8f00-2b48ab956e47"}], "security_groups": [{"name": "tempest-securitygroup--1698614208"}], "key_name": "tempest-keypair-2030153821", "user_data": "}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:22:29.190896 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.network.neutron [None req-c3b466c9-28d7-4c07-91a1-d02d809194d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] validate_networks() for [('d58d27bc-7779-478c-8f00-2b48ab956e47', None, None, None, None, None)] {{(pid=123392) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 03 09:22:29.497165 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c91d0f52-2f03-4bc2-bc91-1d8fb25747bd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:29.497774 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c91d0f52-2f03-4bc2-bc91-1d8fb25747bd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:29.504513 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c91d0f52-2f03-4bc2-bc91-1d8fb25747bd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:29.504965 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c91d0f52-2f03-4bc2-bc91-1d8fb25747bd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:29.505732 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c91d0f52-2f03-4bc2-bc91-1d8fb25747bd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:29.506168 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c91d0f52-2f03-4bc2-bc91-1d8fb25747bd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:29.586025 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-c3b466c9-28d7-4c07-91a1-d02d809194d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Flavor limits 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 03 09:22:29.586451 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-c3b466c9-28d7-4c07-91a1-d02d809194d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Image limits 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 03 09:22:29.586945 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-c3b466c9-28d7-4c07-91a1-d02d809194d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Flavor pref 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 03 09:22:29.587335 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-c3b466c9-28d7-4c07-91a1-d02d809194d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Image pref 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 03 09:22:29.587748 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-c3b466c9-28d7-4c07-91a1-d02d809194d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 03 09:22:29.596743 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c3b466c9-28d7-4c07-91a1-d02d809194d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:29.597226 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c3b466c9-28d7-4c07-91a1-d02d809194d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:29.598002 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c3b466c9-28d7-4c07-91a1-d02d809194d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:29.598435 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c3b466c9-28d7-4c07-91a1-d02d809194d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:29.615243 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-c3b466c9-28d7-4c07-91a1-d02d809194d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Getting quotas for project d9159d65c5ca43edadaa60281f20c2ae. Resources: {'cores', 'ram', 'instances'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 03 09:22:29.619196 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-c3b466c9-28d7-4c07-91a1-d02d809194d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Getting quotas for user 027eeadca01b4c4f93b892ef0fbcb195 and project d9159d65c5ca43edadaa60281f20c2ae. Resources: {'cores', 'ram', 'instances'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 03 09:22:29.630588 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c3b466c9-28d7-4c07-91a1-d02d809194d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Going to run 1 instances... {{(pid=123392) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 03 09:22:29.632926 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c3b466c9-28d7-4c07-91a1-d02d809194d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: e3fc745c-a212-4dc7-8d76-601e0f70dbc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd46d67a-108d-4c0c-9f0b-cb6d41c82a32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 03 09:22:29.648940 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c91d0f52-2f03-4bc2-bc91-1d8fb25747bd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:29.657012 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c91d0f52-2f03-4bc2-bc91-1d8fb25747bd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.163882 May 03 09:22:29.657638 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1284/2394] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:29 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:29.683455 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c3b466c9-28d7-4c07-91a1-d02d809194d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.597440 May 03 09:22:29.687827 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1111/2395] 10.222.0.11 () {60 vars in 1146 bytes} [Tue May 3 09:22:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 03 09:22:29.694523 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b5a05f71-b30f-45bc-bafa-2addf54bb6f9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:29.695160 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b5a05f71-b30f-45bc-bafa-2addf54bb6f9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: e3fc745c-a212-4dc7-8d76-601e0f70dbc7] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:29.746569 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b5a05f71-b30f-45bc-bafa-2addf54bb6f9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:29.753469 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b5a05f71-b30f-45bc-bafa-2addf54bb6f9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/e3fc745c-a212-4dc7-8d76-601e0f70dbc7" status: 200 len: 1238 microversion: 2.1 time: 0.062835 May 03 09:22:29.754056 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1285/2396] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:29 2022] GET /compute/v2.1/servers/e3fc745c-a212-4dc7-8d76-601e0f70dbc7 => generated 1238 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:30.674739 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-1cf55fc9-91eb-442c-94a3-43e4c0eda13e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:30.675350 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-1cf55fc9-91eb-442c-94a3-43e4c0eda13e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:30.681982 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1cf55fc9-91eb-442c-94a3-43e4c0eda13e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:30.682431 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1cf55fc9-91eb-442c-94a3-43e4c0eda13e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:30.683205 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1cf55fc9-91eb-442c-94a3-43e4c0eda13e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:30.683620 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1cf55fc9-91eb-442c-94a3-43e4c0eda13e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:30.770745 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c832529b-8353-4117-b6f0-80729b3b1453 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:30.771313 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c832529b-8353-4117-b6f0-80729b3b1453 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: e3fc745c-a212-4dc7-8d76-601e0f70dbc7] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:30.778472 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c832529b-8353-4117-b6f0-80729b3b1453 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:30.779001 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c832529b-8353-4117-b6f0-80729b3b1453 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:30.780516 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c832529b-8353-4117-b6f0-80729b3b1453 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:30.780940 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c832529b-8353-4117-b6f0-80729b3b1453 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:30.817377 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-1cf55fc9-91eb-442c-94a3-43e4c0eda13e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:30.825860 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-1cf55fc9-91eb-442c-94a3-43e4c0eda13e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.155383 May 03 09:22:30.826523 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1112/2397] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:30 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:30.849169 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c832529b-8353-4117-b6f0-80729b3b1453 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:30.856476 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c832529b-8353-4117-b6f0-80729b3b1453 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/e3fc745c-a212-4dc7-8d76-601e0f70dbc7" status: 200 len: 1296 microversion: 2.1 time: 0.089858 May 03 09:22:30.857184 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1286/2398] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:30 2022] GET /compute/v2.1/servers/e3fc745c-a212-4dc7-8d76-601e0f70dbc7 => generated 1296 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:31.843068 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e707b56c-0dff-40dc-b8db-0473ea4132ab tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:31.843658 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e707b56c-0dff-40dc-b8db-0473ea4132ab tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:31.850793 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e707b56c-0dff-40dc-b8db-0473ea4132ab tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:31.851245 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e707b56c-0dff-40dc-b8db-0473ea4132ab tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:31.852081 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e707b56c-0dff-40dc-b8db-0473ea4132ab tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:31.852512 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e707b56c-0dff-40dc-b8db-0473ea4132ab tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:31.874124 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b52b11bd-48ea-453d-bc74-39f85efa5f2f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:31.874984 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b52b11bd-48ea-453d-bc74-39f85efa5f2f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: e3fc745c-a212-4dc7-8d76-601e0f70dbc7] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:31.882328 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b52b11bd-48ea-453d-bc74-39f85efa5f2f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:31.883139 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b52b11bd-48ea-453d-bc74-39f85efa5f2f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:31.883975 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b52b11bd-48ea-453d-bc74-39f85efa5f2f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:31.884376 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b52b11bd-48ea-453d-bc74-39f85efa5f2f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:32.060133 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e707b56c-0dff-40dc-b8db-0473ea4132ab tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:32.064497 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b52b11bd-48ea-453d-bc74-39f85efa5f2f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:32.073019 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b52b11bd-48ea-453d-bc74-39f85efa5f2f tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/e3fc745c-a212-4dc7-8d76-601e0f70dbc7" status: 200 len: 1364 microversion: 2.1 time: 0.202789 May 03 09:22:32.074502 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1287/2399] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:31 2022] GET /compute/v2.1/servers/e3fc745c-a212-4dc7-8d76-601e0f70dbc7 => generated 1364 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:32.080139 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e707b56c-0dff-40dc-b8db-0473ea4132ab tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.241084 May 03 09:22:32.081584 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1113/2400] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:31 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:32.246678 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [req-9d450355-eec5-4db9-a494-e9bc9ddaa2e0 req-05cb65c5-c79c-4887-942a-d8a1f98122da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3fc745c-a212-4dc7-8d76-601e0f70dbc7", "tag": "a394154c-d998-421c-9a73-8c82f7b46a7a"}]} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:22:32.255552 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-9d450355-eec5-4db9-a494-e9bc9ddaa2e0 req-05cb65c5-c79c-4887-942a-d8a1f98122da service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:32.256022 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-9d450355-eec5-4db9-a494-e9bc9ddaa2e0 req-05cb65c5-c79c-4887-942a-d8a1f98122da service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:32.267957 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.compute.server_external_events [req-9d450355-eec5-4db9-a494-e9bc9ddaa2e0 req-05cb65c5-c79c-4887-942a-d8a1f98122da service nova] Creating event network-changed:a394154c-d998-421c-9a73-8c82f7b46a7a for instance e3fc745c-a212-4dc7-8d76-601e0f70dbc7 on hv-cinder-84027 May 03 09:22:32.273999 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [req-9d450355-eec5-4db9-a494-e9bc9ddaa2e0 req-05cb65c5-c79c-4887-942a-d8a1f98122da service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031112 May 03 09:22:32.274999 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1288/2401] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:22:33.090985 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5f63141c-c9ae-4a49-a8d0-bb0358449444 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:33.091660 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5f63141c-c9ae-4a49-a8d0-bb0358449444 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: e3fc745c-a212-4dc7-8d76-601e0f70dbc7] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:33.098558 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5f63141c-c9ae-4a49-a8d0-bb0358449444 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:33.098950 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-7de9673a-dec0-4b06-a3fc-413761d250aa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:33.099433 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5f63141c-c9ae-4a49-a8d0-bb0358449444 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:33.099639 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-7de9673a-dec0-4b06-a3fc-413761d250aa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:33.099817 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5f63141c-c9ae-4a49-a8d0-bb0358449444 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:33.100251 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5f63141c-c9ae-4a49-a8d0-bb0358449444 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:33.106280 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7de9673a-dec0-4b06-a3fc-413761d250aa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:33.106827 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7de9673a-dec0-4b06-a3fc-413761d250aa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:33.107594 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7de9673a-dec0-4b06-a3fc-413761d250aa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:33.108076 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7de9673a-dec0-4b06-a3fc-413761d250aa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:33.297508 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5f63141c-c9ae-4a49-a8d0-bb0358449444 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:33.300643 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7de9673a-dec0-4b06-a3fc-413761d250aa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:33.305191 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5f63141c-c9ae-4a49-a8d0-bb0358449444 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/e3fc745c-a212-4dc7-8d76-601e0f70dbc7" status: 200 len: 1364 microversion: 2.1 time: 0.218251 May 03 09:22:33.305771 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1114/2402] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:33 2022] GET /compute/v2.1/servers/e3fc745c-a212-4dc7-8d76-601e0f70dbc7 => generated 1364 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:33.308693 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-7de9673a-dec0-4b06-a3fc-413761d250aa tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.214320 May 03 09:22:33.309267 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1289/2403] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:33 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:34.322300 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a4798be2-f371-4c6c-aec3-e9c1422e1fe9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:34.322923 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a4798be2-f371-4c6c-aec3-e9c1422e1fe9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: e3fc745c-a212-4dc7-8d76-601e0f70dbc7] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:34.325686 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-37efc84c-5524-4597-b353-24f7ec8fe756 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:34.326374 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-37efc84c-5524-4597-b353-24f7ec8fe756 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:34.329633 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a4798be2-f371-4c6c-aec3-e9c1422e1fe9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:34.330083 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a4798be2-f371-4c6c-aec3-e9c1422e1fe9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:34.330848 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a4798be2-f371-4c6c-aec3-e9c1422e1fe9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:34.331282 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a4798be2-f371-4c6c-aec3-e9c1422e1fe9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:34.333612 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-37efc84c-5524-4597-b353-24f7ec8fe756 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:34.334050 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-37efc84c-5524-4597-b353-24f7ec8fe756 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:34.335181 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-37efc84c-5524-4597-b353-24f7ec8fe756 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:34.335611 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-37efc84c-5524-4597-b353-24f7ec8fe756 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:34.526986 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a4798be2-f371-4c6c-aec3-e9c1422e1fe9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:34.534509 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-37efc84c-5524-4597-b353-24f7ec8fe756 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:34.534764 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a4798be2-f371-4c6c-aec3-e9c1422e1fe9 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/e3fc745c-a212-4dc7-8d76-601e0f70dbc7" status: 200 len: 1364 microversion: 2.1 time: 0.216382 May 03 09:22:34.535354 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1115/2404] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:34 2022] GET /compute/v2.1/servers/e3fc745c-a212-4dc7-8d76-601e0f70dbc7 => generated 1364 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:34.542774 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-37efc84c-5524-4597-b353-24f7ec8fe756 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.221042 May 03 09:22:34.543431 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1290/2405] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:34 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:35.552062 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-3b1eb5bc-0330-436e-adca-900ab89ab91a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:35.552646 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-3b1eb5bc-0330-436e-adca-900ab89ab91a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: e3fc745c-a212-4dc7-8d76-601e0f70dbc7] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:35.559699 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3b1eb5bc-0330-436e-adca-900ab89ab91a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:35.560167 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3b1eb5bc-0330-436e-adca-900ab89ab91a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:35.560744 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-54253f62-fc72-41aa-a2b6-193fbea79a18 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:35.561274 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3b1eb5bc-0330-436e-adca-900ab89ab91a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:35.561382 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-54253f62-fc72-41aa-a2b6-193fbea79a18 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:35.561478 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3b1eb5bc-0330-436e-adca-900ab89ab91a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:35.568195 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-54253f62-fc72-41aa-a2b6-193fbea79a18 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:35.568623 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-54253f62-fc72-41aa-a2b6-193fbea79a18 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:35.569434 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-54253f62-fc72-41aa-a2b6-193fbea79a18 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:35.569868 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-54253f62-fc72-41aa-a2b6-193fbea79a18 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:35.758358 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-3b1eb5bc-0330-436e-adca-900ab89ab91a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:35.761281 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-54253f62-fc72-41aa-a2b6-193fbea79a18 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:35.766038 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-3b1eb5bc-0330-436e-adca-900ab89ab91a tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/e3fc745c-a212-4dc7-8d76-601e0f70dbc7" status: 200 len: 1364 microversion: 2.1 time: 0.218014 May 03 09:22:35.766596 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1116/2406] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:35 2022] GET /compute/v2.1/servers/e3fc745c-a212-4dc7-8d76-601e0f70dbc7 => generated 1364 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:35.769372 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-54253f62-fc72-41aa-a2b6-193fbea79a18 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.212474 May 03 09:22:35.769982 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1291/2407] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:35 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:36.084186 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-cdb87a5e-d4fc-432e-90b5-08c524508e8d req-c4938ce6-36a5-4bd3-8ff0-1e99653bbdc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3fc745c-a212-4dc7-8d76-601e0f70dbc7", "name": "network-vif-plugged", "status": "completed", "tag": "a394154c-d998-421c-9a73-8c82f7b46a7a"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:22:36.093285 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-cdb87a5e-d4fc-432e-90b5-08c524508e8d req-c4938ce6-36a5-4bd3-8ff0-1e99653bbdc8 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:36.093880 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-cdb87a5e-d4fc-432e-90b5-08c524508e8d req-c4938ce6-36a5-4bd3-8ff0-1e99653bbdc8 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:36.106416 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-cdb87a5e-d4fc-432e-90b5-08c524508e8d req-c4938ce6-36a5-4bd3-8ff0-1e99653bbdc8 service nova] Creating event network-vif-plugged:a394154c-d998-421c-9a73-8c82f7b46a7a for instance e3fc745c-a212-4dc7-8d76-601e0f70dbc7 on hv-cinder-84027 May 03 09:22:36.113132 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-cdb87a5e-d4fc-432e-90b5-08c524508e8d req-c4938ce6-36a5-4bd3-8ff0-1e99653bbdc8 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032800 May 03 09:22:36.113924 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1117/2408] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:22:36.784410 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9878438b-6c6e-44c1-921b-483c84f164b5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:36.785011 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9878438b-6c6e-44c1-921b-483c84f164b5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: e3fc745c-a212-4dc7-8d76-601e0f70dbc7] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:36.787433 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5fd79610-c4d0-43f8-a8e8-cf2f2665da0f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:36.788148 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5fd79610-c4d0-43f8-a8e8-cf2f2665da0f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:36.791551 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9878438b-6c6e-44c1-921b-483c84f164b5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:36.792368 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9878438b-6c6e-44c1-921b-483c84f164b5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:36.793188 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9878438b-6c6e-44c1-921b-483c84f164b5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:36.793638 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9878438b-6c6e-44c1-921b-483c84f164b5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:36.794600 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5fd79610-c4d0-43f8-a8e8-cf2f2665da0f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:36.795054 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5fd79610-c4d0-43f8-a8e8-cf2f2665da0f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:36.795902 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5fd79610-c4d0-43f8-a8e8-cf2f2665da0f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:36.796331 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5fd79610-c4d0-43f8-a8e8-cf2f2665da0f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:36.998939 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9878438b-6c6e-44c1-921b-483c84f164b5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:37.007005 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5fd79610-c4d0-43f8-a8e8-cf2f2665da0f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:37.009147 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9878438b-6c6e-44c1-921b-483c84f164b5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/e3fc745c-a212-4dc7-8d76-601e0f70dbc7" status: 200 len: 1364 microversion: 2.1 time: 0.228920 May 03 09:22:37.009978 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1292/2409] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:36 2022] GET /compute/v2.1/servers/e3fc745c-a212-4dc7-8d76-601e0f70dbc7 => generated 1364 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:37.017020 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5fd79610-c4d0-43f8-a8e8-cf2f2665da0f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.234228 May 03 09:22:37.017758 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1118/2410] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:36 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:38.026734 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d6730555-6d35-4dff-9fdf-91ae80621a81 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:38.027358 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d6730555-6d35-4dff-9fdf-91ae80621a81 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: e3fc745c-a212-4dc7-8d76-601e0f70dbc7] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:38.033913 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d6730555-6d35-4dff-9fdf-91ae80621a81 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:38.034137 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2f46466f-d72b-4d59-8d34-d0124c4c668d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:38.034569 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d6730555-6d35-4dff-9fdf-91ae80621a81 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:38.034727 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-2f46466f-d72b-4d59-8d34-d0124c4c668d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:38.035103 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d6730555-6d35-4dff-9fdf-91ae80621a81 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:38.035536 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d6730555-6d35-4dff-9fdf-91ae80621a81 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:38.041619 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2f46466f-d72b-4d59-8d34-d0124c4c668d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:38.042067 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2f46466f-d72b-4d59-8d34-d0124c4c668d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:38.042839 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2f46466f-d72b-4d59-8d34-d0124c4c668d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:38.043265 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2f46466f-d72b-4d59-8d34-d0124c4c668d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:38.234131 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d6730555-6d35-4dff-9fdf-91ae80621a81 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:38.237459 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2f46466f-d72b-4d59-8d34-d0124c4c668d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:38.241921 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d6730555-6d35-4dff-9fdf-91ae80621a81 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/e3fc745c-a212-4dc7-8d76-601e0f70dbc7" status: 200 len: 1550 microversion: 2.1 time: 0.219090 May 03 09:22:38.242520 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1293/2411] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:38 2022] GET /compute/v2.1/servers/e3fc745c-a212-4dc7-8d76-601e0f70dbc7 => generated 1550 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:38.245724 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-2f46466f-d72b-4d59-8d34-d0124c4c668d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.215388 May 03 09:22:38.246301 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1119/2412] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:38 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:38.258854 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-26038ac2-3277-43e3-bd61-c711f974c2e7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:38.259345 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-26038ac2-3277-43e3-bd61-c711f974c2e7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: e3fc745c-a212-4dc7-8d76-601e0f70dbc7] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:38.265849 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-26038ac2-3277-43e3-bd61-c711f974c2e7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:38.266329 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-26038ac2-3277-43e3-bd61-c711f974c2e7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:38.267105 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-26038ac2-3277-43e3-bd61-c711f974c2e7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:38.267538 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-26038ac2-3277-43e3-bd61-c711f974c2e7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:38.346639 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-26038ac2-3277-43e3-bd61-c711f974c2e7 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/e3fc745c-a212-4dc7-8d76-601e0f70dbc7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091615 May 03 09:22:38.347247 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1294/2413] 10.222.0.11 () {58 vars in 1274 bytes} [Tue May 3 09:22:38 2022] GET /compute/v2.1/servers/e3fc745c-a212-4dc7-8d76-601e0f70dbc7/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:22:39.263268 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-066d6ebc-4325-4a6d-8c5d-09535bd18e6b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:39.263890 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-066d6ebc-4325-4a6d-8c5d-09535bd18e6b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:39.272058 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-066d6ebc-4325-4a6d-8c5d-09535bd18e6b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:39.272441 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-066d6ebc-4325-4a6d-8c5d-09535bd18e6b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:39.273113 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-066d6ebc-4325-4a6d-8c5d-09535bd18e6b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:39.273559 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-066d6ebc-4325-4a6d-8c5d-09535bd18e6b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:39.451537 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-066d6ebc-4325-4a6d-8c5d-09535bd18e6b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:39.460360 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-066d6ebc-4325-4a6d-8c5d-09535bd18e6b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.200667 May 03 09:22:39.466764 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1120/2414] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:39 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:39.472355 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [req-d13b7135-4db0-4e1f-934d-918e25edc9f5 req-e9130875-a5b1-4b8f-bea4-38389954000b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3fc745c-a212-4dc7-8d76-601e0f70dbc7", "tag": "a394154c-d998-421c-9a73-8c82f7b46a7a"}]} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:22:39.480489 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-d13b7135-4db0-4e1f-934d-918e25edc9f5 req-e9130875-a5b1-4b8f-bea4-38389954000b service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:39.480931 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-d13b7135-4db0-4e1f-934d-918e25edc9f5 req-e9130875-a5b1-4b8f-bea4-38389954000b service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:39.492553 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.compute.server_external_events [req-d13b7135-4db0-4e1f-934d-918e25edc9f5 req-e9130875-a5b1-4b8f-bea4-38389954000b service nova] Creating event network-changed:a394154c-d998-421c-9a73-8c82f7b46a7a for instance e3fc745c-a212-4dc7-8d76-601e0f70dbc7 on hv-cinder-84027 May 03 09:22:39.497854 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [req-d13b7135-4db0-4e1f-934d-918e25edc9f5 req-e9130875-a5b1-4b8f-bea4-38389954000b service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087355 May 03 09:22:39.498456 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1295/2415] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:22:40.477558 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5e85b360-fa2d-46b2-860f-d519f3ade841 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:40.478183 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5e85b360-fa2d-46b2-860f-d519f3ade841 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:40.484953 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5e85b360-fa2d-46b2-860f-d519f3ade841 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:40.485399 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5e85b360-fa2d-46b2-860f-d519f3ade841 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:40.486159 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5e85b360-fa2d-46b2-860f-d519f3ade841 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:40.486617 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5e85b360-fa2d-46b2-860f-d519f3ade841 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:40.626368 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5e85b360-fa2d-46b2-860f-d519f3ade841 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:40.634393 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5e85b360-fa2d-46b2-860f-d519f3ade841 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.160783 May 03 09:22:40.634965 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1121/2416] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:40 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:41.657632 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-269f1e22-be58-41ca-8c67-ca3ad0dc2e44 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:41.658798 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-269f1e22-be58-41ca-8c67-ca3ad0dc2e44 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:41.669146 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-269f1e22-be58-41ca-8c67-ca3ad0dc2e44 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:41.669599 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-269f1e22-be58-41ca-8c67-ca3ad0dc2e44 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:41.670374 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-269f1e22-be58-41ca-8c67-ca3ad0dc2e44 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:41.670806 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-269f1e22-be58-41ca-8c67-ca3ad0dc2e44 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:41.809173 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-269f1e22-be58-41ca-8c67-ca3ad0dc2e44 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:41.817581 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-269f1e22-be58-41ca-8c67-ca3ad0dc2e44 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.168020 May 03 09:22:41.818183 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1296/2417] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:41 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:42.836055 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-db3de191-6ada-48ba-93ba-a6f532b784ec tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:42.836636 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-db3de191-6ada-48ba-93ba-a6f532b784ec tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:42.843411 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-db3de191-6ada-48ba-93ba-a6f532b784ec tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:42.843878 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-db3de191-6ada-48ba-93ba-a6f532b784ec tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:42.844635 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-db3de191-6ada-48ba-93ba-a6f532b784ec tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:42.845066 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-db3de191-6ada-48ba-93ba-a6f532b784ec tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:42.985585 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-db3de191-6ada-48ba-93ba-a6f532b784ec tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:42.995575 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-db3de191-6ada-48ba-93ba-a6f532b784ec tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.163846 May 03 09:22:42.996298 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1122/2418] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:42 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:44.013339 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-15b0b964-5094-4b06-9990-0ab816465471 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:44.014013 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-15b0b964-5094-4b06-9990-0ab816465471 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:44.020886 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-15b0b964-5094-4b06-9990-0ab816465471 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:44.021336 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-15b0b964-5094-4b06-9990-0ab816465471 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:44.022104 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-15b0b964-5094-4b06-9990-0ab816465471 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:44.022538 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-15b0b964-5094-4b06-9990-0ab816465471 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:44.159585 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-15b0b964-5094-4b06-9990-0ab816465471 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:44.167557 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-15b0b964-5094-4b06-9990-0ab816465471 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.158219 May 03 09:22:44.168173 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1297/2419] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:44 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:45.187126 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4fd538e4-5bb8-4347-a9f1-3397db09cbd0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:45.187725 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4fd538e4-5bb8-4347-a9f1-3397db09cbd0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:45.194445 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4fd538e4-5bb8-4347-a9f1-3397db09cbd0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:45.194893 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4fd538e4-5bb8-4347-a9f1-3397db09cbd0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:45.195652 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4fd538e4-5bb8-4347-a9f1-3397db09cbd0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:45.196110 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4fd538e4-5bb8-4347-a9f1-3397db09cbd0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:45.340345 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-4fd538e4-5bb8-4347-a9f1-3397db09cbd0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:45.351003 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-4fd538e4-5bb8-4347-a9f1-3397db09cbd0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.169267 May 03 09:22:45.351833 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1123/2420] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:45 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:46.369614 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ed62f4d0-d598-441f-b172-3761a383f131 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:46.370274 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ed62f4d0-d598-441f-b172-3761a383f131 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:46.376730 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ed62f4d0-d598-441f-b172-3761a383f131 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:46.377187 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ed62f4d0-d598-441f-b172-3761a383f131 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:46.377937 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ed62f4d0-d598-441f-b172-3761a383f131 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:46.378367 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ed62f4d0-d598-441f-b172-3761a383f131 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:46.807515 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ed62f4d0-d598-441f-b172-3761a383f131 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:46.815847 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ed62f4d0-d598-441f-b172-3761a383f131 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.450152 May 03 09:22:46.816423 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1298/2421] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:46 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:47.833605 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ba472e55-0ea3-422e-b1c3-ceb9392e2fed tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:47.834603 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ba472e55-0ea3-422e-b1c3-ceb9392e2fed tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:47.841795 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ba472e55-0ea3-422e-b1c3-ceb9392e2fed tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:47.842249 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ba472e55-0ea3-422e-b1c3-ceb9392e2fed tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:47.844472 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ba472e55-0ea3-422e-b1c3-ceb9392e2fed tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:47.844472 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ba472e55-0ea3-422e-b1c3-ceb9392e2fed tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:47.981886 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ba472e55-0ea3-422e-b1c3-ceb9392e2fed tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:47.992650 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ba472e55-0ea3-422e-b1c3-ceb9392e2fed tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.163352 May 03 09:22:47.993591 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1124/2422] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:47 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:22:49.014272 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e3ef419a-adda-4623-a911-0ed7a474b853 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:49.015077 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e3ef419a-adda-4623-a911-0ed7a474b853 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:49.025057 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e3ef419a-adda-4623-a911-0ed7a474b853 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:49.025576 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e3ef419a-adda-4623-a911-0ed7a474b853 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:49.026501 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e3ef419a-adda-4623-a911-0ed7a474b853 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:49.026988 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e3ef419a-adda-4623-a911-0ed7a474b853 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:49.195074 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e3ef419a-adda-4623-a911-0ed7a474b853 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:49.203493 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e3ef419a-adda-4623-a911-0ed7a474b853 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.193859 May 03 09:22:49.204108 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1299/2423] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:49 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:50.223906 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ee1beb3f-b9f3-48c9-8faa-a9f95e148de8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:50.224528 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ee1beb3f-b9f3-48c9-8faa-a9f95e148de8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:50.232826 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ee1beb3f-b9f3-48c9-8faa-a9f95e148de8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:50.233276 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ee1beb3f-b9f3-48c9-8faa-a9f95e148de8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:50.234051 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ee1beb3f-b9f3-48c9-8faa-a9f95e148de8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:50.234486 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ee1beb3f-b9f3-48c9-8faa-a9f95e148de8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:50.391620 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ee1beb3f-b9f3-48c9-8faa-a9f95e148de8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:50.401275 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ee1beb3f-b9f3-48c9-8faa-a9f95e148de8 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.182531 May 03 09:22:50.402204 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1125/2424] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:50 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:51.418825 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b3571ea9-28a1-484f-9796-1b8e85bfdff5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:51.419445 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b3571ea9-28a1-484f-9796-1b8e85bfdff5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:51.426641 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b3571ea9-28a1-484f-9796-1b8e85bfdff5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:51.427089 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b3571ea9-28a1-484f-9796-1b8e85bfdff5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:51.427894 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b3571ea9-28a1-484f-9796-1b8e85bfdff5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:51.428334 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b3571ea9-28a1-484f-9796-1b8e85bfdff5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:51.565283 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b3571ea9-28a1-484f-9796-1b8e85bfdff5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:51.573994 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b3571ea9-28a1-484f-9796-1b8e85bfdff5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.159179 May 03 09:22:51.574593 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1300/2425] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:51 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:52.593951 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d7675a7f-26cf-4b9e-b4fb-df159a29bfa2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:52.594529 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d7675a7f-26cf-4b9e-b4fb-df159a29bfa2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:52.604561 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d7675a7f-26cf-4b9e-b4fb-df159a29bfa2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:52.605007 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d7675a7f-26cf-4b9e-b4fb-df159a29bfa2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:52.605801 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d7675a7f-26cf-4b9e-b4fb-df159a29bfa2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:52.606231 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d7675a7f-26cf-4b9e-b4fb-df159a29bfa2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:52.746014 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d7675a7f-26cf-4b9e-b4fb-df159a29bfa2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:52.754486 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d7675a7f-26cf-4b9e-b4fb-df159a29bfa2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.165982 May 03 09:22:52.755081 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1126/2426] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:52 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:53.777100 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3d1fc911-888a-4f92-8abc-077031180140 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:53.778212 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-3d1fc911-888a-4f92-8abc-077031180140 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:53.789795 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3d1fc911-888a-4f92-8abc-077031180140 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:53.790615 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3d1fc911-888a-4f92-8abc-077031180140 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:53.792094 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3d1fc911-888a-4f92-8abc-077031180140 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:53.792884 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3d1fc911-888a-4f92-8abc-077031180140 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:53.946209 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-3d1fc911-888a-4f92-8abc-077031180140 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:53.956455 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-3d1fc911-888a-4f92-8abc-077031180140 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.187021 May 03 09:22:53.957075 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1301/2427] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:53 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:22:54.973874 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0b6e2d3e-29a6-494d-9722-3ca43f0bd1da tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:54.974500 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0b6e2d3e-29a6-494d-9722-3ca43f0bd1da tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:54.981259 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0b6e2d3e-29a6-494d-9722-3ca43f0bd1da tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:54.981711 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0b6e2d3e-29a6-494d-9722-3ca43f0bd1da tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:54.982479 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0b6e2d3e-29a6-494d-9722-3ca43f0bd1da tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:54.982916 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0b6e2d3e-29a6-494d-9722-3ca43f0bd1da tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:55.124379 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0b6e2d3e-29a6-494d-9722-3ca43f0bd1da tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:55.133727 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0b6e2d3e-29a6-494d-9722-3ca43f0bd1da tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.163527 May 03 09:22:55.134540 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1127/2428] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:54 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:56.154213 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-2d75a23c-1312-4a68-9999-3415aaafad6d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:56.154857 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-2d75a23c-1312-4a68-9999-3415aaafad6d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:56.162724 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2d75a23c-1312-4a68-9999-3415aaafad6d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:56.163256 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2d75a23c-1312-4a68-9999-3415aaafad6d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:56.164457 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2d75a23c-1312-4a68-9999-3415aaafad6d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:56.165012 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2d75a23c-1312-4a68-9999-3415aaafad6d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:56.300238 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-2d75a23c-1312-4a68-9999-3415aaafad6d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:56.310589 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-2d75a23c-1312-4a68-9999-3415aaafad6d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.161731 May 03 09:22:56.311180 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1302/2429] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:56 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:57.330355 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6ba34a74-f1b8-4282-ad17-321ea0a6e73e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:57.331436 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6ba34a74-f1b8-4282-ad17-321ea0a6e73e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:57.342187 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6ba34a74-f1b8-4282-ad17-321ea0a6e73e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:57.342750 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6ba34a74-f1b8-4282-ad17-321ea0a6e73e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:57.343672 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6ba34a74-f1b8-4282-ad17-321ea0a6e73e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:57.344255 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6ba34a74-f1b8-4282-ad17-321ea0a6e73e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:57.502542 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6ba34a74-f1b8-4282-ad17-321ea0a6e73e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:57.511146 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6ba34a74-f1b8-4282-ad17-321ea0a6e73e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.184977 May 03 09:22:57.511735 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1128/2430] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:57 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:58.530937 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d4c823c3-0f8d-4665-8b87-eb50ce85d254 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:58.531666 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d4c823c3-0f8d-4665-8b87-eb50ce85d254 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:58.538176 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d4c823c3-0f8d-4665-8b87-eb50ce85d254 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:58.538620 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d4c823c3-0f8d-4665-8b87-eb50ce85d254 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:58.539376 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d4c823c3-0f8d-4665-8b87-eb50ce85d254 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:58.539808 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d4c823c3-0f8d-4665-8b87-eb50ce85d254 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:58.674498 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d4c823c3-0f8d-4665-8b87-eb50ce85d254 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:58.686424 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d4c823c3-0f8d-4665-8b87-eb50ce85d254 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.159284 May 03 09:22:58.687374 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1303/2431] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:58 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:22:59.706816 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-555d7cbd-eddd-45f9-937e-eb37429e77ad tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:22:59.707462 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-555d7cbd-eddd-45f9-937e-eb37429e77ad tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:22:59.714806 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-555d7cbd-eddd-45f9-937e-eb37429e77ad tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:59.715263 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-555d7cbd-eddd-45f9-937e-eb37429e77ad tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:59.716087 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-555d7cbd-eddd-45f9-937e-eb37429e77ad tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:22:59.716509 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-555d7cbd-eddd-45f9-937e-eb37429e77ad tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:22:59.846229 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-555d7cbd-eddd-45f9-937e-eb37429e77ad tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:22:59.854206 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-555d7cbd-eddd-45f9-937e-eb37429e77ad tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.151542 May 03 09:22:59.854776 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1129/2432] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:22:59 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:23:00.871866 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e67236d5-0b96-4bc4-84f2-b43b975ebd6e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:00.872448 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e67236d5-0b96-4bc4-84f2-b43b975ebd6e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:00.879104 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e67236d5-0b96-4bc4-84f2-b43b975ebd6e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:00.879553 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e67236d5-0b96-4bc4-84f2-b43b975ebd6e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:00.880354 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e67236d5-0b96-4bc4-84f2-b43b975ebd6e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:00.880786 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e67236d5-0b96-4bc4-84f2-b43b975ebd6e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:01.012420 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e67236d5-0b96-4bc4-84f2-b43b975ebd6e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:01.020863 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e67236d5-0b96-4bc4-84f2-b43b975ebd6e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.153070 May 03 09:23:01.021434 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1304/2433] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:00 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:23:02.038263 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-952b118e-86b5-4c9d-8203-20d74058d7a4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:02.039070 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-952b118e-86b5-4c9d-8203-20d74058d7a4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:02.045953 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-952b118e-86b5-4c9d-8203-20d74058d7a4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:02.046363 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-952b118e-86b5-4c9d-8203-20d74058d7a4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:02.047123 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-952b118e-86b5-4c9d-8203-20d74058d7a4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:02.047559 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-952b118e-86b5-4c9d-8203-20d74058d7a4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:02.189504 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-952b118e-86b5-4c9d-8203-20d74058d7a4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:02.197685 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-952b118e-86b5-4c9d-8203-20d74058d7a4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.163323 May 03 09:23:02.198312 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1130/2434] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:02 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:23:03.217600 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-77776276-695e-4b5f-8627-aa5e455a4926 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:03.218569 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-77776276-695e-4b5f-8627-aa5e455a4926 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:03.228553 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-77776276-695e-4b5f-8627-aa5e455a4926 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:03.229322 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-77776276-695e-4b5f-8627-aa5e455a4926 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:03.230698 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-77776276-695e-4b5f-8627-aa5e455a4926 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:03.231424 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-77776276-695e-4b5f-8627-aa5e455a4926 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:03.374758 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-77776276-695e-4b5f-8627-aa5e455a4926 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:03.384239 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-77776276-695e-4b5f-8627-aa5e455a4926 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.172381 May 03 09:23:03.384804 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1305/2435] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:03 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:23:04.401621 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d2efbc7c-2a93-4552-aea7-e9f1bb2af586 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:04.402886 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d2efbc7c-2a93-4552-aea7-e9f1bb2af586 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:04.409560 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d2efbc7c-2a93-4552-aea7-e9f1bb2af586 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:04.410015 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d2efbc7c-2a93-4552-aea7-e9f1bb2af586 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:04.410822 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d2efbc7c-2a93-4552-aea7-e9f1bb2af586 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:04.411386 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d2efbc7c-2a93-4552-aea7-e9f1bb2af586 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:04.553672 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d2efbc7c-2a93-4552-aea7-e9f1bb2af586 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:04.561566 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d2efbc7c-2a93-4552-aea7-e9f1bb2af586 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.163903 May 03 09:23:04.562194 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1131/2436] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:04 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:23:05.580053 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-8d90478f-740a-47e8-bc54-7cac850dc040 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:05.580752 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-8d90478f-740a-47e8-bc54-7cac850dc040 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:05.589148 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8d90478f-740a-47e8-bc54-7cac850dc040 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:05.589612 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8d90478f-740a-47e8-bc54-7cac850dc040 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:05.590609 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8d90478f-740a-47e8-bc54-7cac850dc040 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:05.591090 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8d90478f-740a-47e8-bc54-7cac850dc040 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:05.725970 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-8d90478f-740a-47e8-bc54-7cac850dc040 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:05.736838 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-8d90478f-740a-47e8-bc54-7cac850dc040 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.161735 May 03 09:23:05.737562 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1306/2437] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:05 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:23:06.758682 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-966ea529-9575-4d15-a757-2f4f56aa10ca tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:06.759305 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-966ea529-9575-4d15-a757-2f4f56aa10ca tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:06.766344 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-966ea529-9575-4d15-a757-2f4f56aa10ca tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:06.766795 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-966ea529-9575-4d15-a757-2f4f56aa10ca tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:06.767592 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-966ea529-9575-4d15-a757-2f4f56aa10ca tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:06.768084 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-966ea529-9575-4d15-a757-2f4f56aa10ca tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:06.904469 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-966ea529-9575-4d15-a757-2f4f56aa10ca tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:06.912509 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-966ea529-9575-4d15-a757-2f4f56aa10ca tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.158646 May 03 09:23:06.913075 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1132/2438] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:06 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:23:07.931489 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-1f2eb34a-049f-405a-a79d-d0d847a656e0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:07.932316 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-1f2eb34a-049f-405a-a79d-d0d847a656e0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:07.942914 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1f2eb34a-049f-405a-a79d-d0d847a656e0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:07.943368 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1f2eb34a-049f-405a-a79d-d0d847a656e0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:07.944174 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1f2eb34a-049f-405a-a79d-d0d847a656e0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:07.944605 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1f2eb34a-049f-405a-a79d-d0d847a656e0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:08.082772 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-1f2eb34a-049f-405a-a79d-d0d847a656e0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:08.091135 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-1f2eb34a-049f-405a-a79d-d0d847a656e0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.164393 May 03 09:23:08.091788 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1307/2439] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:07 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:23:09.110708 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ca58aff3-508c-4238-bdc0-ba5a066d2b6e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:09.111268 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ca58aff3-508c-4238-bdc0-ba5a066d2b6e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:09.118480 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ca58aff3-508c-4238-bdc0-ba5a066d2b6e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:09.118943 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ca58aff3-508c-4238-bdc0-ba5a066d2b6e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:09.119734 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ca58aff3-508c-4238-bdc0-ba5a066d2b6e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:09.120209 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ca58aff3-508c-4238-bdc0-ba5a066d2b6e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:09.256798 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ca58aff3-508c-4238-bdc0-ba5a066d2b6e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:09.267259 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ca58aff3-508c-4238-bdc0-ba5a066d2b6e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.160598 May 03 09:23:09.267884 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1133/2440] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:09 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:23:10.286896 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-580545e5-94f4-4135-bb1a-dc58ad953dbc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:10.287508 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-580545e5-94f4-4135-bb1a-dc58ad953dbc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:10.294304 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-580545e5-94f4-4135-bb1a-dc58ad953dbc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:10.294786 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-580545e5-94f4-4135-bb1a-dc58ad953dbc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:10.295561 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-580545e5-94f4-4135-bb1a-dc58ad953dbc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:10.296033 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-580545e5-94f4-4135-bb1a-dc58ad953dbc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:10.428510 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-580545e5-94f4-4135-bb1a-dc58ad953dbc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:10.436881 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-580545e5-94f4-4135-bb1a-dc58ad953dbc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.154089 May 03 09:23:10.437523 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1308/2441] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:10 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:23:11.455157 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d8f63be6-8d8e-4c17-8604-47363c5ad317 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:11.455853 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d8f63be6-8d8e-4c17-8604-47363c5ad317 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:11.463228 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d8f63be6-8d8e-4c17-8604-47363c5ad317 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:11.463617 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d8f63be6-8d8e-4c17-8604-47363c5ad317 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:11.464442 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d8f63be6-8d8e-4c17-8604-47363c5ad317 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:11.464879 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d8f63be6-8d8e-4c17-8604-47363c5ad317 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:11.603367 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d8f63be6-8d8e-4c17-8604-47363c5ad317 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:11.611905 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d8f63be6-8d8e-4c17-8604-47363c5ad317 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.161004 May 03 09:23:11.612483 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1134/2442] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:11 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:23:11.732039 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-2d9b2f76-1042-44c0-beeb-7c70df478edb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:11.732862 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-2d9b2f76-1042-44c0-beeb-7c70df478edb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: e3fc745c-a212-4dc7-8d76-601e0f70dbc7] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:11.739343 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2d9b2f76-1042-44c0-beeb-7c70df478edb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:11.739750 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2d9b2f76-1042-44c0-beeb-7c70df478edb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:11.740648 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2d9b2f76-1042-44c0-beeb-7c70df478edb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:11.741073 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2d9b2f76-1042-44c0-beeb-7c70df478edb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:11.765091 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-2d9b2f76-1042-44c0-beeb-7c70df478edb tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/e3fc745c-a212-4dc7-8d76-601e0f70dbc7/ips" status: 200 len: 145 microversion: 2.1 time: 0.037256 May 03 09:23:11.765659 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1309/2443] 10.222.0.11 () {58 vars in 1247 bytes} [Tue May 3 09:23:11 2022] GET /compute/v2.1/servers/e3fc745c-a212-4dc7-8d76-601e0f70dbc7/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 09:23:12.628838 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-8fba582b-82f5-46ff-a7e2-9b3734af14c1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:12.629419 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-8fba582b-82f5-46ff-a7e2-9b3734af14c1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:12.637251 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8fba582b-82f5-46ff-a7e2-9b3734af14c1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:12.637700 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8fba582b-82f5-46ff-a7e2-9b3734af14c1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:12.638463 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8fba582b-82f5-46ff-a7e2-9b3734af14c1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:12.638908 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8fba582b-82f5-46ff-a7e2-9b3734af14c1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:12.767906 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-8fba582b-82f5-46ff-a7e2-9b3734af14c1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:12.776397 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-8fba582b-82f5-46ff-a7e2-9b3734af14c1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.151644 May 03 09:23:12.777051 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1135/2444] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:12 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:23:13.793411 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-8eceb2fc-cc1b-41a0-afe5-b00f9ffd8665 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:13.794045 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-8eceb2fc-cc1b-41a0-afe5-b00f9ffd8665 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:13.801111 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8eceb2fc-cc1b-41a0-afe5-b00f9ffd8665 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:13.801553 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8eceb2fc-cc1b-41a0-afe5-b00f9ffd8665 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:13.802468 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8eceb2fc-cc1b-41a0-afe5-b00f9ffd8665 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:13.802940 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8eceb2fc-cc1b-41a0-afe5-b00f9ffd8665 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:13.933478 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-8eceb2fc-cc1b-41a0-afe5-b00f9ffd8665 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:13.941968 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-8eceb2fc-cc1b-41a0-afe5-b00f9ffd8665 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.152687 May 03 09:23:13.942536 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1310/2445] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:13 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:23:14.960634 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f5b5d034-3859-4049-b058-3e5959b247bb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:14.961264 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f5b5d034-3859-4049-b058-3e5959b247bb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:14.968026 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f5b5d034-3859-4049-b058-3e5959b247bb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:14.968479 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f5b5d034-3859-4049-b058-3e5959b247bb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:14.969246 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f5b5d034-3859-4049-b058-3e5959b247bb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:14.969681 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f5b5d034-3859-4049-b058-3e5959b247bb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:15.102487 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f5b5d034-3859-4049-b058-3e5959b247bb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:15.111367 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f5b5d034-3859-4049-b058-3e5959b247bb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.155146 May 03 09:23:15.111984 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1136/2446] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:14 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:23:16.130353 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-cf8a95aa-4779-4398-b4a1-40c700a7e5b5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:16.131127 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-cf8a95aa-4779-4398-b4a1-40c700a7e5b5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:16.138072 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cf8a95aa-4779-4398-b4a1-40c700a7e5b5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:16.138517 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cf8a95aa-4779-4398-b4a1-40c700a7e5b5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:16.139283 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cf8a95aa-4779-4398-b4a1-40c700a7e5b5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:16.139713 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cf8a95aa-4779-4398-b4a1-40c700a7e5b5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:16.272767 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-cf8a95aa-4779-4398-b4a1-40c700a7e5b5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:16.281564 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-cf8a95aa-4779-4398-b4a1-40c700a7e5b5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.155135 May 03 09:23:16.282158 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1311/2447] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:16 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:23:17.299182 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-75b120f4-ea50-4396-b3c1-8b9bae05c7a7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:17.299867 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-75b120f4-ea50-4396-b3c1-8b9bae05c7a7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:17.306870 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-75b120f4-ea50-4396-b3c1-8b9bae05c7a7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:17.307309 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-75b120f4-ea50-4396-b3c1-8b9bae05c7a7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:17.308122 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-75b120f4-ea50-4396-b3c1-8b9bae05c7a7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:17.308566 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-75b120f4-ea50-4396-b3c1-8b9bae05c7a7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:17.457769 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-75b120f4-ea50-4396-b3c1-8b9bae05c7a7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:17.466552 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-75b120f4-ea50-4396-b3c1-8b9bae05c7a7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.171693 May 03 09:23:17.467092 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1137/2448] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:17 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:23:18.486925 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-28f9c100-1300-4bff-96cf-d89e2089b2ca tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:18.488157 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-28f9c100-1300-4bff-96cf-d89e2089b2ca tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:18.494575 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-28f9c100-1300-4bff-96cf-d89e2089b2ca tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:18.495024 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-28f9c100-1300-4bff-96cf-d89e2089b2ca tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:18.495857 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-28f9c100-1300-4bff-96cf-d89e2089b2ca tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:18.496296 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-28f9c100-1300-4bff-96cf-d89e2089b2ca tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:18.629140 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-28f9c100-1300-4bff-96cf-d89e2089b2ca tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:18.637472 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-28f9c100-1300-4bff-96cf-d89e2089b2ca tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.154629 May 03 09:23:18.638030 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1312/2449] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:18 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:23:19.655100 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f41048cd-dc72-4f8f-89d2-4ce6083973f7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:19.655750 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f41048cd-dc72-4f8f-89d2-4ce6083973f7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:19.662753 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f41048cd-dc72-4f8f-89d2-4ce6083973f7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:19.663203 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f41048cd-dc72-4f8f-89d2-4ce6083973f7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:19.664027 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f41048cd-dc72-4f8f-89d2-4ce6083973f7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:19.664460 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f41048cd-dc72-4f8f-89d2-4ce6083973f7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:19.807046 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f41048cd-dc72-4f8f-89d2-4ce6083973f7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:19.815927 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f41048cd-dc72-4f8f-89d2-4ce6083973f7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.164676 May 03 09:23:19.816514 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1138/2450] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:19 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:23:20.833274 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-63b33ac1-4ee5-47e0-acad-83cae7e4cf0e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:20.834175 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-63b33ac1-4ee5-47e0-acad-83cae7e4cf0e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:20.841204 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-63b33ac1-4ee5-47e0-acad-83cae7e4cf0e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:20.841647 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-63b33ac1-4ee5-47e0-acad-83cae7e4cf0e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:20.842384 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-63b33ac1-4ee5-47e0-acad-83cae7e4cf0e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:20.842838 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-63b33ac1-4ee5-47e0-acad-83cae7e4cf0e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:20.976624 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-63b33ac1-4ee5-47e0-acad-83cae7e4cf0e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:20.984734 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-63b33ac1-4ee5-47e0-acad-83cae7e4cf0e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.155292 May 03 09:23:20.985310 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1313/2451] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:20 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:23:22.002783 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-76dadfc7-3903-4763-894b-e53aa0156b2a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:22.003395 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-76dadfc7-3903-4763-894b-e53aa0156b2a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:22.010447 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-76dadfc7-3903-4763-894b-e53aa0156b2a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:22.010898 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-76dadfc7-3903-4763-894b-e53aa0156b2a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:22.011700 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-76dadfc7-3903-4763-894b-e53aa0156b2a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:22.012173 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-76dadfc7-3903-4763-894b-e53aa0156b2a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:22.147382 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-76dadfc7-3903-4763-894b-e53aa0156b2a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:22.156443 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-76dadfc7-3903-4763-894b-e53aa0156b2a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.157573 May 03 09:23:22.157032 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1139/2452] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:21 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:23:23.174808 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-dd3e8182-2b8b-4066-834b-9f34fc1c2229 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:23.175431 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-dd3e8182-2b8b-4066-834b-9f34fc1c2229 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:23.182509 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dd3e8182-2b8b-4066-834b-9f34fc1c2229 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:23.182959 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dd3e8182-2b8b-4066-834b-9f34fc1c2229 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:23.183973 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dd3e8182-2b8b-4066-834b-9f34fc1c2229 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:23.184449 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dd3e8182-2b8b-4066-834b-9f34fc1c2229 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:23.324780 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-dd3e8182-2b8b-4066-834b-9f34fc1c2229 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:23.334019 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-dd3e8182-2b8b-4066-834b-9f34fc1c2229 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.162798 May 03 09:23:23.334603 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1314/2453] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:23 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:23:24.352145 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-38991a08-ecd5-45eb-a608-4b18277e243a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:24.352781 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-38991a08-ecd5-45eb-a608-4b18277e243a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:24.359804 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-38991a08-ecd5-45eb-a608-4b18277e243a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:24.360287 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-38991a08-ecd5-45eb-a608-4b18277e243a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:24.361083 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-38991a08-ecd5-45eb-a608-4b18277e243a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:24.361514 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-38991a08-ecd5-45eb-a608-4b18277e243a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:24.497431 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-38991a08-ecd5-45eb-a608-4b18277e243a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:24.505796 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-38991a08-ecd5-45eb-a608-4b18277e243a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.157751 May 03 09:23:24.506398 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1140/2454] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:24 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:23:25.528430 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9a6639bc-f3a2-442f-8eb7-39ae9c8b9fa6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:25.529007 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9a6639bc-f3a2-442f-8eb7-39ae9c8b9fa6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:25.535805 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9a6639bc-f3a2-442f-8eb7-39ae9c8b9fa6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:25.536283 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9a6639bc-f3a2-442f-8eb7-39ae9c8b9fa6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:25.537064 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9a6639bc-f3a2-442f-8eb7-39ae9c8b9fa6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:25.537596 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9a6639bc-f3a2-442f-8eb7-39ae9c8b9fa6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:25.673973 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9a6639bc-f3a2-442f-8eb7-39ae9c8b9fa6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:25.682596 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9a6639bc-f3a2-442f-8eb7-39ae9c8b9fa6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.158185 May 03 09:23:25.683182 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1315/2455] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:25 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:23:26.700646 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7f924b43-5566-4158-a89d-a0fd6834b3c2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:26.701277 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7f924b43-5566-4158-a89d-a0fd6834b3c2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:26.708696 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7f924b43-5566-4158-a89d-a0fd6834b3c2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:26.709154 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7f924b43-5566-4158-a89d-a0fd6834b3c2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:26.709973 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7f924b43-5566-4158-a89d-a0fd6834b3c2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:26.710415 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7f924b43-5566-4158-a89d-a0fd6834b3c2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:26.848808 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7f924b43-5566-4158-a89d-a0fd6834b3c2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:26.857086 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7f924b43-5566-4158-a89d-a0fd6834b3c2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.160973 May 03 09:23:26.857678 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1141/2456] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:26 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:23:27.193558 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 09:23:27.194191 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: Tue May 3 09:23:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 03 09:23:27.877019 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-cd8565de-bcad-41f6-b999-b45c3767304a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:27.877573 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-cd8565de-bcad-41f6-b999-b45c3767304a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:27.885628 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cd8565de-bcad-41f6-b999-b45c3767304a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:27.886099 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cd8565de-bcad-41f6-b999-b45c3767304a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:27.886878 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cd8565de-bcad-41f6-b999-b45c3767304a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:27.887318 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cd8565de-bcad-41f6-b999-b45c3767304a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:28.025616 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-cd8565de-bcad-41f6-b999-b45c3767304a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:28.036817 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-cd8565de-bcad-41f6-b999-b45c3767304a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.165341 May 03 09:23:28.037724 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1316/2457] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:27 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:23:29.056749 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-3a98f872-0bef-4402-8a01-72d05c885260 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:29.057353 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-3a98f872-0bef-4402-8a01-72d05c885260 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:29.064107 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3a98f872-0bef-4402-8a01-72d05c885260 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:29.064557 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3a98f872-0bef-4402-8a01-72d05c885260 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:29.065316 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3a98f872-0bef-4402-8a01-72d05c885260 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:29.065902 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3a98f872-0bef-4402-8a01-72d05c885260 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:29.206730 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-3a98f872-0bef-4402-8a01-72d05c885260 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:29.215557 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-3a98f872-0bef-4402-8a01-72d05c885260 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.162947 May 03 09:23:29.216177 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1142/2458] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:29 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:23:30.233286 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9ee729c5-33e9-401d-ae66-b2e4e82c17ac tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:30.233912 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9ee729c5-33e9-401d-ae66-b2e4e82c17ac tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:30.240978 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9ee729c5-33e9-401d-ae66-b2e4e82c17ac tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:30.241431 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9ee729c5-33e9-401d-ae66-b2e4e82c17ac tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:30.242209 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9ee729c5-33e9-401d-ae66-b2e4e82c17ac tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:30.242639 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9ee729c5-33e9-401d-ae66-b2e4e82c17ac tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:30.378431 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9ee729c5-33e9-401d-ae66-b2e4e82c17ac tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:30.387224 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9ee729c5-33e9-401d-ae66-b2e4e82c17ac tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.157893 May 03 09:23:30.387889 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1317/2459] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:30 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:23:31.404645 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6f31815b-591c-4384-8bdd-9c1d5a969a14 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:31.405308 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6f31815b-591c-4384-8bdd-9c1d5a969a14 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:31.412560 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6f31815b-591c-4384-8bdd-9c1d5a969a14 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:31.413013 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6f31815b-591c-4384-8bdd-9c1d5a969a14 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:31.413788 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6f31815b-591c-4384-8bdd-9c1d5a969a14 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:31.414311 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6f31815b-591c-4384-8bdd-9c1d5a969a14 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:31.556464 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6f31815b-591c-4384-8bdd-9c1d5a969a14 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:31.570110 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6f31815b-591c-4384-8bdd-9c1d5a969a14 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.169259 May 03 09:23:31.570843 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1143/2460] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:31 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:23:32.589174 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-579b6689-773f-4277-bfdf-4d81c417fd60 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:32.589776 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-579b6689-773f-4277-bfdf-4d81c417fd60 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:32.596841 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-579b6689-773f-4277-bfdf-4d81c417fd60 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:32.597295 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-579b6689-773f-4277-bfdf-4d81c417fd60 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:32.598092 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-579b6689-773f-4277-bfdf-4d81c417fd60 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:32.598523 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-579b6689-773f-4277-bfdf-4d81c417fd60 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:32.738222 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-579b6689-773f-4277-bfdf-4d81c417fd60 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:32.746283 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-579b6689-773f-4277-bfdf-4d81c417fd60 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.161397 May 03 09:23:32.746855 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1318/2461] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:32 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:23:33.765933 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d903a90a-2842-4f7c-8cd0-e1a181ba0a07 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:33.766906 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d903a90a-2842-4f7c-8cd0-e1a181ba0a07 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:33.778101 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d903a90a-2842-4f7c-8cd0-e1a181ba0a07 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:33.778905 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d903a90a-2842-4f7c-8cd0-e1a181ba0a07 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:33.780246 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d903a90a-2842-4f7c-8cd0-e1a181ba0a07 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:33.781020 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d903a90a-2842-4f7c-8cd0-e1a181ba0a07 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:33.915665 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d903a90a-2842-4f7c-8cd0-e1a181ba0a07 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:33.929639 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d903a90a-2842-4f7c-8cd0-e1a181ba0a07 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.169387 May 03 09:23:33.930625 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1144/2462] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:33 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:23:34.958306 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3b498a6c-5b30-47df-9bff-0f6fe7c6b776 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:34.959142 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-3b498a6c-5b30-47df-9bff-0f6fe7c6b776 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:34.968280 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3b498a6c-5b30-47df-9bff-0f6fe7c6b776 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:34.968768 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3b498a6c-5b30-47df-9bff-0f6fe7c6b776 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:34.969984 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3b498a6c-5b30-47df-9bff-0f6fe7c6b776 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:34.970429 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3b498a6c-5b30-47df-9bff-0f6fe7c6b776 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:35.115682 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-3b498a6c-5b30-47df-9bff-0f6fe7c6b776 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:35.124512 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-3b498a6c-5b30-47df-9bff-0f6fe7c6b776 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.172798 May 03 09:23:35.125108 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1319/2463] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:34 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:23:36.142454 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-cab5f152-3084-4153-8ec5-35abf933133c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:36.143116 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-cab5f152-3084-4153-8ec5-35abf933133c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:36.150147 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cab5f152-3084-4153-8ec5-35abf933133c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:36.150621 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cab5f152-3084-4153-8ec5-35abf933133c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:36.151403 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cab5f152-3084-4153-8ec5-35abf933133c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:36.151885 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cab5f152-3084-4153-8ec5-35abf933133c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:36.286788 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-cab5f152-3084-4153-8ec5-35abf933133c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:36.295728 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-cab5f152-3084-4153-8ec5-35abf933133c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.157340 May 03 09:23:36.296411 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1145/2464] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:36 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:23:37.313523 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-6eec87d2-6ff0-4793-a15f-e80a227507ec tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:37.314122 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-6eec87d2-6ff0-4793-a15f-e80a227507ec tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:37.320882 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6eec87d2-6ff0-4793-a15f-e80a227507ec tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:37.321325 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6eec87d2-6ff0-4793-a15f-e80a227507ec tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:37.322084 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6eec87d2-6ff0-4793-a15f-e80a227507ec tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:37.322509 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6eec87d2-6ff0-4793-a15f-e80a227507ec tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:37.460064 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-6eec87d2-6ff0-4793-a15f-e80a227507ec tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:37.468081 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-6eec87d2-6ff0-4793-a15f-e80a227507ec tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.158359 May 03 09:23:37.468546 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1320/2465] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:37 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:23:38.488168 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b909bc7d-1a25-4d93-bef0-9a314bd63b57 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:38.488995 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b909bc7d-1a25-4d93-bef0-9a314bd63b57 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:38.498138 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b909bc7d-1a25-4d93-bef0-9a314bd63b57 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:38.498598 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b909bc7d-1a25-4d93-bef0-9a314bd63b57 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:38.499386 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b909bc7d-1a25-4d93-bef0-9a314bd63b57 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:38.499863 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b909bc7d-1a25-4d93-bef0-9a314bd63b57 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:38.630507 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b909bc7d-1a25-4d93-bef0-9a314bd63b57 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:38.643236 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b909bc7d-1a25-4d93-bef0-9a314bd63b57 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.160864 May 03 09:23:38.644081 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1146/2466] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:38 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:23:39.662823 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-baee49b0-2e70-4bfc-b253-9bd402892b02 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:39.663434 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-baee49b0-2e70-4bfc-b253-9bd402892b02 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:39.672479 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-baee49b0-2e70-4bfc-b253-9bd402892b02 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:39.672944 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-baee49b0-2e70-4bfc-b253-9bd402892b02 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:39.673781 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-baee49b0-2e70-4bfc-b253-9bd402892b02 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:39.681625 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-baee49b0-2e70-4bfc-b253-9bd402892b02 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:39.814524 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-baee49b0-2e70-4bfc-b253-9bd402892b02 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:39.823690 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-baee49b0-2e70-4bfc-b253-9bd402892b02 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.164758 May 03 09:23:39.824311 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1321/2467] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:39 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:23:40.842978 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f2333944-ce83-424d-98e0-34434656fdba tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:40.843576 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f2333944-ce83-424d-98e0-34434656fdba tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:40.851041 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f2333944-ce83-424d-98e0-34434656fdba tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:40.851494 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f2333944-ce83-424d-98e0-34434656fdba tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:40.852322 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f2333944-ce83-424d-98e0-34434656fdba tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:40.852761 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f2333944-ce83-424d-98e0-34434656fdba tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:40.985888 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f2333944-ce83-424d-98e0-34434656fdba tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:40.995809 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f2333944-ce83-424d-98e0-34434656fdba tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.157060 May 03 09:23:40.996387 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1147/2468] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:40 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:23:42.013853 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9b69aa3e-7dc5-4adc-a94f-f71724fba26c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:42.014988 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9b69aa3e-7dc5-4adc-a94f-f71724fba26c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:42.023625 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9b69aa3e-7dc5-4adc-a94f-f71724fba26c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:42.024109 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9b69aa3e-7dc5-4adc-a94f-f71724fba26c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:42.024885 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9b69aa3e-7dc5-4adc-a94f-f71724fba26c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:42.025312 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9b69aa3e-7dc5-4adc-a94f-f71724fba26c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:42.177054 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9b69aa3e-7dc5-4adc-a94f-f71724fba26c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:42.187219 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9b69aa3e-7dc5-4adc-a94f-f71724fba26c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.177762 May 03 09:23:42.187812 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1322/2469] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:42 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:23:43.207374 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-96f42360-e4c9-4276-a187-3bdeae47a912 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:43.208611 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-96f42360-e4c9-4276-a187-3bdeae47a912 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:43.215114 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-96f42360-e4c9-4276-a187-3bdeae47a912 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:43.215559 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-96f42360-e4c9-4276-a187-3bdeae47a912 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:43.216412 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-96f42360-e4c9-4276-a187-3bdeae47a912 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:43.216839 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-96f42360-e4c9-4276-a187-3bdeae47a912 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:43.367787 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-96f42360-e4c9-4276-a187-3bdeae47a912 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:43.376483 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-96f42360-e4c9-4276-a187-3bdeae47a912 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.172986 May 03 09:23:43.377059 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1148/2470] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:43 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:23:44.394252 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5f87532b-e057-4b4a-baf3-d5d76a867c8d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:44.394874 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5f87532b-e057-4b4a-baf3-d5d76a867c8d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:44.401707 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5f87532b-e057-4b4a-baf3-d5d76a867c8d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:44.402156 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5f87532b-e057-4b4a-baf3-d5d76a867c8d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:44.402919 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5f87532b-e057-4b4a-baf3-d5d76a867c8d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:44.403356 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5f87532b-e057-4b4a-baf3-d5d76a867c8d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:44.537748 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5f87532b-e057-4b4a-baf3-d5d76a867c8d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:44.546211 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5f87532b-e057-4b4a-baf3-d5d76a867c8d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.155880 May 03 09:23:44.546793 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1323/2471] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:44 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:23:45.564036 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ddbf367a-aefc-4bfa-98e7-358e67f11ae1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:45.564615 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ddbf367a-aefc-4bfa-98e7-358e67f11ae1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:45.571621 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ddbf367a-aefc-4bfa-98e7-358e67f11ae1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:45.572088 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ddbf367a-aefc-4bfa-98e7-358e67f11ae1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:45.572987 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ddbf367a-aefc-4bfa-98e7-358e67f11ae1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:45.573422 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ddbf367a-aefc-4bfa-98e7-358e67f11ae1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:45.716683 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ddbf367a-aefc-4bfa-98e7-358e67f11ae1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:45.725681 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ddbf367a-aefc-4bfa-98e7-358e67f11ae1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.165727 May 03 09:23:45.726503 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1149/2472] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:45 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:23:46.745769 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-2015ecd1-af2a-45a4-8c22-582f6c3969c0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:46.746404 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-2015ecd1-af2a-45a4-8c22-582f6c3969c0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:46.753544 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2015ecd1-af2a-45a4-8c22-582f6c3969c0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:46.754004 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2015ecd1-af2a-45a4-8c22-582f6c3969c0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:46.754762 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2015ecd1-af2a-45a4-8c22-582f6c3969c0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:46.755189 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2015ecd1-af2a-45a4-8c22-582f6c3969c0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:46.885403 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-2015ecd1-af2a-45a4-8c22-582f6c3969c0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:46.893897 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-2015ecd1-af2a-45a4-8c22-582f6c3969c0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.152000 May 03 09:23:46.894480 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1324/2473] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:46 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:23:47.917530 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d6a327e3-abf3-4c3a-afa7-3cf07b78c461 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:47.918451 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d6a327e3-abf3-4c3a-afa7-3cf07b78c461 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:47.926763 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d6a327e3-abf3-4c3a-afa7-3cf07b78c461 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:47.927218 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d6a327e3-abf3-4c3a-afa7-3cf07b78c461 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:47.928036 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d6a327e3-abf3-4c3a-afa7-3cf07b78c461 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:47.928502 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d6a327e3-abf3-4c3a-afa7-3cf07b78c461 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:48.065661 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d6a327e3-abf3-4c3a-afa7-3cf07b78c461 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:48.077358 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d6a327e3-abf3-4c3a-afa7-3cf07b78c461 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.165673 May 03 09:23:48.077999 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1150/2474] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:47 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:23:49.096776 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-51b374b6-5c59-4b8e-a683-1163cf46889d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:49.097346 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-51b374b6-5c59-4b8e-a683-1163cf46889d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:49.106850 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-51b374b6-5c59-4b8e-a683-1163cf46889d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:49.107314 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-51b374b6-5c59-4b8e-a683-1163cf46889d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:49.109536 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-51b374b6-5c59-4b8e-a683-1163cf46889d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:49.109985 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-51b374b6-5c59-4b8e-a683-1163cf46889d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:49.252502 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-51b374b6-5c59-4b8e-a683-1163cf46889d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:49.262379 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-51b374b6-5c59-4b8e-a683-1163cf46889d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.169590 May 03 09:23:49.263248 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1325/2475] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:49 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:23:50.281479 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-327d3c9a-6253-4d53-acf4-c92a25185748 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:50.282090 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-327d3c9a-6253-4d53-acf4-c92a25185748 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:50.288849 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-327d3c9a-6253-4d53-acf4-c92a25185748 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:50.289303 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-327d3c9a-6253-4d53-acf4-c92a25185748 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:50.290067 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-327d3c9a-6253-4d53-acf4-c92a25185748 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:50.290504 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-327d3c9a-6253-4d53-acf4-c92a25185748 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:50.418539 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-327d3c9a-6253-4d53-acf4-c92a25185748 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:50.426585 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-327d3c9a-6253-4d53-acf4-c92a25185748 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.149052 May 03 09:23:50.427152 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1151/2476] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:50 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:23:51.448162 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f5c2b458-617f-4d41-ae0d-0758cf5b4c91 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:51.449137 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f5c2b458-617f-4d41-ae0d-0758cf5b4c91 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:51.460312 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f5c2b458-617f-4d41-ae0d-0758cf5b4c91 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:51.461060 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f5c2b458-617f-4d41-ae0d-0758cf5b4c91 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:51.462422 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f5c2b458-617f-4d41-ae0d-0758cf5b4c91 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:51.463045 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f5c2b458-617f-4d41-ae0d-0758cf5b4c91 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:51.600413 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f5c2b458-617f-4d41-ae0d-0758cf5b4c91 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:51.608938 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f5c2b458-617f-4d41-ae0d-0758cf5b4c91 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.167325 May 03 09:23:51.609563 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1326/2477] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:51 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:23:52.630410 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-1b26650d-2321-4c3e-bbde-3c6fdc2d8b04 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:52.631223 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-1b26650d-2321-4c3e-bbde-3c6fdc2d8b04 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:52.640289 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1b26650d-2321-4c3e-bbde-3c6fdc2d8b04 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:52.640815 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1b26650d-2321-4c3e-bbde-3c6fdc2d8b04 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:52.642077 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1b26650d-2321-4c3e-bbde-3c6fdc2d8b04 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:52.642785 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1b26650d-2321-4c3e-bbde-3c6fdc2d8b04 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:52.786061 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-1b26650d-2321-4c3e-bbde-3c6fdc2d8b04 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:52.794357 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-1b26650d-2321-4c3e-bbde-3c6fdc2d8b04 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.170267 May 03 09:23:52.794934 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1152/2478] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:52 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:23:53.812320 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ac1b29fc-06d0-4e38-a502-e8ccd23c8f15 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:53.813013 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ac1b29fc-06d0-4e38-a502-e8ccd23c8f15 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:53.819787 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ac1b29fc-06d0-4e38-a502-e8ccd23c8f15 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:53.820245 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ac1b29fc-06d0-4e38-a502-e8ccd23c8f15 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:53.821032 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ac1b29fc-06d0-4e38-a502-e8ccd23c8f15 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:53.821457 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ac1b29fc-06d0-4e38-a502-e8ccd23c8f15 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:53.957232 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ac1b29fc-06d0-4e38-a502-e8ccd23c8f15 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:53.965890 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ac1b29fc-06d0-4e38-a502-e8ccd23c8f15 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.157798 May 03 09:23:53.966478 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1327/2479] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:53 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:23:54.984120 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-dbd3cbbb-f640-4b9e-8eb2-84073ac7110f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:54.984768 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-dbd3cbbb-f640-4b9e-8eb2-84073ac7110f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:54.993226 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dbd3cbbb-f640-4b9e-8eb2-84073ac7110f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:54.994160 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dbd3cbbb-f640-4b9e-8eb2-84073ac7110f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:54.996391 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dbd3cbbb-f640-4b9e-8eb2-84073ac7110f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:54.997220 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dbd3cbbb-f640-4b9e-8eb2-84073ac7110f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:55.144070 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-dbd3cbbb-f640-4b9e-8eb2-84073ac7110f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:55.152658 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-dbd3cbbb-f640-4b9e-8eb2-84073ac7110f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.172699 May 03 09:23:55.153248 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1153/2480] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:54 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:23:56.171678 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9e74bc54-abb4-4ae5-9d64-991d440a2a48 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:56.172349 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9e74bc54-abb4-4ae5-9d64-991d440a2a48 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:56.179167 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9e74bc54-abb4-4ae5-9d64-991d440a2a48 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:56.179621 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9e74bc54-abb4-4ae5-9d64-991d440a2a48 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:56.180428 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9e74bc54-abb4-4ae5-9d64-991d440a2a48 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:56.180870 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9e74bc54-abb4-4ae5-9d64-991d440a2a48 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:56.314646 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9e74bc54-abb4-4ae5-9d64-991d440a2a48 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:56.322697 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9e74bc54-abb4-4ae5-9d64-991d440a2a48 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.156713 May 03 09:23:56.323360 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1328/2481] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:56 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:23:57.340309 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7105b2dc-53a2-4a1b-8bde-54bb7e66f09e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:57.340940 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7105b2dc-53a2-4a1b-8bde-54bb7e66f09e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:57.347708 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7105b2dc-53a2-4a1b-8bde-54bb7e66f09e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:57.348189 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7105b2dc-53a2-4a1b-8bde-54bb7e66f09e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:57.348962 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7105b2dc-53a2-4a1b-8bde-54bb7e66f09e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:57.349388 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7105b2dc-53a2-4a1b-8bde-54bb7e66f09e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:57.485661 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7105b2dc-53a2-4a1b-8bde-54bb7e66f09e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:57.493990 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7105b2dc-53a2-4a1b-8bde-54bb7e66f09e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.157602 May 03 09:23:57.494576 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1154/2482] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:57 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:23:58.511000 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9d0b63dc-8993-4938-b74c-b370ef0e85c4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:58.511567 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9d0b63dc-8993-4938-b74c-b370ef0e85c4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:58.518594 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9d0b63dc-8993-4938-b74c-b370ef0e85c4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:58.519045 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9d0b63dc-8993-4938-b74c-b370ef0e85c4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:58.519835 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9d0b63dc-8993-4938-b74c-b370ef0e85c4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:58.520280 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9d0b63dc-8993-4938-b74c-b370ef0e85c4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:58.652826 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9d0b63dc-8993-4938-b74c-b370ef0e85c4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:58.661497 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9d0b63dc-8993-4938-b74c-b370ef0e85c4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.154529 May 03 09:23:58.662089 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1329/2483] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:58 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:23:59.683256 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-25572093-c1fc-4c6e-9915-381da80ee5a1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:23:59.683910 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-25572093-c1fc-4c6e-9915-381da80ee5a1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:23:59.691215 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-25572093-c1fc-4c6e-9915-381da80ee5a1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:59.691670 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-25572093-c1fc-4c6e-9915-381da80ee5a1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:59.692508 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-25572093-c1fc-4c6e-9915-381da80ee5a1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:23:59.692915 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-25572093-c1fc-4c6e-9915-381da80ee5a1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:23:59.830556 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-25572093-c1fc-4c6e-9915-381da80ee5a1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:23:59.841127 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-25572093-c1fc-4c6e-9915-381da80ee5a1 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.164787 May 03 09:23:59.841707 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1155/2484] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:23:59 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:00.858768 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-eb451b82-1415-4d68-b7ff-81874fcb19fc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:00.859361 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-eb451b82-1415-4d68-b7ff-81874fcb19fc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:00.866135 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-eb451b82-1415-4d68-b7ff-81874fcb19fc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:00.866591 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-eb451b82-1415-4d68-b7ff-81874fcb19fc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:00.867376 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-eb451b82-1415-4d68-b7ff-81874fcb19fc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:00.867843 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-eb451b82-1415-4d68-b7ff-81874fcb19fc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:00.997737 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-eb451b82-1415-4d68-b7ff-81874fcb19fc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:01.006179 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-eb451b82-1415-4d68-b7ff-81874fcb19fc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.151329 May 03 09:24:01.006991 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1330/2485] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:00 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:02.024021 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-19ca1f65-c51e-40e7-8ac4-e3190c34ca80 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:02.024657 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-19ca1f65-c51e-40e7-8ac4-e3190c34ca80 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:02.031464 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-19ca1f65-c51e-40e7-8ac4-e3190c34ca80 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:02.031949 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-19ca1f65-c51e-40e7-8ac4-e3190c34ca80 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:02.032713 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-19ca1f65-c51e-40e7-8ac4-e3190c34ca80 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:02.033137 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-19ca1f65-c51e-40e7-8ac4-e3190c34ca80 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:02.178549 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-19ca1f65-c51e-40e7-8ac4-e3190c34ca80 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:02.190805 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-19ca1f65-c51e-40e7-8ac4-e3190c34ca80 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.170699 May 03 09:24:02.191540 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1156/2486] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:02 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:03.209523 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a1d08fa4-76c9-4560-b1dc-5a6a035bfd7e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:03.210116 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a1d08fa4-76c9-4560-b1dc-5a6a035bfd7e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:03.218003 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a1d08fa4-76c9-4560-b1dc-5a6a035bfd7e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:03.218451 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a1d08fa4-76c9-4560-b1dc-5a6a035bfd7e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:03.219219 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a1d08fa4-76c9-4560-b1dc-5a6a035bfd7e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:03.219646 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a1d08fa4-76c9-4560-b1dc-5a6a035bfd7e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:03.355107 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a1d08fa4-76c9-4560-b1dc-5a6a035bfd7e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:03.364519 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a1d08fa4-76c9-4560-b1dc-5a6a035bfd7e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.159160 May 03 09:24:03.365120 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1331/2487] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:03 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:04.383843 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ebaa29e7-18a7-4b42-9020-4344812ed72c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:04.384450 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ebaa29e7-18a7-4b42-9020-4344812ed72c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:04.391550 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ebaa29e7-18a7-4b42-9020-4344812ed72c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:04.392026 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ebaa29e7-18a7-4b42-9020-4344812ed72c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:04.392800 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ebaa29e7-18a7-4b42-9020-4344812ed72c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:04.393235 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ebaa29e7-18a7-4b42-9020-4344812ed72c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:04.530781 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ebaa29e7-18a7-4b42-9020-4344812ed72c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:04.539095 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ebaa29e7-18a7-4b42-9020-4344812ed72c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.160375 May 03 09:24:04.539676 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1157/2488] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:04 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:05.559504 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-6836d4ef-7238-4e25-975a-ad40a1dddbe5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:05.560472 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-6836d4ef-7238-4e25-975a-ad40a1dddbe5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:05.567497 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6836d4ef-7238-4e25-975a-ad40a1dddbe5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:05.567988 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6836d4ef-7238-4e25-975a-ad40a1dddbe5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:05.568776 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6836d4ef-7238-4e25-975a-ad40a1dddbe5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:05.569215 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6836d4ef-7238-4e25-975a-ad40a1dddbe5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:05.704484 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-6836d4ef-7238-4e25-975a-ad40a1dddbe5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:05.713231 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-6836d4ef-7238-4e25-975a-ad40a1dddbe5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.160291 May 03 09:24:05.713848 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1332/2489] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:05 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:06.730612 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-da56bfcd-3fbf-4ea2-ab27-43cb68ca7240 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:06.731275 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-da56bfcd-3fbf-4ea2-ab27-43cb68ca7240 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:06.742638 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-da56bfcd-3fbf-4ea2-ab27-43cb68ca7240 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:06.743436 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-da56bfcd-3fbf-4ea2-ab27-43cb68ca7240 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:06.744902 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-da56bfcd-3fbf-4ea2-ab27-43cb68ca7240 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:06.745676 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-da56bfcd-3fbf-4ea2-ab27-43cb68ca7240 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:06.882367 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-da56bfcd-3fbf-4ea2-ab27-43cb68ca7240 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:06.894676 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-da56bfcd-3fbf-4ea2-ab27-43cb68ca7240 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.167726 May 03 09:24:06.895548 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1158/2490] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:06 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:07.919194 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e70015dd-4ed9-4bcc-8911-2c413ff105ff tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:07.920134 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e70015dd-4ed9-4bcc-8911-2c413ff105ff tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:07.930045 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e70015dd-4ed9-4bcc-8911-2c413ff105ff tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:07.930485 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e70015dd-4ed9-4bcc-8911-2c413ff105ff tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:07.931537 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e70015dd-4ed9-4bcc-8911-2c413ff105ff tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:07.932285 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e70015dd-4ed9-4bcc-8911-2c413ff105ff tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:08.070365 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e70015dd-4ed9-4bcc-8911-2c413ff105ff tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:08.080145 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e70015dd-4ed9-4bcc-8911-2c413ff105ff tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.167265 May 03 09:24:08.080735 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1333/2491] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:07 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:09.098109 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0b586534-fc40-4a57-a65e-33c47cc5832c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:09.098678 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0b586534-fc40-4a57-a65e-33c47cc5832c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:09.105538 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0b586534-fc40-4a57-a65e-33c47cc5832c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:09.105984 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0b586534-fc40-4a57-a65e-33c47cc5832c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:09.106760 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0b586534-fc40-4a57-a65e-33c47cc5832c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:09.107159 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0b586534-fc40-4a57-a65e-33c47cc5832c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:09.243432 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0b586534-fc40-4a57-a65e-33c47cc5832c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:09.252056 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0b586534-fc40-4a57-a65e-33c47cc5832c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.157914 May 03 09:24:09.252645 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1159/2492] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:09 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:10.269405 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-1c686784-1e0e-4eff-95bb-410329353095 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:10.270026 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-1c686784-1e0e-4eff-95bb-410329353095 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:10.276862 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1c686784-1e0e-4eff-95bb-410329353095 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:10.277309 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1c686784-1e0e-4eff-95bb-410329353095 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:10.278469 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1c686784-1e0e-4eff-95bb-410329353095 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:10.279187 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1c686784-1e0e-4eff-95bb-410329353095 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:10.432996 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-1c686784-1e0e-4eff-95bb-410329353095 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:10.441538 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-1c686784-1e0e-4eff-95bb-410329353095 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.176006 May 03 09:24:10.442127 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1334/2493] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:10 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:11.459261 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-71f9aa03-dbb8-4419-8548-5cb0562278dd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:11.460028 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-71f9aa03-dbb8-4419-8548-5cb0562278dd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:11.469940 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-71f9aa03-dbb8-4419-8548-5cb0562278dd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:11.470606 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-71f9aa03-dbb8-4419-8548-5cb0562278dd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:11.471381 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-71f9aa03-dbb8-4419-8548-5cb0562278dd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:11.471823 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-71f9aa03-dbb8-4419-8548-5cb0562278dd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:11.614566 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-71f9aa03-dbb8-4419-8548-5cb0562278dd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:11.622478 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-71f9aa03-dbb8-4419-8548-5cb0562278dd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.167474 May 03 09:24:11.623197 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1160/2494] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:11 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:11.838587 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-317375a1-99ed-41cf-a4e0-3ecdcc55b0a5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:11.839150 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-317375a1-99ed-41cf-a4e0-3ecdcc55b0a5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: e3fc745c-a212-4dc7-8d76-601e0f70dbc7] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:11.847246 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-317375a1-99ed-41cf-a4e0-3ecdcc55b0a5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:11.848159 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-317375a1-99ed-41cf-a4e0-3ecdcc55b0a5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:11.849575 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-317375a1-99ed-41cf-a4e0-3ecdcc55b0a5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:11.850349 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-317375a1-99ed-41cf-a4e0-3ecdcc55b0a5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:11.877083 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-317375a1-99ed-41cf-a4e0-3ecdcc55b0a5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: e3fc745c-a212-4dc7-8d76-601e0f70dbc7] Going to try to terminate instance {{(pid=123391) delete /opt/stack/nova/nova/compute/api.py:2664}} May 03 09:24:11.960790 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-317375a1-99ed-41cf-a4e0-3ecdcc55b0a5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "DELETE /compute/v2.1/servers/e3fc745c-a212-4dc7-8d76-601e0f70dbc7" status: 204 len: 0 microversion: 2.1 time: 0.125933 May 03 09:24:11.961394 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1335/2495] 10.222.0.11 () {58 vars in 1238 bytes} [Tue May 3 09:24:11 2022] DELETE /compute/v2.1/servers/e3fc745c-a212-4dc7-8d76-601e0f70dbc7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 03 09:24:11.969759 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7301f434-d405-491b-8b58-116ddb612a7d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:11.970365 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7301f434-d405-491b-8b58-116ddb612a7d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: e3fc745c-a212-4dc7-8d76-601e0f70dbc7] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:11.976485 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7301f434-d405-491b-8b58-116ddb612a7d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:11.976931 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7301f434-d405-491b-8b58-116ddb612a7d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:11.977688 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7301f434-d405-491b-8b58-116ddb612a7d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:11.978115 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7301f434-d405-491b-8b58-116ddb612a7d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:12.119129 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7301f434-d405-491b-8b58-116ddb612a7d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:12.126688 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7301f434-d405-491b-8b58-116ddb612a7d tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/e3fc745c-a212-4dc7-8d76-601e0f70dbc7" status: 200 len: 1674 microversion: 2.1 time: 0.160929 May 03 09:24:12.127253 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1161/2496] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:11 2022] GET /compute/v2.1/servers/e3fc745c-a212-4dc7-8d76-601e0f70dbc7 => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:12.640631 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-2cd9eaa5-6fc0-437d-bcdc-9060e14b37cd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:12.641342 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-2cd9eaa5-6fc0-437d-bcdc-9060e14b37cd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:12.647925 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2cd9eaa5-6fc0-437d-bcdc-9060e14b37cd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:12.648370 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2cd9eaa5-6fc0-437d-bcdc-9060e14b37cd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:12.649141 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2cd9eaa5-6fc0-437d-bcdc-9060e14b37cd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:12.649579 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2cd9eaa5-6fc0-437d-bcdc-9060e14b37cd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:12.791303 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-2cd9eaa5-6fc0-437d-bcdc-9060e14b37cd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:12.799661 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-2cd9eaa5-6fc0-437d-bcdc-9060e14b37cd tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.163502 May 03 09:24:12.800268 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1336/2497] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:12 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:13.143912 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-df9e1015-ea13-4074-a60e-48db0a711fcc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:13.144583 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-df9e1015-ea13-4074-a60e-48db0a711fcc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: e3fc745c-a212-4dc7-8d76-601e0f70dbc7] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:13.151543 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-df9e1015-ea13-4074-a60e-48db0a711fcc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:13.152016 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-df9e1015-ea13-4074-a60e-48db0a711fcc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:13.152790 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-df9e1015-ea13-4074-a60e-48db0a711fcc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:13.153215 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-df9e1015-ea13-4074-a60e-48db0a711fcc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:13.285896 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-df9e1015-ea13-4074-a60e-48db0a711fcc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:13.293685 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-df9e1015-ea13-4074-a60e-48db0a711fcc tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/e3fc745c-a212-4dc7-8d76-601e0f70dbc7" status: 200 len: 1674 microversion: 2.1 time: 0.153634 May 03 09:24:13.295167 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1162/2498] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:13 2022] GET /compute/v2.1/servers/e3fc745c-a212-4dc7-8d76-601e0f70dbc7 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:13.817295 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-75125146-5bf9-4b8f-ab7f-60a7a327ac0b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:13.818056 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-75125146-5bf9-4b8f-ab7f-60a7a327ac0b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:13.825095 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-75125146-5bf9-4b8f-ab7f-60a7a327ac0b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:13.825752 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-75125146-5bf9-4b8f-ab7f-60a7a327ac0b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:13.826817 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-75125146-5bf9-4b8f-ab7f-60a7a327ac0b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:13.827392 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-75125146-5bf9-4b8f-ab7f-60a7a327ac0b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:13.973636 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-75125146-5bf9-4b8f-ab7f-60a7a327ac0b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:13.981925 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-75125146-5bf9-4b8f-ab7f-60a7a327ac0b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.168577 May 03 09:24:13.982822 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1337/2499] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:13 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:14.230383 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-6178f068-7523-4473-b9cb-4f2c54b093ac req-3f7ca2bc-54ad-42f9-8815-b3c1bee852dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3fc745c-a212-4dc7-8d76-601e0f70dbc7", "name": "network-vif-deleted", "tag": "a394154c-d998-421c-9a73-8c82f7b46a7a"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:24:14.239426 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-6178f068-7523-4473-b9cb-4f2c54b093ac req-3f7ca2bc-54ad-42f9-8815-b3c1bee852dc service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:14.240187 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-6178f068-7523-4473-b9cb-4f2c54b093ac req-3f7ca2bc-54ad-42f9-8815-b3c1bee852dc service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:14.261144 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-6178f068-7523-4473-b9cb-4f2c54b093ac req-3f7ca2bc-54ad-42f9-8815-b3c1bee852dc service nova] Creating event network-vif-deleted:a394154c-d998-421c-9a73-8c82f7b46a7a for instance e3fc745c-a212-4dc7-8d76-601e0f70dbc7 on hv-cinder-84027 May 03 09:24:14.266924 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-6178f068-7523-4473-b9cb-4f2c54b093ac req-3f7ca2bc-54ad-42f9-8815-b3c1bee852dc service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099087 May 03 09:24:14.267539 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1163/2500] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:24:14.310869 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-664119de-1393-4bd1-a1ca-883efcb8b0ac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:14.311495 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-664119de-1393-4bd1-a1ca-883efcb8b0ac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: e3fc745c-a212-4dc7-8d76-601e0f70dbc7] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:14.318094 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-664119de-1393-4bd1-a1ca-883efcb8b0ac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:14.318550 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-664119de-1393-4bd1-a1ca-883efcb8b0ac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:14.319344 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-664119de-1393-4bd1-a1ca-883efcb8b0ac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:14.319799 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-664119de-1393-4bd1-a1ca-883efcb8b0ac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:14.355708 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-664119de-1393-4bd1-a1ca-883efcb8b0ac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:14.356192 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-664119de-1393-4bd1-a1ca-883efcb8b0ac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:14.356659 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.objects.instance [None req-664119de-1393-4bd1-a1ca-883efcb8b0ac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lazy-loading 'fault' on Instance uuid e3fc745c-a212-4dc7-8d76-601e0f70dbc7 {{(pid=123391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 03 09:24:14.402910 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-664119de-1393-4bd1-a1ca-883efcb8b0ac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:14.411881 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-664119de-1393-4bd1-a1ca-883efcb8b0ac tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/e3fc745c-a212-4dc7-8d76-601e0f70dbc7" status: 200 len: 1328 microversion: 2.1 time: 0.104991 May 03 09:24:14.412510 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1338/2501] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:14 2022] GET /compute/v2.1/servers/e3fc745c-a212-4dc7-8d76-601e0f70dbc7 => generated 1328 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:15.000290 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-28f4d992-0c4d-43d8-818a-31ebe890359e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:15.001001 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-28f4d992-0c4d-43d8-818a-31ebe890359e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:15.007510 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-28f4d992-0c4d-43d8-818a-31ebe890359e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:15.007995 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-28f4d992-0c4d-43d8-818a-31ebe890359e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:15.008781 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-28f4d992-0c4d-43d8-818a-31ebe890359e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:15.009218 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-28f4d992-0c4d-43d8-818a-31ebe890359e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:15.144901 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-28f4d992-0c4d-43d8-818a-31ebe890359e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:15.153344 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-28f4d992-0c4d-43d8-818a-31ebe890359e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.157468 May 03 09:24:15.157012 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1164/2502] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:14 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:15.433345 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d83bea03-c1f9-4fb9-a2ba-fceb6f931dc5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:15.434294 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d83bea03-c1f9-4fb9-a2ba-fceb6f931dc5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: e3fc745c-a212-4dc7-8d76-601e0f70dbc7] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:15.441840 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d83bea03-c1f9-4fb9-a2ba-fceb6f931dc5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:15.442286 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d83bea03-c1f9-4fb9-a2ba-fceb6f931dc5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:15.443066 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d83bea03-c1f9-4fb9-a2ba-fceb6f931dc5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:15.443502 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d83bea03-c1f9-4fb9-a2ba-fceb6f931dc5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:15.457597 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.wsgi [None req-d83bea03-c1f9-4fb9-a2ba-fceb6f931dc5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] HTTP exception thrown: Instance e3fc745c-a212-4dc7-8d76-601e0f70dbc7 could not be found. May 03 09:24:15.458195 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d83bea03-c1f9-4fb9-a2ba-fceb6f931dc5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Returning 404 to user: Instance e3fc745c-a212-4dc7-8d76-601e0f70dbc7 could not be found. {{(pid=123391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 09:24:15.459028 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d83bea03-c1f9-4fb9-a2ba-fceb6f931dc5 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/e3fc745c-a212-4dc7-8d76-601e0f70dbc7" status: 404 len: 111 microversion: 2.1 time: 0.032294 May 03 09:24:15.459562 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1339/2503] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:15 2022] GET /compute/v2.1/servers/e3fc745c-a212-4dc7-8d76-601e0f70dbc7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 09:24:15.468666 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f00aadb1-d080-4753-809c-2439c9238b95 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '.version_select at 0x7f09cdf01e50>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:15.487817 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f00aadb1-d080-4753-809c-2439c9238b95 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2030153821" status: 202 len: 0 microversion: 2.1 time: 0.023274 May 03 09:24:15.488418 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1165/2504] 10.222.0.11 () {58 vars in 1220 bytes} [Tue May 3 09:24:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2030153821 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 09:24:16.137179 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-7bbc3fbf-c907-47d6-9c20-11e56168f9ab tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:16.137821 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-7bbc3fbf-c907-47d6-9c20-11e56168f9ab tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: e3fc745c-a212-4dc7-8d76-601e0f70dbc7] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:16.147608 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7bbc3fbf-c907-47d6-9c20-11e56168f9ab tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:16.148236 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7bbc3fbf-c907-47d6-9c20-11e56168f9ab tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:16.149433 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7bbc3fbf-c907-47d6-9c20-11e56168f9ab tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:16.150075 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7bbc3fbf-c907-47d6-9c20-11e56168f9ab tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:16.166184 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.wsgi [None req-7bbc3fbf-c907-47d6-9c20-11e56168f9ab tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] HTTP exception thrown: Instance e3fc745c-a212-4dc7-8d76-601e0f70dbc7 could not be found. May 03 09:24:16.166817 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-7bbc3fbf-c907-47d6-9c20-11e56168f9ab tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Returning 404 to user: Instance e3fc745c-a212-4dc7-8d76-601e0f70dbc7 could not be found. {{(pid=123391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 09:24:16.167700 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-7bbc3fbf-c907-47d6-9c20-11e56168f9ab tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "DELETE /compute/v2.1/servers/e3fc745c-a212-4dc7-8d76-601e0f70dbc7" status: 404 len: 111 microversion: 2.1 time: 0.036729 May 03 09:24:16.168307 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1340/2505] 10.222.0.11 () {58 vars in 1238 bytes} [Tue May 3 09:24:16 2022] DELETE /compute/v2.1/servers/e3fc745c-a212-4dc7-8d76-601e0f70dbc7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 09:24:16.171061 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7586744d-b8ba-440b-bcf8-19aa5e459313 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:16.171684 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7586744d-b8ba-440b-bcf8-19aa5e459313 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:16.176508 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-251b6975-e822-4b3e-ad89-1625518c44d2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:16.177134 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-251b6975-e822-4b3e-ad89-1625518c44d2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: e3fc745c-a212-4dc7-8d76-601e0f70dbc7] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:16.178835 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7586744d-b8ba-440b-bcf8-19aa5e459313 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:16.179323 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7586744d-b8ba-440b-bcf8-19aa5e459313 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:16.180268 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7586744d-b8ba-440b-bcf8-19aa5e459313 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:16.180728 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7586744d-b8ba-440b-bcf8-19aa5e459313 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:16.185233 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-251b6975-e822-4b3e-ad89-1625518c44d2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:16.185770 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-251b6975-e822-4b3e-ad89-1625518c44d2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:16.186555 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-251b6975-e822-4b3e-ad89-1625518c44d2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:16.187001 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-251b6975-e822-4b3e-ad89-1625518c44d2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:16.201278 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.wsgi [None req-251b6975-e822-4b3e-ad89-1625518c44d2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] HTTP exception thrown: Instance e3fc745c-a212-4dc7-8d76-601e0f70dbc7 could not be found. May 03 09:24:16.202553 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-251b6975-e822-4b3e-ad89-1625518c44d2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Returning 404 to user: Instance e3fc745c-a212-4dc7-8d76-601e0f70dbc7 could not be found. {{(pid=123391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 09:24:16.202721 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-251b6975-e822-4b3e-ad89-1625518c44d2 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/e3fc745c-a212-4dc7-8d76-601e0f70dbc7" status: 404 len: 111 microversion: 2.1 time: 0.030184 May 03 09:24:16.203538 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1341/2506] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:16 2022] GET /compute/v2.1/servers/e3fc745c-a212-4dc7-8d76-601e0f70dbc7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 03 09:24:16.323393 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7586744d-b8ba-440b-bcf8-19aa5e459313 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:16.332220 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7586744d-b8ba-440b-bcf8-19aa5e459313 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.164757 May 03 09:24:16.333007 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1166/2507] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:16 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:17.349273 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3572eb6f-9305-4fdc-9eb0-0b9651f419b9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:17.349854 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-3572eb6f-9305-4fdc-9eb0-0b9651f419b9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:17.356530 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3572eb6f-9305-4fdc-9eb0-0b9651f419b9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:17.356966 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3572eb6f-9305-4fdc-9eb0-0b9651f419b9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:17.357762 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3572eb6f-9305-4fdc-9eb0-0b9651f419b9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:17.358187 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3572eb6f-9305-4fdc-9eb0-0b9651f419b9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:17.505276 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-3572eb6f-9305-4fdc-9eb0-0b9651f419b9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:17.516467 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-3572eb6f-9305-4fdc-9eb0-0b9651f419b9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.171145 May 03 09:24:17.517035 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1342/2508] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:17 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:18.535839 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a5e976e3-afde-4e11-99dc-686ed35fba0a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:18.536386 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a5e976e3-afde-4e11-99dc-686ed35fba0a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:18.545771 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a5e976e3-afde-4e11-99dc-686ed35fba0a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:18.546213 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a5e976e3-afde-4e11-99dc-686ed35fba0a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:18.546978 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a5e976e3-afde-4e11-99dc-686ed35fba0a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:18.547404 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a5e976e3-afde-4e11-99dc-686ed35fba0a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:18.680754 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a5e976e3-afde-4e11-99dc-686ed35fba0a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:18.692319 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a5e976e3-afde-4e11-99dc-686ed35fba0a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.160099 May 03 09:24:18.693097 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1167/2509] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:18 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:19.716650 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9585d0f6-9c44-42f3-a20c-912d99064524 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:19.717252 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9585d0f6-9c44-42f3-a20c-912d99064524 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:19.723996 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9585d0f6-9c44-42f3-a20c-912d99064524 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:19.724453 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9585d0f6-9c44-42f3-a20c-912d99064524 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:19.725218 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9585d0f6-9c44-42f3-a20c-912d99064524 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:19.725652 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9585d0f6-9c44-42f3-a20c-912d99064524 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:19.857751 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9585d0f6-9c44-42f3-a20c-912d99064524 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:19.868185 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9585d0f6-9c44-42f3-a20c-912d99064524 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.157966 May 03 09:24:19.869147 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1343/2510] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:19 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:20.887225 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-50fd5e56-93e7-4b39-adf6-b2d1bf92391e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:20.887900 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-50fd5e56-93e7-4b39-adf6-b2d1bf92391e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:20.894796 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-50fd5e56-93e7-4b39-adf6-b2d1bf92391e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:20.895530 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-50fd5e56-93e7-4b39-adf6-b2d1bf92391e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:20.896119 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-50fd5e56-93e7-4b39-adf6-b2d1bf92391e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:20.896486 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-50fd5e56-93e7-4b39-adf6-b2d1bf92391e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:21.027931 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-50fd5e56-93e7-4b39-adf6-b2d1bf92391e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:21.040417 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-50fd5e56-93e7-4b39-adf6-b2d1bf92391e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.156764 May 03 09:24:21.041250 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1168/2511] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:20 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:22.059449 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-44549e11-6c48-4e5f-b684-2f1b76077d0a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:22.060124 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-44549e11-6c48-4e5f-b684-2f1b76077d0a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:22.066852 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-44549e11-6c48-4e5f-b684-2f1b76077d0a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:22.067295 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-44549e11-6c48-4e5f-b684-2f1b76077d0a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:22.068088 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-44549e11-6c48-4e5f-b684-2f1b76077d0a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:22.068517 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-44549e11-6c48-4e5f-b684-2f1b76077d0a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:22.196974 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-44549e11-6c48-4e5f-b684-2f1b76077d0a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:22.205448 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-44549e11-6c48-4e5f-b684-2f1b76077d0a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.149907 May 03 09:24:22.206236 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1344/2512] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:22 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:23.222877 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c90ce5df-3a70-40f6-92f4-b3dd5c9689f4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:23.223457 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c90ce5df-3a70-40f6-92f4-b3dd5c9689f4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:23.230377 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c90ce5df-3a70-40f6-92f4-b3dd5c9689f4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:23.230825 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c90ce5df-3a70-40f6-92f4-b3dd5c9689f4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:23.231599 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c90ce5df-3a70-40f6-92f4-b3dd5c9689f4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:23.232105 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c90ce5df-3a70-40f6-92f4-b3dd5c9689f4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:23.366652 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c90ce5df-3a70-40f6-92f4-b3dd5c9689f4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:23.375409 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c90ce5df-3a70-40f6-92f4-b3dd5c9689f4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.156474 May 03 09:24:23.376004 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1169/2513] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:23 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:24.392886 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-0b652114-5583-436b-aa0d-e61a1d3db4b7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:24.393506 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-0b652114-5583-436b-aa0d-e61a1d3db4b7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:24.400357 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0b652114-5583-436b-aa0d-e61a1d3db4b7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:24.400812 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0b652114-5583-436b-aa0d-e61a1d3db4b7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:24.401579 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0b652114-5583-436b-aa0d-e61a1d3db4b7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:24.402044 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0b652114-5583-436b-aa0d-e61a1d3db4b7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:24.537656 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-0b652114-5583-436b-aa0d-e61a1d3db4b7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:24.545867 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-0b652114-5583-436b-aa0d-e61a1d3db4b7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.156848 May 03 09:24:24.546450 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1345/2514] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:24 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:25.569304 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4d82ef06-5bd4-428c-b5af-08ad30a31f5d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:25.570202 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4d82ef06-5bd4-428c-b5af-08ad30a31f5d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:25.580528 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4d82ef06-5bd4-428c-b5af-08ad30a31f5d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:25.581276 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4d82ef06-5bd4-428c-b5af-08ad30a31f5d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:25.582919 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4d82ef06-5bd4-428c-b5af-08ad30a31f5d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:25.583644 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4d82ef06-5bd4-428c-b5af-08ad30a31f5d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:25.776441 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-4d82ef06-5bd4-428c-b5af-08ad30a31f5d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:25.785238 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-4d82ef06-5bd4-428c-b5af-08ad30a31f5d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.224234 May 03 09:24:25.785807 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1170/2515] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:25 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:26.802781 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-131ebd6d-0014-4532-841c-24bb3b17de56 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:26.803414 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-131ebd6d-0014-4532-841c-24bb3b17de56 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:26.809977 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-131ebd6d-0014-4532-841c-24bb3b17de56 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:26.810408 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-131ebd6d-0014-4532-841c-24bb3b17de56 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:26.811166 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-131ebd6d-0014-4532-841c-24bb3b17de56 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:26.811618 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-131ebd6d-0014-4532-841c-24bb3b17de56 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:26.941879 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-131ebd6d-0014-4532-841c-24bb3b17de56 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:26.950129 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-131ebd6d-0014-4532-841c-24bb3b17de56 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.151401 May 03 09:24:26.950704 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1346/2516] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:26 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:27.967314 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-951dbe6e-334f-414b-b149-cfb3d6778e41 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:27.967977 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-951dbe6e-334f-414b-b149-cfb3d6778e41 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:27.974792 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-951dbe6e-334f-414b-b149-cfb3d6778e41 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:27.975236 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-951dbe6e-334f-414b-b149-cfb3d6778e41 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:27.976038 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-951dbe6e-334f-414b-b149-cfb3d6778e41 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:27.976473 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-951dbe6e-334f-414b-b149-cfb3d6778e41 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:28.110564 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-951dbe6e-334f-414b-b149-cfb3d6778e41 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:28.119048 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-951dbe6e-334f-414b-b149-cfb3d6778e41 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.155807 May 03 09:24:28.123003 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1171/2517] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:27 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:29.136677 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ff0f4219-1595-4d4d-9cce-bc53f0d00aef tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:29.137245 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ff0f4219-1595-4d4d-9cce-bc53f0d00aef tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:29.144058 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ff0f4219-1595-4d4d-9cce-bc53f0d00aef tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:29.144512 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ff0f4219-1595-4d4d-9cce-bc53f0d00aef tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:29.145278 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ff0f4219-1595-4d4d-9cce-bc53f0d00aef tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:29.145710 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ff0f4219-1595-4d4d-9cce-bc53f0d00aef tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:29.288202 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ff0f4219-1595-4d4d-9cce-bc53f0d00aef tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:29.296652 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ff0f4219-1595-4d4d-9cce-bc53f0d00aef tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.164011 May 03 09:24:29.297222 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1347/2518] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:29 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:30.314170 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-76ca6616-6831-42a9-ad11-225c2490f4b5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:30.314787 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-76ca6616-6831-42a9-ad11-225c2490f4b5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:30.321635 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-76ca6616-6831-42a9-ad11-225c2490f4b5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:30.322092 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-76ca6616-6831-42a9-ad11-225c2490f4b5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:30.322875 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-76ca6616-6831-42a9-ad11-225c2490f4b5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:30.323310 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-76ca6616-6831-42a9-ad11-225c2490f4b5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:30.456903 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-76ca6616-6831-42a9-ad11-225c2490f4b5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:30.467664 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-76ca6616-6831-42a9-ad11-225c2490f4b5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.157469 May 03 09:24:30.468179 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1172/2519] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:30 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:31.490104 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-eb815576-2bde-4580-a10a-63dadc23c661 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:31.491051 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-eb815576-2bde-4580-a10a-63dadc23c661 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:31.501880 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-eb815576-2bde-4580-a10a-63dadc23c661 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:31.502335 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-eb815576-2bde-4580-a10a-63dadc23c661 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:31.503099 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-eb815576-2bde-4580-a10a-63dadc23c661 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:31.503522 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-eb815576-2bde-4580-a10a-63dadc23c661 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:31.645511 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-eb815576-2bde-4580-a10a-63dadc23c661 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:31.654132 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-eb815576-2bde-4580-a10a-63dadc23c661 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.170631 May 03 09:24:31.654740 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1348/2520] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:31 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:32.673693 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7453d845-3466-4372-a4ff-eeee95f55b21 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:32.674314 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7453d845-3466-4372-a4ff-eeee95f55b21 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:32.681533 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7453d845-3466-4372-a4ff-eeee95f55b21 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:32.681976 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7453d845-3466-4372-a4ff-eeee95f55b21 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:32.682738 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7453d845-3466-4372-a4ff-eeee95f55b21 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:32.683168 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7453d845-3466-4372-a4ff-eeee95f55b21 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:32.817302 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7453d845-3466-4372-a4ff-eeee95f55b21 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:32.829726 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7453d845-3466-4372-a4ff-eeee95f55b21 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.161592 May 03 09:24:32.830543 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1173/2521] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:32 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:33.847974 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f2982fe6-5b51-4baa-a2b0-fcfcd60c42f4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:33.848637 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f2982fe6-5b51-4baa-a2b0-fcfcd60c42f4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:33.855464 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f2982fe6-5b51-4baa-a2b0-fcfcd60c42f4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:33.855951 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f2982fe6-5b51-4baa-a2b0-fcfcd60c42f4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:33.856708 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f2982fe6-5b51-4baa-a2b0-fcfcd60c42f4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:33.857140 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f2982fe6-5b51-4baa-a2b0-fcfcd60c42f4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:33.995428 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f2982fe6-5b51-4baa-a2b0-fcfcd60c42f4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:34.004203 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f2982fe6-5b51-4baa-a2b0-fcfcd60c42f4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.160239 May 03 09:24:34.004769 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1349/2522] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:33 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:35.023205 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-8f40055c-dbc8-4729-8f48-6e27dade5180 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:35.023805 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-8f40055c-dbc8-4729-8f48-6e27dade5180 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:35.031315 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8f40055c-dbc8-4729-8f48-6e27dade5180 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:35.031816 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8f40055c-dbc8-4729-8f48-6e27dade5180 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:35.032717 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8f40055c-dbc8-4729-8f48-6e27dade5180 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:35.033216 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8f40055c-dbc8-4729-8f48-6e27dade5180 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:35.171760 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-8f40055c-dbc8-4729-8f48-6e27dade5180 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:35.179790 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-8f40055c-dbc8-4729-8f48-6e27dade5180 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.161122 May 03 09:24:35.180414 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1174/2523] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:35 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:36.197830 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c354ebbd-afe0-4c40-bf64-614170e6a7a4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:36.199976 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c354ebbd-afe0-4c40-bf64-614170e6a7a4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:36.206121 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c354ebbd-afe0-4c40-bf64-614170e6a7a4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:36.206870 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c354ebbd-afe0-4c40-bf64-614170e6a7a4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:36.207678 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c354ebbd-afe0-4c40-bf64-614170e6a7a4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:36.208156 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c354ebbd-afe0-4c40-bf64-614170e6a7a4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:36.349821 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c354ebbd-afe0-4c40-bf64-614170e6a7a4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:36.361449 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c354ebbd-afe0-4c40-bf64-614170e6a7a4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.168855 May 03 09:24:36.362086 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1350/2524] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:36 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:37.383173 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-bb67c7d5-c2c1-451a-8380-5ad56dcac741 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:37.384324 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-bb67c7d5-c2c1-451a-8380-5ad56dcac741 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:37.395228 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bb67c7d5-c2c1-451a-8380-5ad56dcac741 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:37.396040 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bb67c7d5-c2c1-451a-8380-5ad56dcac741 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:37.396831 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bb67c7d5-c2c1-451a-8380-5ad56dcac741 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:37.397278 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bb67c7d5-c2c1-451a-8380-5ad56dcac741 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:37.531464 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-bb67c7d5-c2c1-451a-8380-5ad56dcac741 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:37.541506 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-bb67c7d5-c2c1-451a-8380-5ad56dcac741 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.164545 May 03 09:24:37.542322 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1175/2525] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:37 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:38.565918 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-363cff4d-c995-4302-8809-686fd61dbea2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:38.566573 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-363cff4d-c995-4302-8809-686fd61dbea2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:38.575179 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-363cff4d-c995-4302-8809-686fd61dbea2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:38.575733 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-363cff4d-c995-4302-8809-686fd61dbea2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:38.576714 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-363cff4d-c995-4302-8809-686fd61dbea2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:38.577288 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-363cff4d-c995-4302-8809-686fd61dbea2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:38.721151 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-363cff4d-c995-4302-8809-686fd61dbea2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:38.729423 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-363cff4d-c995-4302-8809-686fd61dbea2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.168480 May 03 09:24:38.729984 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1351/2526] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:38 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:39.748043 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-397b666d-3431-4c3a-88a2-a3d5f5b62b69 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:39.748678 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-397b666d-3431-4c3a-88a2-a3d5f5b62b69 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:39.756198 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-397b666d-3431-4c3a-88a2-a3d5f5b62b69 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:39.756716 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-397b666d-3431-4c3a-88a2-a3d5f5b62b69 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:39.757487 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-397b666d-3431-4c3a-88a2-a3d5f5b62b69 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:39.757923 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-397b666d-3431-4c3a-88a2-a3d5f5b62b69 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:39.898421 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-397b666d-3431-4c3a-88a2-a3d5f5b62b69 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:39.908896 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-397b666d-3431-4c3a-88a2-a3d5f5b62b69 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.164178 May 03 09:24:39.909751 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1176/2527] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:39 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:40.926630 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f172faad-8800-49fa-86c5-d8342b00aace tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:40.927236 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f172faad-8800-49fa-86c5-d8342b00aace tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:40.933962 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f172faad-8800-49fa-86c5-d8342b00aace tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:40.934410 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f172faad-8800-49fa-86c5-d8342b00aace tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:40.935180 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f172faad-8800-49fa-86c5-d8342b00aace tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:40.935599 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f172faad-8800-49fa-86c5-d8342b00aace tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:41.063991 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f172faad-8800-49fa-86c5-d8342b00aace tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:41.072323 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f172faad-8800-49fa-86c5-d8342b00aace tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.149590 May 03 09:24:41.072863 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1352/2528] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:40 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:42.089942 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c3a290b7-6a1c-49f8-9eb3-c5d6822b6e3e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:42.090577 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c3a290b7-6a1c-49f8-9eb3-c5d6822b6e3e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:42.097294 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c3a290b7-6a1c-49f8-9eb3-c5d6822b6e3e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:42.097739 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c3a290b7-6a1c-49f8-9eb3-c5d6822b6e3e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:42.098498 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c3a290b7-6a1c-49f8-9eb3-c5d6822b6e3e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:42.098923 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c3a290b7-6a1c-49f8-9eb3-c5d6822b6e3e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:42.231823 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c3a290b7-6a1c-49f8-9eb3-c5d6822b6e3e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:42.239947 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c3a290b7-6a1c-49f8-9eb3-c5d6822b6e3e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.153864 May 03 09:24:42.240517 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1177/2529] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:42 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:43.260428 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-90322471-c715-4859-9010-3536961a56eb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:43.261334 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-90322471-c715-4859-9010-3536961a56eb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:43.270553 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-90322471-c715-4859-9010-3536961a56eb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:43.271183 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-90322471-c715-4859-9010-3536961a56eb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:43.272297 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-90322471-c715-4859-9010-3536961a56eb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:43.272909 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-90322471-c715-4859-9010-3536961a56eb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:43.428265 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-90322471-c715-4859-9010-3536961a56eb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:43.436871 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-90322471-c715-4859-9010-3536961a56eb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.181640 May 03 09:24:43.437437 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1353/2530] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:43 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:44.458423 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-09cf00bf-9702-430d-abaf-e12fafc93f98 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:44.459471 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-09cf00bf-9702-430d-abaf-e12fafc93f98 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:44.467281 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-09cf00bf-9702-430d-abaf-e12fafc93f98 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:44.467702 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-09cf00bf-9702-430d-abaf-e12fafc93f98 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:44.468600 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-09cf00bf-9702-430d-abaf-e12fafc93f98 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:44.469086 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-09cf00bf-9702-430d-abaf-e12fafc93f98 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:44.600600 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-09cf00bf-9702-430d-abaf-e12fafc93f98 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:44.608510 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-09cf00bf-9702-430d-abaf-e12fafc93f98 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.157049 May 03 09:24:44.609116 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1178/2531] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:44 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:45.626681 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3d0d7517-1858-4eb7-bc0e-b9d1317a8ca5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:45.627278 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-3d0d7517-1858-4eb7-bc0e-b9d1317a8ca5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:45.634611 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3d0d7517-1858-4eb7-bc0e-b9d1317a8ca5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:45.635068 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3d0d7517-1858-4eb7-bc0e-b9d1317a8ca5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:45.635883 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3d0d7517-1858-4eb7-bc0e-b9d1317a8ca5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:45.636305 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3d0d7517-1858-4eb7-bc0e-b9d1317a8ca5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:45.773393 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-3d0d7517-1858-4eb7-bc0e-b9d1317a8ca5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:45.781430 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-3d0d7517-1858-4eb7-bc0e-b9d1317a8ca5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.158775 May 03 09:24:45.782008 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1354/2532] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:45 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:46.800641 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-1dfc7323-6dee-4013-a34f-15d4988d55c9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:46.801502 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-1dfc7323-6dee-4013-a34f-15d4988d55c9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:46.810322 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1dfc7323-6dee-4013-a34f-15d4988d55c9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:46.810772 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1dfc7323-6dee-4013-a34f-15d4988d55c9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:46.811899 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1dfc7323-6dee-4013-a34f-15d4988d55c9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:46.812574 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1dfc7323-6dee-4013-a34f-15d4988d55c9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:46.942890 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-1dfc7323-6dee-4013-a34f-15d4988d55c9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:46.951570 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-1dfc7323-6dee-4013-a34f-15d4988d55c9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.156152 May 03 09:24:46.952200 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1179/2533] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:46 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:47.976904 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c81564d0-acab-4c34-8424-6a94a1e42c56 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:47.977896 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c81564d0-acab-4c34-8424-6a94a1e42c56 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:47.988604 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c81564d0-acab-4c34-8424-6a94a1e42c56 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:47.989198 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c81564d0-acab-4c34-8424-6a94a1e42c56 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:47.990275 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c81564d0-acab-4c34-8424-6a94a1e42c56 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:47.990870 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c81564d0-acab-4c34-8424-6a94a1e42c56 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:48.126365 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c81564d0-acab-4c34-8424-6a94a1e42c56 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:48.135002 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c81564d0-acab-4c34-8424-6a94a1e42c56 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.164502 May 03 09:24:48.135582 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1355/2534] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:47 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:49.154782 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-78ce0701-9834-495a-be7a-403753e63c42 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:49.155385 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-78ce0701-9834-495a-be7a-403753e63c42 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:49.162032 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-78ce0701-9834-495a-be7a-403753e63c42 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:49.162477 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-78ce0701-9834-495a-be7a-403753e63c42 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:49.163230 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-78ce0701-9834-495a-be7a-403753e63c42 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:49.163652 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-78ce0701-9834-495a-be7a-403753e63c42 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:49.294395 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-78ce0701-9834-495a-be7a-403753e63c42 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:49.302880 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-78ce0701-9834-495a-be7a-403753e63c42 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.152161 May 03 09:24:49.303500 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1180/2535] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:49 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:50.324643 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f0c76c49-6b36-42bd-b1a0-f02a726b19f7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:50.325656 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f0c76c49-6b36-42bd-b1a0-f02a726b19f7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:50.336536 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f0c76c49-6b36-42bd-b1a0-f02a726b19f7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:50.336982 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f0c76c49-6b36-42bd-b1a0-f02a726b19f7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:50.337765 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f0c76c49-6b36-42bd-b1a0-f02a726b19f7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:50.338194 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f0c76c49-6b36-42bd-b1a0-f02a726b19f7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:50.481514 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f0c76c49-6b36-42bd-b1a0-f02a726b19f7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:50.493375 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f0c76c49-6b36-42bd-b1a0-f02a726b19f7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.175364 May 03 09:24:50.493977 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1356/2536] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:50 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:51.513678 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ec885929-08fb-4099-be89-494fb4ff2c68 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:51.514266 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ec885929-08fb-4099-be89-494fb4ff2c68 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:51.521461 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ec885929-08fb-4099-be89-494fb4ff2c68 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:51.521876 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ec885929-08fb-4099-be89-494fb4ff2c68 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:51.522670 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ec885929-08fb-4099-be89-494fb4ff2c68 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:51.523106 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ec885929-08fb-4099-be89-494fb4ff2c68 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:51.665498 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ec885929-08fb-4099-be89-494fb4ff2c68 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:51.678256 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ec885929-08fb-4099-be89-494fb4ff2c68 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.170431 May 03 09:24:51.679185 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1181/2537] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:51 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:52.700086 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-95726a83-f166-4e63-b639-68eae07f9034 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:52.701131 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-95726a83-f166-4e63-b639-68eae07f9034 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:52.711987 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-95726a83-f166-4e63-b639-68eae07f9034 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:52.712440 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-95726a83-f166-4e63-b639-68eae07f9034 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:52.713210 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-95726a83-f166-4e63-b639-68eae07f9034 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:52.713642 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-95726a83-f166-4e63-b639-68eae07f9034 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:52.856649 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-95726a83-f166-4e63-b639-68eae07f9034 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:52.868230 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-95726a83-f166-4e63-b639-68eae07f9034 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.174345 May 03 09:24:52.868909 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1357/2538] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:52 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:53.891737 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-fcbc19f9-a7f5-4e04-9a60-60b1e8848007 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:53.892750 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-fcbc19f9-a7f5-4e04-9a60-60b1e8848007 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:53.901299 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fcbc19f9-a7f5-4e04-9a60-60b1e8848007 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:53.901739 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fcbc19f9-a7f5-4e04-9a60-60b1e8848007 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:53.902499 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fcbc19f9-a7f5-4e04-9a60-60b1e8848007 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:53.902928 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fcbc19f9-a7f5-4e04-9a60-60b1e8848007 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:54.039436 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-fcbc19f9-a7f5-4e04-9a60-60b1e8848007 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:54.048055 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-fcbc19f9-a7f5-4e04-9a60-60b1e8848007 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.162939 May 03 09:24:54.048637 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1182/2539] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:53 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:55.069369 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-99a4e38c-02b3-406d-819a-2f5b667ac983 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:55.070356 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-99a4e38c-02b3-406d-819a-2f5b667ac983 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:55.078605 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-99a4e38c-02b3-406d-819a-2f5b667ac983 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:55.079146 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-99a4e38c-02b3-406d-819a-2f5b667ac983 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:55.080115 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-99a4e38c-02b3-406d-819a-2f5b667ac983 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:55.080632 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-99a4e38c-02b3-406d-819a-2f5b667ac983 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:55.224664 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-99a4e38c-02b3-406d-819a-2f5b667ac983 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:55.232964 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-99a4e38c-02b3-406d-819a-2f5b667ac983 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.170173 May 03 09:24:55.233533 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1358/2540] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:55 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:56.250762 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d847e8e6-5642-4611-b152-ff808f1fba6a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:56.251329 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d847e8e6-5642-4611-b152-ff808f1fba6a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:56.258157 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d847e8e6-5642-4611-b152-ff808f1fba6a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:56.258613 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d847e8e6-5642-4611-b152-ff808f1fba6a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:56.259380 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d847e8e6-5642-4611-b152-ff808f1fba6a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:56.259818 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d847e8e6-5642-4611-b152-ff808f1fba6a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:56.657430 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d847e8e6-5642-4611-b152-ff808f1fba6a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:56.665659 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d847e8e6-5642-4611-b152-ff808f1fba6a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.418986 May 03 09:24:56.666269 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1183/2541] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:56 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:57.685678 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-cbbbfb49-f3c1-4738-b6dd-2791bf2e6dd2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:57.686574 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-cbbbfb49-f3c1-4738-b6dd-2791bf2e6dd2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:57.695591 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cbbbfb49-f3c1-4738-b6dd-2791bf2e6dd2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:57.696285 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cbbbfb49-f3c1-4738-b6dd-2791bf2e6dd2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:57.697381 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cbbbfb49-f3c1-4738-b6dd-2791bf2e6dd2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:57.698002 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cbbbfb49-f3c1-4738-b6dd-2791bf2e6dd2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:57.832377 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-cbbbfb49-f3c1-4738-b6dd-2791bf2e6dd2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:57.840483 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-cbbbfb49-f3c1-4738-b6dd-2791bf2e6dd2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.160803 May 03 09:24:57.841020 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1359/2542] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:57 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:24:58.862614 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-aefddd91-3758-49f8-82bb-d48f87dda9b0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:24:58.863637 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-aefddd91-3758-49f8-82bb-d48f87dda9b0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:24:58.875486 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aefddd91-3758-49f8-82bb-d48f87dda9b0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:58.876323 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aefddd91-3758-49f8-82bb-d48f87dda9b0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:58.877931 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aefddd91-3758-49f8-82bb-d48f87dda9b0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:24:58.878714 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aefddd91-3758-49f8-82bb-d48f87dda9b0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:24:59.012990 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-aefddd91-3758-49f8-82bb-d48f87dda9b0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:24:59.020845 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-aefddd91-3758-49f8-82bb-d48f87dda9b0 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.165012 May 03 09:24:59.021440 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1184/2543] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:24:58 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:00.039827 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c2614357-2ca9-4c98-8640-9994d5b46d8b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:00.040581 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c2614357-2ca9-4c98-8640-9994d5b46d8b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:00.048659 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c2614357-2ca9-4c98-8640-9994d5b46d8b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:00.049218 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c2614357-2ca9-4c98-8640-9994d5b46d8b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:00.050154 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c2614357-2ca9-4c98-8640-9994d5b46d8b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:00.050693 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c2614357-2ca9-4c98-8640-9994d5b46d8b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:00.186803 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c2614357-2ca9-4c98-8640-9994d5b46d8b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:00.194686 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c2614357-2ca9-4c98-8640-9994d5b46d8b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.159752 May 03 09:25:00.195267 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1360/2544] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:00 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:01.214767 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-82a4f8e0-ee54-4f9f-96d4-e91aad4e32dc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:01.215355 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-82a4f8e0-ee54-4f9f-96d4-e91aad4e32dc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:01.222842 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-82a4f8e0-ee54-4f9f-96d4-e91aad4e32dc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:01.223224 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-82a4f8e0-ee54-4f9f-96d4-e91aad4e32dc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:01.224011 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-82a4f8e0-ee54-4f9f-96d4-e91aad4e32dc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:01.224438 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-82a4f8e0-ee54-4f9f-96d4-e91aad4e32dc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:01.358549 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-82a4f8e0-ee54-4f9f-96d4-e91aad4e32dc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:01.366827 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-82a4f8e0-ee54-4f9f-96d4-e91aad4e32dc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.155998 May 03 09:25:01.367520 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1185/2545] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:01 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:02.387341 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-eb215a39-7f10-476c-9409-92b248db122c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:02.388319 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-eb215a39-7f10-476c-9409-92b248db122c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:02.398864 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-eb215a39-7f10-476c-9409-92b248db122c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:02.399425 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-eb215a39-7f10-476c-9409-92b248db122c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:02.400247 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-eb215a39-7f10-476c-9409-92b248db122c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:02.400680 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-eb215a39-7f10-476c-9409-92b248db122c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:02.530230 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-eb215a39-7f10-476c-9409-92b248db122c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:02.541151 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-eb215a39-7f10-476c-9409-92b248db122c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.160212 May 03 09:25:02.541723 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1361/2546] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:02 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:03.561633 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ff31fc75-656a-400c-9d97-16e987d904d6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:03.562218 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ff31fc75-656a-400c-9d97-16e987d904d6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:03.571535 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ff31fc75-656a-400c-9d97-16e987d904d6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:03.572016 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ff31fc75-656a-400c-9d97-16e987d904d6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:03.572770 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ff31fc75-656a-400c-9d97-16e987d904d6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:03.573201 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ff31fc75-656a-400c-9d97-16e987d904d6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:03.713542 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ff31fc75-656a-400c-9d97-16e987d904d6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:03.721873 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ff31fc75-656a-400c-9d97-16e987d904d6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.165917 May 03 09:25:03.722441 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1186/2547] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:03 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:04.740364 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d50cf17d-31e6-438a-be6f-4ae0f34422ee tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:04.741072 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d50cf17d-31e6-438a-be6f-4ae0f34422ee tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:04.748159 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d50cf17d-31e6-438a-be6f-4ae0f34422ee tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:04.748606 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d50cf17d-31e6-438a-be6f-4ae0f34422ee tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:04.749371 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d50cf17d-31e6-438a-be6f-4ae0f34422ee tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:04.749802 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d50cf17d-31e6-438a-be6f-4ae0f34422ee tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:04.887586 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d50cf17d-31e6-438a-be6f-4ae0f34422ee tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:04.895964 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d50cf17d-31e6-438a-be6f-4ae0f34422ee tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.160336 May 03 09:25:04.896538 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1362/2548] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:04 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:05.913792 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e9f8cf0d-a36e-4038-81c4-0ca29b63e117 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:05.914455 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e9f8cf0d-a36e-4038-81c4-0ca29b63e117 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:05.921147 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e9f8cf0d-a36e-4038-81c4-0ca29b63e117 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:05.921595 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e9f8cf0d-a36e-4038-81c4-0ca29b63e117 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:05.922373 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e9f8cf0d-a36e-4038-81c4-0ca29b63e117 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:05.922812 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e9f8cf0d-a36e-4038-81c4-0ca29b63e117 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:06.058789 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e9f8cf0d-a36e-4038-81c4-0ca29b63e117 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:06.070687 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e9f8cf0d-a36e-4038-81c4-0ca29b63e117 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.160730 May 03 09:25:06.071532 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1187/2549] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:05 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:07.092708 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-eacba79e-0ae8-43ab-a1bd-48bab0548e79 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:07.093635 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-eacba79e-0ae8-43ab-a1bd-48bab0548e79 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:07.103135 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-eacba79e-0ae8-43ab-a1bd-48bab0548e79 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:07.103588 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-eacba79e-0ae8-43ab-a1bd-48bab0548e79 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:07.104364 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-eacba79e-0ae8-43ab-a1bd-48bab0548e79 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:07.104792 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-eacba79e-0ae8-43ab-a1bd-48bab0548e79 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:07.238304 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-eacba79e-0ae8-43ab-a1bd-48bab0548e79 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:07.246492 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-eacba79e-0ae8-43ab-a1bd-48bab0548e79 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.160297 May 03 09:25:07.247131 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1363/2550] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:07 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:08.264046 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c6704c37-2d8a-4894-b4b7-ac102910c6da tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:08.264631 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c6704c37-2d8a-4894-b4b7-ac102910c6da tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:08.271294 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c6704c37-2d8a-4894-b4b7-ac102910c6da tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:08.271737 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c6704c37-2d8a-4894-b4b7-ac102910c6da tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:08.272618 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c6704c37-2d8a-4894-b4b7-ac102910c6da tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:08.273050 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c6704c37-2d8a-4894-b4b7-ac102910c6da tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:08.407350 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c6704c37-2d8a-4894-b4b7-ac102910c6da tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:08.416069 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c6704c37-2d8a-4894-b4b7-ac102910c6da tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.155996 May 03 09:25:08.416614 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1188/2551] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:08 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:09.438055 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-4b45b5ff-1b11-415b-8ca1-8f6443d96e1a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:09.439049 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-4b45b5ff-1b11-415b-8ca1-8f6443d96e1a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:09.448738 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4b45b5ff-1b11-415b-8ca1-8f6443d96e1a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:09.449188 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4b45b5ff-1b11-415b-8ca1-8f6443d96e1a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:09.449956 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4b45b5ff-1b11-415b-8ca1-8f6443d96e1a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:09.450459 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4b45b5ff-1b11-415b-8ca1-8f6443d96e1a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:09.581599 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-4b45b5ff-1b11-415b-8ca1-8f6443d96e1a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:09.591660 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-4b45b5ff-1b11-415b-8ca1-8f6443d96e1a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.160630 May 03 09:25:09.592293 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1364/2552] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:09 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:10.612806 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-bc95af83-02c4-4ea5-8de8-10468043d186 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:10.613648 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-bc95af83-02c4-4ea5-8de8-10468043d186 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:10.622433 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bc95af83-02c4-4ea5-8de8-10468043d186 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:10.622883 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bc95af83-02c4-4ea5-8de8-10468043d186 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:10.623641 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bc95af83-02c4-4ea5-8de8-10468043d186 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:10.624111 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bc95af83-02c4-4ea5-8de8-10468043d186 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:10.761529 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-bc95af83-02c4-4ea5-8de8-10468043d186 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:10.772868 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-bc95af83-02c4-4ea5-8de8-10468043d186 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.166458 May 03 09:25:10.773397 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1189/2553] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:10 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:11.799478 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-2b2c2334-d577-4f6b-b2f2-c2170dedcdb4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:11.800629 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-2b2c2334-d577-4f6b-b2f2-c2170dedcdb4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:11.811293 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2b2c2334-d577-4f6b-b2f2-c2170dedcdb4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:11.812084 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2b2c2334-d577-4f6b-b2f2-c2170dedcdb4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:11.813335 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2b2c2334-d577-4f6b-b2f2-c2170dedcdb4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:11.814035 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2b2c2334-d577-4f6b-b2f2-c2170dedcdb4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:11.951631 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-2b2c2334-d577-4f6b-b2f2-c2170dedcdb4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:11.960424 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-2b2c2334-d577-4f6b-b2f2-c2170dedcdb4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.167588 May 03 09:25:11.960994 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1365/2554] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:11 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:12.978283 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-cbe6716c-689f-49cf-bd77-22a94e84a248 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:12.978885 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-cbe6716c-689f-49cf-bd77-22a94e84a248 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:12.985567 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cbe6716c-689f-49cf-bd77-22a94e84a248 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:12.986022 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cbe6716c-689f-49cf-bd77-22a94e84a248 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:12.986792 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cbe6716c-689f-49cf-bd77-22a94e84a248 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:12.987227 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cbe6716c-689f-49cf-bd77-22a94e84a248 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:13.121734 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-cbe6716c-689f-49cf-bd77-22a94e84a248 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:13.132348 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-cbe6716c-689f-49cf-bd77-22a94e84a248 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.158067 May 03 09:25:13.132959 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1190/2555] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:12 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:14.150087 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-696c2cec-1ed0-49f6-8499-e077da98cfdc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:14.150733 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-696c2cec-1ed0-49f6-8499-e077da98cfdc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:14.157420 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-696c2cec-1ed0-49f6-8499-e077da98cfdc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:14.157864 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-696c2cec-1ed0-49f6-8499-e077da98cfdc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:14.158624 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-696c2cec-1ed0-49f6-8499-e077da98cfdc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:14.159052 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-696c2cec-1ed0-49f6-8499-e077da98cfdc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:14.293077 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-696c2cec-1ed0-49f6-8499-e077da98cfdc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:14.303265 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-696c2cec-1ed0-49f6-8499-e077da98cfdc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.157196 May 03 09:25:14.303959 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1366/2556] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:14 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:15.321033 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-90d03044-c5c8-4c1f-9fca-3e40db393248 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:15.321643 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-90d03044-c5c8-4c1f-9fca-3e40db393248 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:15.328585 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-90d03044-c5c8-4c1f-9fca-3e40db393248 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:15.329054 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-90d03044-c5c8-4c1f-9fca-3e40db393248 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:15.330013 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-90d03044-c5c8-4c1f-9fca-3e40db393248 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:15.330785 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-90d03044-c5c8-4c1f-9fca-3e40db393248 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:15.474533 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-90d03044-c5c8-4c1f-9fca-3e40db393248 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:15.484315 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-90d03044-c5c8-4c1f-9fca-3e40db393248 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.167239 May 03 09:25:15.484915 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1191/2557] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:15 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:16.501803 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-fe4c45e4-ef0b-47cc-b689-a8bd3e97f46c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:16.502464 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-fe4c45e4-ef0b-47cc-b689-a8bd3e97f46c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:16.509147 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fe4c45e4-ef0b-47cc-b689-a8bd3e97f46c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:16.509596 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fe4c45e4-ef0b-47cc-b689-a8bd3e97f46c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:16.510366 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fe4c45e4-ef0b-47cc-b689-a8bd3e97f46c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:16.510802 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fe4c45e4-ef0b-47cc-b689-a8bd3e97f46c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:16.641944 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-fe4c45e4-ef0b-47cc-b689-a8bd3e97f46c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:16.650369 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-fe4c45e4-ef0b-47cc-b689-a8bd3e97f46c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.152571 May 03 09:25:16.650958 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1367/2558] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:16 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:17.668004 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-1fd5c383-6cb8-43a7-a218-54297340fcd5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:17.668632 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-1fd5c383-6cb8-43a7-a218-54297340fcd5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:17.675370 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1fd5c383-6cb8-43a7-a218-54297340fcd5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:17.675814 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1fd5c383-6cb8-43a7-a218-54297340fcd5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:17.676580 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1fd5c383-6cb8-43a7-a218-54297340fcd5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:17.677020 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1fd5c383-6cb8-43a7-a218-54297340fcd5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:17.807010 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-1fd5c383-6cb8-43a7-a218-54297340fcd5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:17.814915 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-1fd5c383-6cb8-43a7-a218-54297340fcd5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.150923 May 03 09:25:17.815483 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1192/2559] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:17 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:18.447050 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 09:25:18.447671 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: Tue May 3 09:25:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 03 09:25:18.833517 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d4881bdf-04d3-419c-bf23-0f7d432618dc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:18.834108 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d4881bdf-04d3-419c-bf23-0f7d432618dc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:18.841392 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d4881bdf-04d3-419c-bf23-0f7d432618dc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:18.841842 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d4881bdf-04d3-419c-bf23-0f7d432618dc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:18.842629 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d4881bdf-04d3-419c-bf23-0f7d432618dc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:18.843071 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d4881bdf-04d3-419c-bf23-0f7d432618dc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:18.986588 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d4881bdf-04d3-419c-bf23-0f7d432618dc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:18.999520 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d4881bdf-04d3-419c-bf23-0f7d432618dc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.169838 May 03 09:25:19.000602 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1368/2560] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:18 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:20.023519 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4e6cef3d-ed0c-44ce-8a4f-3b3c9bbc139b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:20.024559 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4e6cef3d-ed0c-44ce-8a4f-3b3c9bbc139b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:20.035434 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4e6cef3d-ed0c-44ce-8a4f-3b3c9bbc139b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:20.036232 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4e6cef3d-ed0c-44ce-8a4f-3b3c9bbc139b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:20.037470 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4e6cef3d-ed0c-44ce-8a4f-3b3c9bbc139b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:20.038182 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4e6cef3d-ed0c-44ce-8a4f-3b3c9bbc139b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:20.166129 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-4e6cef3d-ed0c-44ce-8a4f-3b3c9bbc139b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:20.174509 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-4e6cef3d-ed0c-44ce-8a4f-3b3c9bbc139b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.157524 May 03 09:25:20.175070 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1193/2561] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:20 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:21.196122 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-7b9f224a-8136-4a50-a3b5-c5b03d640620 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:21.197092 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-7b9f224a-8136-4a50-a3b5-c5b03d640620 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:21.203996 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7b9f224a-8136-4a50-a3b5-c5b03d640620 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:21.204451 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7b9f224a-8136-4a50-a3b5-c5b03d640620 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:21.205593 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7b9f224a-8136-4a50-a3b5-c5b03d640620 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:21.206030 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7b9f224a-8136-4a50-a3b5-c5b03d640620 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:21.342183 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7b9f224a-8136-4a50-a3b5-c5b03d640620 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:21.350912 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-7b9f224a-8136-4a50-a3b5-c5b03d640620 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.161593 May 03 09:25:21.351492 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1369/2562] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:21 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:22.372309 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-671086b8-6393-42fb-852e-7c5dfc4e6250 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:22.373299 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-671086b8-6393-42fb-852e-7c5dfc4e6250 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:22.384725 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-671086b8-6393-42fb-852e-7c5dfc4e6250 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:22.385947 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-671086b8-6393-42fb-852e-7c5dfc4e6250 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:22.387229 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-671086b8-6393-42fb-852e-7c5dfc4e6250 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:22.388040 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-671086b8-6393-42fb-852e-7c5dfc4e6250 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:22.531983 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-671086b8-6393-42fb-852e-7c5dfc4e6250 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:22.544224 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-671086b8-6393-42fb-852e-7c5dfc4e6250 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.178211 May 03 09:25:22.544965 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1194/2563] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:22 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:23.569994 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-90992f7c-76a5-4c76-be00-b3c4b59bb619 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:23.570884 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-90992f7c-76a5-4c76-be00-b3c4b59bb619 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:23.578157 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-90992f7c-76a5-4c76-be00-b3c4b59bb619 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:23.578605 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-90992f7c-76a5-4c76-be00-b3c4b59bb619 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:23.579352 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-90992f7c-76a5-4c76-be00-b3c4b59bb619 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:23.579793 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-90992f7c-76a5-4c76-be00-b3c4b59bb619 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:23.718810 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-90992f7c-76a5-4c76-be00-b3c4b59bb619 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:23.727086 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-90992f7c-76a5-4c76-be00-b3c4b59bb619 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.163838 May 03 09:25:23.727656 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1370/2564] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:23 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:24.749017 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-32c58d28-e1d9-4c48-b644-95eb53d2a371 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:24.750035 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-32c58d28-e1d9-4c48-b644-95eb53d2a371 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:24.760345 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-32c58d28-e1d9-4c48-b644-95eb53d2a371 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:24.761090 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-32c58d28-e1d9-4c48-b644-95eb53d2a371 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:24.762361 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-32c58d28-e1d9-4c48-b644-95eb53d2a371 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:24.763087 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-32c58d28-e1d9-4c48-b644-95eb53d2a371 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:24.914871 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-32c58d28-e1d9-4c48-b644-95eb53d2a371 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:24.923178 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-32c58d28-e1d9-4c48-b644-95eb53d2a371 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.181437 May 03 09:25:24.923804 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1195/2565] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:24 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:25.940661 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-41c2e57f-5ac7-4ef7-bcef-19644c79c96b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:25.941283 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-41c2e57f-5ac7-4ef7-bcef-19644c79c96b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:25.947787 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-41c2e57f-5ac7-4ef7-bcef-19644c79c96b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:25.948367 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-41c2e57f-5ac7-4ef7-bcef-19644c79c96b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:25.949132 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-41c2e57f-5ac7-4ef7-bcef-19644c79c96b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:25.949574 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-41c2e57f-5ac7-4ef7-bcef-19644c79c96b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:26.083624 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-41c2e57f-5ac7-4ef7-bcef-19644c79c96b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:26.091869 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-41c2e57f-5ac7-4ef7-bcef-19644c79c96b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.155140 May 03 09:25:26.092455 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1371/2566] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:25 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:27.112993 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a5fd6b02-43de-4c57-b109-995297fcd863 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:27.113994 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a5fd6b02-43de-4c57-b109-995297fcd863 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:27.122732 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a5fd6b02-43de-4c57-b109-995297fcd863 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:27.123183 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a5fd6b02-43de-4c57-b109-995297fcd863 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:27.123982 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a5fd6b02-43de-4c57-b109-995297fcd863 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:27.124421 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a5fd6b02-43de-4c57-b109-995297fcd863 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:27.268098 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a5fd6b02-43de-4c57-b109-995297fcd863 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:27.281113 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a5fd6b02-43de-4c57-b109-995297fcd863 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.174235 May 03 09:25:27.282232 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1196/2567] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:27 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:28.306570 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f700d849-5328-4762-830e-d6ba1fcfd1ce tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:28.307656 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f700d849-5328-4762-830e-d6ba1fcfd1ce tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:28.314404 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f700d849-5328-4762-830e-d6ba1fcfd1ce tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:28.314853 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f700d849-5328-4762-830e-d6ba1fcfd1ce tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:28.315613 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f700d849-5328-4762-830e-d6ba1fcfd1ce tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:28.316085 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f700d849-5328-4762-830e-d6ba1fcfd1ce tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:28.451747 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f700d849-5328-4762-830e-d6ba1fcfd1ce tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:28.460417 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f700d849-5328-4762-830e-d6ba1fcfd1ce tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.160424 May 03 09:25:28.461016 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1372/2568] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:28 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:29.480360 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-47afc7b7-94b9-41d1-adf1-e97e8caa00ae tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:29.480928 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-47afc7b7-94b9-41d1-adf1-e97e8caa00ae tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:29.487406 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-47afc7b7-94b9-41d1-adf1-e97e8caa00ae tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:29.487895 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-47afc7b7-94b9-41d1-adf1-e97e8caa00ae tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:29.488650 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-47afc7b7-94b9-41d1-adf1-e97e8caa00ae tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:29.489088 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-47afc7b7-94b9-41d1-adf1-e97e8caa00ae tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:29.619621 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-47afc7b7-94b9-41d1-adf1-e97e8caa00ae tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:29.628269 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-47afc7b7-94b9-41d1-adf1-e97e8caa00ae tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.153369 May 03 09:25:29.628846 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1197/2569] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:29 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:30.651884 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3004a35c-3de6-43a5-8895-fe6fa5971e05 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:30.652530 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-3004a35c-3de6-43a5-8895-fe6fa5971e05 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:30.659951 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3004a35c-3de6-43a5-8895-fe6fa5971e05 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:30.660444 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3004a35c-3de6-43a5-8895-fe6fa5971e05 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:30.661271 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3004a35c-3de6-43a5-8895-fe6fa5971e05 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:30.661763 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3004a35c-3de6-43a5-8895-fe6fa5971e05 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:30.800389 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-3004a35c-3de6-43a5-8895-fe6fa5971e05 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:30.808301 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-3004a35c-3de6-43a5-8895-fe6fa5971e05 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.162738 May 03 09:25:30.808855 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1373/2570] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:30 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:31.825918 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2db856d3-1b17-4cad-b407-1e7e0ba62a30 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:31.826552 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-2db856d3-1b17-4cad-b407-1e7e0ba62a30 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:31.833577 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2db856d3-1b17-4cad-b407-1e7e0ba62a30 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:31.834022 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2db856d3-1b17-4cad-b407-1e7e0ba62a30 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:31.834785 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2db856d3-1b17-4cad-b407-1e7e0ba62a30 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:31.835217 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2db856d3-1b17-4cad-b407-1e7e0ba62a30 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:31.982575 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2db856d3-1b17-4cad-b407-1e7e0ba62a30 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:31.991002 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-2db856d3-1b17-4cad-b407-1e7e0ba62a30 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.169074 May 03 09:25:31.991587 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1198/2571] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:31 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:33.013659 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-6efea4d2-b181-4091-bf4f-064d9d8b16cb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:33.014636 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-6efea4d2-b181-4091-bf4f-064d9d8b16cb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:33.025517 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6efea4d2-b181-4091-bf4f-064d9d8b16cb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:33.026288 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6efea4d2-b181-4091-bf4f-064d9d8b16cb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:33.027314 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6efea4d2-b181-4091-bf4f-064d9d8b16cb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:33.027749 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6efea4d2-b181-4091-bf4f-064d9d8b16cb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:33.183872 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-6efea4d2-b181-4091-bf4f-064d9d8b16cb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:33.192487 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-6efea4d2-b181-4091-bf4f-064d9d8b16cb tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.186741 May 03 09:25:33.193098 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1374/2572] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:33 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:34.216112 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5862c16d-ea5b-490b-8214-43e5a265dfd4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:34.216819 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5862c16d-ea5b-490b-8214-43e5a265dfd4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:34.227457 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5862c16d-ea5b-490b-8214-43e5a265dfd4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:34.228283 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5862c16d-ea5b-490b-8214-43e5a265dfd4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:34.229717 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5862c16d-ea5b-490b-8214-43e5a265dfd4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:34.230134 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5862c16d-ea5b-490b-8214-43e5a265dfd4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:34.365948 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5862c16d-ea5b-490b-8214-43e5a265dfd4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:34.374575 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5862c16d-ea5b-490b-8214-43e5a265dfd4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.165291 May 03 09:25:34.375154 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1199/2573] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:34 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:35.395739 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-7cd280a8-1cee-45b9-91d8-c615cb287a45 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:35.396848 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-7cd280a8-1cee-45b9-91d8-c615cb287a45 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:35.409006 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7cd280a8-1cee-45b9-91d8-c615cb287a45 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:35.409805 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7cd280a8-1cee-45b9-91d8-c615cb287a45 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:35.411112 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7cd280a8-1cee-45b9-91d8-c615cb287a45 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:35.411978 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7cd280a8-1cee-45b9-91d8-c615cb287a45 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:35.552713 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7cd280a8-1cee-45b9-91d8-c615cb287a45 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:35.560604 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-7cd280a8-1cee-45b9-91d8-c615cb287a45 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.171943 May 03 09:25:35.561184 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1375/2574] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:35 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:35.846725 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 09:25:35.847310 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: Tue May 3 09:25:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 03 09:25:36.583202 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-301af8b3-5edb-437a-b24a-86a09a7a19e7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:36.584499 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-301af8b3-5edb-437a-b24a-86a09a7a19e7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:36.595263 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-301af8b3-5edb-437a-b24a-86a09a7a19e7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:36.596065 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-301af8b3-5edb-437a-b24a-86a09a7a19e7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:36.597164 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-301af8b3-5edb-437a-b24a-86a09a7a19e7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:36.597597 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-301af8b3-5edb-437a-b24a-86a09a7a19e7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:36.725858 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-301af8b3-5edb-437a-b24a-86a09a7a19e7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:36.737484 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-301af8b3-5edb-437a-b24a-86a09a7a19e7 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.160923 May 03 09:25:36.738033 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1200/2575] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:36 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:37.758424 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-fc4af397-2d15-4ba3-9029-b1e272015601 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:37.759545 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-fc4af397-2d15-4ba3-9029-b1e272015601 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:37.769808 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fc4af397-2d15-4ba3-9029-b1e272015601 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:37.770259 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fc4af397-2d15-4ba3-9029-b1e272015601 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:37.771026 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fc4af397-2d15-4ba3-9029-b1e272015601 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:37.771470 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-fc4af397-2d15-4ba3-9029-b1e272015601 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:37.896488 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-fc4af397-2d15-4ba3-9029-b1e272015601 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:37.904330 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-fc4af397-2d15-4ba3-9029-b1e272015601 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.152440 May 03 09:25:37.904875 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1376/2576] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:37 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:38.922812 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a4b782f1-5960-4fdf-bb8b-43c726ceea41 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:38.923437 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a4b782f1-5960-4fdf-bb8b-43c726ceea41 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:38.930699 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a4b782f1-5960-4fdf-bb8b-43c726ceea41 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:38.931151 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a4b782f1-5960-4fdf-bb8b-43c726ceea41 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:38.931953 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a4b782f1-5960-4fdf-bb8b-43c726ceea41 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:38.932390 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a4b782f1-5960-4fdf-bb8b-43c726ceea41 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:39.063128 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a4b782f1-5960-4fdf-bb8b-43c726ceea41 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:39.071535 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a4b782f1-5960-4fdf-bb8b-43c726ceea41 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.152669 May 03 09:25:39.072159 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1201/2577] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:38 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:40.093439 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-cfc283c9-3c82-4a81-b548-977133831500 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:40.094422 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-cfc283c9-3c82-4a81-b548-977133831500 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:40.102251 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cfc283c9-3c82-4a81-b548-977133831500 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:40.102703 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cfc283c9-3c82-4a81-b548-977133831500 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:40.103462 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cfc283c9-3c82-4a81-b548-977133831500 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:40.103939 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cfc283c9-3c82-4a81-b548-977133831500 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:40.238069 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-cfc283c9-3c82-4a81-b548-977133831500 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:40.246317 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-cfc283c9-3c82-4a81-b548-977133831500 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.159620 May 03 09:25:40.246888 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1377/2578] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:40 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:41.264239 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7a0a2ef8-d8a2-42f7-91a3-db2bc1357770 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:41.264839 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7a0a2ef8-d8a2-42f7-91a3-db2bc1357770 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:41.271923 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7a0a2ef8-d8a2-42f7-91a3-db2bc1357770 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:41.272371 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7a0a2ef8-d8a2-42f7-91a3-db2bc1357770 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:41.273133 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7a0a2ef8-d8a2-42f7-91a3-db2bc1357770 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:41.273564 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7a0a2ef8-d8a2-42f7-91a3-db2bc1357770 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:41.411019 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7a0a2ef8-d8a2-42f7-91a3-db2bc1357770 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:41.419172 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7a0a2ef8-d8a2-42f7-91a3-db2bc1357770 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.159016 May 03 09:25:41.419749 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1202/2579] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:41 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:42.437149 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-395b5b3f-dfcc-43b4-81b9-3323ea9cef4d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:42.437758 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-395b5b3f-dfcc-43b4-81b9-3323ea9cef4d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:42.444513 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-395b5b3f-dfcc-43b4-81b9-3323ea9cef4d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:42.444962 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-395b5b3f-dfcc-43b4-81b9-3323ea9cef4d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:42.445724 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-395b5b3f-dfcc-43b4-81b9-3323ea9cef4d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:42.446157 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-395b5b3f-dfcc-43b4-81b9-3323ea9cef4d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:42.577600 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-395b5b3f-dfcc-43b4-81b9-3323ea9cef4d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:42.585858 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-395b5b3f-dfcc-43b4-81b9-3323ea9cef4d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.152683 May 03 09:25:42.586426 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1378/2580] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:42 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:43.607274 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-3e511197-7848-4291-971c-758498719cf2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:43.608261 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-3e511197-7848-4291-971c-758498719cf2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:43.617595 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3e511197-7848-4291-971c-758498719cf2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:43.618050 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3e511197-7848-4291-971c-758498719cf2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:43.618842 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3e511197-7848-4291-971c-758498719cf2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:43.619276 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3e511197-7848-4291-971c-758498719cf2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:43.763278 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-3e511197-7848-4291-971c-758498719cf2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:43.772142 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-3e511197-7848-4291-971c-758498719cf2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.171455 May 03 09:25:43.772713 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1203/2581] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:43 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:44.790777 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-2f1f0acd-3286-4569-89cd-c988d477019e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:44.791379 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-2f1f0acd-3286-4569-89cd-c988d477019e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:44.800304 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2f1f0acd-3286-4569-89cd-c988d477019e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:44.801034 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2f1f0acd-3286-4569-89cd-c988d477019e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:44.802251 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2f1f0acd-3286-4569-89cd-c988d477019e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:44.802949 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2f1f0acd-3286-4569-89cd-c988d477019e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:44.941910 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-2f1f0acd-3286-4569-89cd-c988d477019e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:44.950233 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-2f1f0acd-3286-4569-89cd-c988d477019e tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.163923 May 03 09:25:44.950804 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1379/2582] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:44 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:45.972257 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f3a6ea63-2d4d-40c7-8185-4d85cb5dd280 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:45.973277 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f3a6ea63-2d4d-40c7-8185-4d85cb5dd280 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:45.986634 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f3a6ea63-2d4d-40c7-8185-4d85cb5dd280 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:45.987533 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f3a6ea63-2d4d-40c7-8185-4d85cb5dd280 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:45.988891 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f3a6ea63-2d4d-40c7-8185-4d85cb5dd280 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:45.989618 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f3a6ea63-2d4d-40c7-8185-4d85cb5dd280 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:46.135615 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f3a6ea63-2d4d-40c7-8185-4d85cb5dd280 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:46.147943 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f3a6ea63-2d4d-40c7-8185-4d85cb5dd280 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.181970 May 03 09:25:46.148708 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1204/2583] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:45 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:47.174212 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-6b0b381c-763f-4c14-b216-22b5e791a092 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:47.175125 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-6b0b381c-763f-4c14-b216-22b5e791a092 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:47.183009 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6b0b381c-763f-4c14-b216-22b5e791a092 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:47.183462 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6b0b381c-763f-4c14-b216-22b5e791a092 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:47.184260 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6b0b381c-763f-4c14-b216-22b5e791a092 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:47.184695 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6b0b381c-763f-4c14-b216-22b5e791a092 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:47.331528 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-6b0b381c-763f-4c14-b216-22b5e791a092 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:47.339806 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-6b0b381c-763f-4c14-b216-22b5e791a092 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.172307 May 03 09:25:47.340353 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1380/2584] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:47 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:48.361686 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-12453025-5cb7-45d2-9e25-31a824568460 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:48.362788 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-12453025-5cb7-45d2-9e25-31a824568460 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:48.373801 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-12453025-5cb7-45d2-9e25-31a824568460 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:48.374534 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-12453025-5cb7-45d2-9e25-31a824568460 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:48.375817 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-12453025-5cb7-45d2-9e25-31a824568460 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:48.376561 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-12453025-5cb7-45d2-9e25-31a824568460 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:48.518466 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-12453025-5cb7-45d2-9e25-31a824568460 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:48.527423 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-12453025-5cb7-45d2-9e25-31a824568460 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.172596 May 03 09:25:48.528186 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1205/2585] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:48 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:49.549513 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-2f693257-1c41-407d-95c7-ee413cf17437 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:49.550444 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-2f693257-1c41-407d-95c7-ee413cf17437 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:49.558297 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2f693257-1c41-407d-95c7-ee413cf17437 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:49.558755 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2f693257-1c41-407d-95c7-ee413cf17437 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:49.559517 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2f693257-1c41-407d-95c7-ee413cf17437 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:49.560008 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2f693257-1c41-407d-95c7-ee413cf17437 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:49.697910 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-2f693257-1c41-407d-95c7-ee413cf17437 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:49.706470 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-2f693257-1c41-407d-95c7-ee413cf17437 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.163776 May 03 09:25:49.707050 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1381/2586] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:49 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:50.726882 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5409be50-52c4-4f2c-8a60-2dff8f2be94a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:50.727574 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5409be50-52c4-4f2c-8a60-2dff8f2be94a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:50.734813 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5409be50-52c4-4f2c-8a60-2dff8f2be94a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:50.735267 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5409be50-52c4-4f2c-8a60-2dff8f2be94a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:50.736088 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5409be50-52c4-4f2c-8a60-2dff8f2be94a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:50.736524 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5409be50-52c4-4f2c-8a60-2dff8f2be94a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:50.890512 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5409be50-52c4-4f2c-8a60-2dff8f2be94a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:50.900942 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5409be50-52c4-4f2c-8a60-2dff8f2be94a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.180363 May 03 09:25:50.901507 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1206/2587] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:50 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:51.920235 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c86e116c-fd49-4193-92be-ed7ffb8c8020 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:51.920873 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c86e116c-fd49-4193-92be-ed7ffb8c8020 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:51.928371 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c86e116c-fd49-4193-92be-ed7ffb8c8020 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:51.929011 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c86e116c-fd49-4193-92be-ed7ffb8c8020 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:51.929831 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c86e116c-fd49-4193-92be-ed7ffb8c8020 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:51.930353 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c86e116c-fd49-4193-92be-ed7ffb8c8020 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:52.078902 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c86e116c-fd49-4193-92be-ed7ffb8c8020 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:52.087933 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c86e116c-fd49-4193-92be-ed7ffb8c8020 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.171687 May 03 09:25:52.088524 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1382/2588] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:51 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:53.105660 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-dbba8e3e-9c04-4b71-aa5b-c3c71cd2efd6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:53.106284 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-dbba8e3e-9c04-4b71-aa5b-c3c71cd2efd6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:53.112798 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dbba8e3e-9c04-4b71-aa5b-c3c71cd2efd6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:53.113234 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dbba8e3e-9c04-4b71-aa5b-c3c71cd2efd6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:53.114007 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dbba8e3e-9c04-4b71-aa5b-c3c71cd2efd6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:53.114439 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dbba8e3e-9c04-4b71-aa5b-c3c71cd2efd6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:53.248235 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-dbba8e3e-9c04-4b71-aa5b-c3c71cd2efd6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:53.256465 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-dbba8e3e-9c04-4b71-aa5b-c3c71cd2efd6 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.154726 May 03 09:25:53.257127 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1207/2589] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:53 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:54.278569 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-002c039b-3f91-4b4b-8990-e757f4441093 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:54.279560 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-002c039b-3f91-4b4b-8990-e757f4441093 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:54.289513 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-002c039b-3f91-4b4b-8990-e757f4441093 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:54.289950 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-002c039b-3f91-4b4b-8990-e757f4441093 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:54.290707 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-002c039b-3f91-4b4b-8990-e757f4441093 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:54.291135 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-002c039b-3f91-4b4b-8990-e757f4441093 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:54.422740 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-002c039b-3f91-4b4b-8990-e757f4441093 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:54.431076 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-002c039b-3f91-4b4b-8990-e757f4441093 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.159144 May 03 09:25:54.431663 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1383/2590] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:54 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:55.452658 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-19d340ed-8a5e-4712-978c-a1e22f7876cc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:55.453622 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-19d340ed-8a5e-4712-978c-a1e22f7876cc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:55.462807 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-19d340ed-8a5e-4712-978c-a1e22f7876cc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:55.463256 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-19d340ed-8a5e-4712-978c-a1e22f7876cc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:55.464055 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-19d340ed-8a5e-4712-978c-a1e22f7876cc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:55.464490 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-19d340ed-8a5e-4712-978c-a1e22f7876cc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:55.615569 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-19d340ed-8a5e-4712-978c-a1e22f7876cc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:55.623809 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-19d340ed-8a5e-4712-978c-a1e22f7876cc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.177919 May 03 09:25:55.624406 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1208/2591] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:55 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:56.645761 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c6337084-893b-4564-aab6-27dc98fefe20 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:56.646698 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c6337084-893b-4564-aab6-27dc98fefe20 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:56.657137 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c6337084-893b-4564-aab6-27dc98fefe20 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:56.657886 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c6337084-893b-4564-aab6-27dc98fefe20 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:56.659152 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c6337084-893b-4564-aab6-27dc98fefe20 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:56.659978 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c6337084-893b-4564-aab6-27dc98fefe20 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:56.792269 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c6337084-893b-4564-aab6-27dc98fefe20 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:56.800541 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c6337084-893b-4564-aab6-27dc98fefe20 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.161617 May 03 09:25:56.801115 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1384/2592] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:56 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:57.822433 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b8e8cb9e-aa0b-42a2-8bfa-6f8c9c175d29 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:57.823318 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b8e8cb9e-aa0b-42a2-8bfa-6f8c9c175d29 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:57.834319 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b8e8cb9e-aa0b-42a2-8bfa-6f8c9c175d29 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:57.835071 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b8e8cb9e-aa0b-42a2-8bfa-6f8c9c175d29 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:57.836437 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b8e8cb9e-aa0b-42a2-8bfa-6f8c9c175d29 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:57.837118 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b8e8cb9e-aa0b-42a2-8bfa-6f8c9c175d29 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:57.979429 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b8e8cb9e-aa0b-42a2-8bfa-6f8c9c175d29 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:57.988774 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b8e8cb9e-aa0b-42a2-8bfa-6f8c9c175d29 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.173323 May 03 09:25:57.989305 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1209/2593] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:57 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:25:59.014813 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-8ad0f6b5-0cc2-4c43-995c-1b91d2b11604 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:25:59.016446 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-8ad0f6b5-0cc2-4c43-995c-1b91d2b11604 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:25:59.027439 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8ad0f6b5-0cc2-4c43-995c-1b91d2b11604 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:59.027939 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8ad0f6b5-0cc2-4c43-995c-1b91d2b11604 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:59.028708 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8ad0f6b5-0cc2-4c43-995c-1b91d2b11604 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:25:59.029146 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8ad0f6b5-0cc2-4c43-995c-1b91d2b11604 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:25:59.176677 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-8ad0f6b5-0cc2-4c43-995c-1b91d2b11604 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:25:59.186578 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-8ad0f6b5-0cc2-4c43-995c-1b91d2b11604 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.182495 May 03 09:25:59.187158 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1385/2594] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:25:59 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:26:00.205544 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f00a810b-a42b-4102-9b36-825a9ccfc84d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:26:00.206142 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f00a810b-a42b-4102-9b36-825a9ccfc84d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:26:00.213327 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f00a810b-a42b-4102-9b36-825a9ccfc84d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:00.213806 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f00a810b-a42b-4102-9b36-825a9ccfc84d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:00.214600 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f00a810b-a42b-4102-9b36-825a9ccfc84d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:00.215661 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f00a810b-a42b-4102-9b36-825a9ccfc84d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:00.348917 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f00a810b-a42b-4102-9b36-825a9ccfc84d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:26:00.357240 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f00a810b-a42b-4102-9b36-825a9ccfc84d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.156300 May 03 09:26:00.357784 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1210/2595] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:26:00 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:26:01.375144 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-73e45dc0-4cbd-40bf-86e2-c0e25d61f828 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:26:01.375804 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-73e45dc0-4cbd-40bf-86e2-c0e25d61f828 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:26:01.382280 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-73e45dc0-4cbd-40bf-86e2-c0e25d61f828 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:01.382709 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-73e45dc0-4cbd-40bf-86e2-c0e25d61f828 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:01.383459 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-73e45dc0-4cbd-40bf-86e2-c0e25d61f828 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:01.383918 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-73e45dc0-4cbd-40bf-86e2-c0e25d61f828 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:01.514904 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-73e45dc0-4cbd-40bf-86e2-c0e25d61f828 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:26:01.522975 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-73e45dc0-4cbd-40bf-86e2-c0e25d61f828 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.151990 May 03 09:26:01.523553 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1386/2596] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:26:01 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:26:02.541010 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-85ebdc06-2666-4851-bf92-60ccecb052c3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:26:02.541532 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-85ebdc06-2666-4851-bf92-60ccecb052c3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:26:02.548400 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-85ebdc06-2666-4851-bf92-60ccecb052c3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:02.548845 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-85ebdc06-2666-4851-bf92-60ccecb052c3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:02.549600 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-85ebdc06-2666-4851-bf92-60ccecb052c3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:02.550030 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-85ebdc06-2666-4851-bf92-60ccecb052c3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:02.682908 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-85ebdc06-2666-4851-bf92-60ccecb052c3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:26:02.692539 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-85ebdc06-2666-4851-bf92-60ccecb052c3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.155622 May 03 09:26:02.693081 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1211/2597] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:26:02 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:26:03.829309 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c2a5c839-4f2c-4c5d-b5a0-9008bc0e5551 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:26:03.829937 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c2a5c839-4f2c-4c5d-b5a0-9008bc0e5551 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:26:03.836074 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c2a5c839-4f2c-4c5d-b5a0-9008bc0e5551 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:03.836528 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c2a5c839-4f2c-4c5d-b5a0-9008bc0e5551 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:03.837278 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c2a5c839-4f2c-4c5d-b5a0-9008bc0e5551 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:03.837691 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c2a5c839-4f2c-4c5d-b5a0-9008bc0e5551 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:03.973552 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c2a5c839-4f2c-4c5d-b5a0-9008bc0e5551 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:26:03.981939 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c2a5c839-4f2c-4c5d-b5a0-9008bc0e5551 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.274408 May 03 09:26:03.982554 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1387/2598] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:26:03 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:26:05.002186 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c8592842-1343-486c-9dd4-3b72849333ff tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:26:05.002895 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c8592842-1343-486c-9dd4-3b72849333ff tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:26:05.010746 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c8592842-1343-486c-9dd4-3b72849333ff tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:05.011276 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c8592842-1343-486c-9dd4-3b72849333ff tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:05.012220 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c8592842-1343-486c-9dd4-3b72849333ff tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:05.012728 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c8592842-1343-486c-9dd4-3b72849333ff tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:05.144133 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c8592842-1343-486c-9dd4-3b72849333ff tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:26:05.152104 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c8592842-1343-486c-9dd4-3b72849333ff tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.156137 May 03 09:26:05.152646 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1212/2599] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:26:04 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:26:06.169245 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b22cd7a3-1e69-49b9-b3b7-7b051dc4eb84 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:26:06.169840 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b22cd7a3-1e69-49b9-b3b7-7b051dc4eb84 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:26:06.176361 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b22cd7a3-1e69-49b9-b3b7-7b051dc4eb84 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:06.176811 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b22cd7a3-1e69-49b9-b3b7-7b051dc4eb84 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:06.177544 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b22cd7a3-1e69-49b9-b3b7-7b051dc4eb84 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:06.177977 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b22cd7a3-1e69-49b9-b3b7-7b051dc4eb84 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:06.333867 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b22cd7a3-1e69-49b9-b3b7-7b051dc4eb84 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:26:06.346109 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b22cd7a3-1e69-49b9-b3b7-7b051dc4eb84 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.180737 May 03 09:26:06.346683 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1388/2600] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:26:06 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:26:07.366712 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-605afc2f-d006-4da6-bc70-7ad1fb404c57 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:26:07.367667 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-605afc2f-d006-4da6-bc70-7ad1fb404c57 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:26:07.377505 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-605afc2f-d006-4da6-bc70-7ad1fb404c57 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:07.377955 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-605afc2f-d006-4da6-bc70-7ad1fb404c57 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:07.378711 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-605afc2f-d006-4da6-bc70-7ad1fb404c57 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:07.379149 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-605afc2f-d006-4da6-bc70-7ad1fb404c57 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:07.516414 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-605afc2f-d006-4da6-bc70-7ad1fb404c57 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:26:07.525573 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-605afc2f-d006-4da6-bc70-7ad1fb404c57 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.165560 May 03 09:26:07.526166 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1213/2601] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:26:07 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:26:08.546954 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5416965f-ee40-4aa3-80f8-aa4ab6eebf70 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:26:08.548009 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5416965f-ee40-4aa3-80f8-aa4ab6eebf70 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:26:08.556308 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5416965f-ee40-4aa3-80f8-aa4ab6eebf70 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:08.556864 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5416965f-ee40-4aa3-80f8-aa4ab6eebf70 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:08.557799 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5416965f-ee40-4aa3-80f8-aa4ab6eebf70 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:08.558336 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5416965f-ee40-4aa3-80f8-aa4ab6eebf70 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:08.702232 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5416965f-ee40-4aa3-80f8-aa4ab6eebf70 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:26:08.711006 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5416965f-ee40-4aa3-80f8-aa4ab6eebf70 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.170658 May 03 09:26:08.711578 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1389/2602] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:26:08 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:26:09.732312 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-bcb39da0-59c1-448b-9fcc-909bd580f095 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:26:09.733352 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-bcb39da0-59c1-448b-9fcc-909bd580f095 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:26:09.741185 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bcb39da0-59c1-448b-9fcc-909bd580f095 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:09.741652 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bcb39da0-59c1-448b-9fcc-909bd580f095 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:09.742423 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bcb39da0-59c1-448b-9fcc-909bd580f095 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:09.742858 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bcb39da0-59c1-448b-9fcc-909bd580f095 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:09.884132 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-bcb39da0-59c1-448b-9fcc-909bd580f095 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:26:09.892815 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-bcb39da0-59c1-448b-9fcc-909bd580f095 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.167092 May 03 09:26:09.893402 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1214/2603] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:26:09 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:26:10.910666 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9be189d3-13e7-4443-bdfc-7a2d02652c32 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:26:10.911439 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9be189d3-13e7-4443-bdfc-7a2d02652c32 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:26:10.918014 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9be189d3-13e7-4443-bdfc-7a2d02652c32 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:10.918458 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9be189d3-13e7-4443-bdfc-7a2d02652c32 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:10.919235 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9be189d3-13e7-4443-bdfc-7a2d02652c32 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:10.919717 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9be189d3-13e7-4443-bdfc-7a2d02652c32 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:11.056803 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9be189d3-13e7-4443-bdfc-7a2d02652c32 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:26:11.067065 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9be189d3-13e7-4443-bdfc-7a2d02652c32 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.160563 May 03 09:26:11.067659 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1390/2604] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:26:10 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:26:12.086252 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-dc6716cd-e8b6-47d4-9842-d1b7be35d1dc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:26:12.087280 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-dc6716cd-e8b6-47d4-9842-d1b7be35d1dc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:26:12.095375 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dc6716cd-e8b6-47d4-9842-d1b7be35d1dc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:12.096004 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dc6716cd-e8b6-47d4-9842-d1b7be35d1dc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:12.096878 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dc6716cd-e8b6-47d4-9842-d1b7be35d1dc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:12.097512 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dc6716cd-e8b6-47d4-9842-d1b7be35d1dc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:12.231791 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-dc6716cd-e8b6-47d4-9842-d1b7be35d1dc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:26:12.240450 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-dc6716cd-e8b6-47d4-9842-d1b7be35d1dc tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.158521 May 03 09:26:12.241027 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1215/2605] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:26:12 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:26:13.258582 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-37522308-cdbe-4c1b-ae3e-aff0b1eeaa8f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:26:13.259445 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-37522308-cdbe-4c1b-ae3e-aff0b1eeaa8f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:26:13.266244 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-37522308-cdbe-4c1b-ae3e-aff0b1eeaa8f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:13.266691 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-37522308-cdbe-4c1b-ae3e-aff0b1eeaa8f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:13.267470 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-37522308-cdbe-4c1b-ae3e-aff0b1eeaa8f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:13.267967 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-37522308-cdbe-4c1b-ae3e-aff0b1eeaa8f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:13.401451 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-37522308-cdbe-4c1b-ae3e-aff0b1eeaa8f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:26:13.410725 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-37522308-cdbe-4c1b-ae3e-aff0b1eeaa8f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.156176 May 03 09:26:13.411472 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1391/2606] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:26:13 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:26:14.430175 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-3aac62b0-910c-454e-9b07-0f7813f3bfb9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:26:14.430865 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-3aac62b0-910c-454e-9b07-0f7813f3bfb9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:26:14.437554 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3aac62b0-910c-454e-9b07-0f7813f3bfb9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:14.438010 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3aac62b0-910c-454e-9b07-0f7813f3bfb9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:14.438798 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3aac62b0-910c-454e-9b07-0f7813f3bfb9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:14.439234 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3aac62b0-910c-454e-9b07-0f7813f3bfb9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:14.570273 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-3aac62b0-910c-454e-9b07-0f7813f3bfb9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:26:14.578282 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-3aac62b0-910c-454e-9b07-0f7813f3bfb9 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.152072 May 03 09:26:14.579355 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1216/2607] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:26:14 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:26:15.596379 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ec1b7aca-f9f0-4a53-81db-934bff0e5545 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:26:15.596964 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ec1b7aca-f9f0-4a53-81db-934bff0e5545 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:26:15.603851 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ec1b7aca-f9f0-4a53-81db-934bff0e5545 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:15.604300 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ec1b7aca-f9f0-4a53-81db-934bff0e5545 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:15.605064 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ec1b7aca-f9f0-4a53-81db-934bff0e5545 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:15.605495 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ec1b7aca-f9f0-4a53-81db-934bff0e5545 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:15.743273 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ec1b7aca-f9f0-4a53-81db-934bff0e5545 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:26:15.752184 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ec1b7aca-f9f0-4a53-81db-934bff0e5545 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.159773 May 03 09:26:15.752785 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1392/2608] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:26:15 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:26:16.771914 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f531ebe1-9a72-429e-af80-a2762152f9b4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:26:16.772506 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f531ebe1-9a72-429e-af80-a2762152f9b4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:26:16.778984 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f531ebe1-9a72-429e-af80-a2762152f9b4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:16.779407 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f531ebe1-9a72-429e-af80-a2762152f9b4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:16.780187 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f531ebe1-9a72-429e-af80-a2762152f9b4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:16.780616 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f531ebe1-9a72-429e-af80-a2762152f9b4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:16.908156 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f531ebe1-9a72-429e-af80-a2762152f9b4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:26:16.916140 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f531ebe1-9a72-429e-af80-a2762152f9b4 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.148212 May 03 09:26:16.916708 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1217/2609] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:26:16 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:26:17.933956 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-1f8a9408-a60f-4817-a150-9cad0d134c12 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:26:17.934611 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-1f8a9408-a60f-4817-a150-9cad0d134c12 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:26:17.941430 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1f8a9408-a60f-4817-a150-9cad0d134c12 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:17.941893 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1f8a9408-a60f-4817-a150-9cad0d134c12 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:17.942737 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1f8a9408-a60f-4817-a150-9cad0d134c12 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:17.943174 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1f8a9408-a60f-4817-a150-9cad0d134c12 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:18.080242 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-1f8a9408-a60f-4817-a150-9cad0d134c12 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:26:18.088706 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-1f8a9408-a60f-4817-a150-9cad0d134c12 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.159020 May 03 09:26:18.089260 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1393/2610] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:26:17 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:26:19.106717 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-94126468-9e9a-43fb-8351-05cabeaa0973 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:26:19.107371 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-94126468-9e9a-43fb-8351-05cabeaa0973 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:26:19.114992 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-94126468-9e9a-43fb-8351-05cabeaa0973 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:19.115490 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-94126468-9e9a-43fb-8351-05cabeaa0973 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:19.116479 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-94126468-9e9a-43fb-8351-05cabeaa0973 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:19.116970 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-94126468-9e9a-43fb-8351-05cabeaa0973 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:19.250559 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-94126468-9e9a-43fb-8351-05cabeaa0973 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:26:19.259971 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-94126468-9e9a-43fb-8351-05cabeaa0973 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.157697 May 03 09:26:19.260669 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1218/2611] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:26:19 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:26:20.277659 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-10dca000-5ec6-4015-89da-091709b10fb5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:26:20.278253 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-10dca000-5ec6-4015-89da-091709b10fb5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:26:20.285068 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-10dca000-5ec6-4015-89da-091709b10fb5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:20.285524 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-10dca000-5ec6-4015-89da-091709b10fb5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:20.286293 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-10dca000-5ec6-4015-89da-091709b10fb5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:20.286789 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-10dca000-5ec6-4015-89da-091709b10fb5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:20.414793 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-10dca000-5ec6-4015-89da-091709b10fb5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:26:20.422839 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-10dca000-5ec6-4015-89da-091709b10fb5 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.149139 May 03 09:26:20.423382 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1394/2612] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:26:20 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:26:21.440348 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e1704c5e-5c97-4641-bf11-b31ad7481392 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:26:21.440955 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e1704c5e-5c97-4641-bf11-b31ad7481392 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:26:21.447583 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e1704c5e-5c97-4641-bf11-b31ad7481392 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:21.448063 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e1704c5e-5c97-4641-bf11-b31ad7481392 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:21.448819 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e1704c5e-5c97-4641-bf11-b31ad7481392 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:21.449242 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e1704c5e-5c97-4641-bf11-b31ad7481392 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:21.581662 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e1704c5e-5c97-4641-bf11-b31ad7481392 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:26:21.589968 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e1704c5e-5c97-4641-bf11-b31ad7481392 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.153685 May 03 09:26:21.590553 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1219/2613] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:26:21 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:26:22.607499 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-0c9c9f9e-8a84-4b27-a03e-11404c3fbf5d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:26:22.608097 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-0c9c9f9e-8a84-4b27-a03e-11404c3fbf5d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:26:22.614919 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0c9c9f9e-8a84-4b27-a03e-11404c3fbf5d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:22.615366 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0c9c9f9e-8a84-4b27-a03e-11404c3fbf5d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:22.616173 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0c9c9f9e-8a84-4b27-a03e-11404c3fbf5d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:22.616608 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0c9c9f9e-8a84-4b27-a03e-11404c3fbf5d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:22.744785 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-0c9c9f9e-8a84-4b27-a03e-11404c3fbf5d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:26:22.752845 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-0c9c9f9e-8a84-4b27-a03e-11404c3fbf5d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.149388 May 03 09:26:22.753409 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1395/2614] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:26:22 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:26:23.770227 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6b37385d-3244-43a2-a171-9c9e65f1eebf tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:26:23.770951 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6b37385d-3244-43a2-a171-9c9e65f1eebf tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:26:23.777284 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6b37385d-3244-43a2-a171-9c9e65f1eebf tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:23.777728 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6b37385d-3244-43a2-a171-9c9e65f1eebf tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:23.778491 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6b37385d-3244-43a2-a171-9c9e65f1eebf tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:23.778925 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6b37385d-3244-43a2-a171-9c9e65f1eebf tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:23.922904 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6b37385d-3244-43a2-a171-9c9e65f1eebf tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:26:23.931322 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6b37385d-3244-43a2-a171-9c9e65f1eebf tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.165092 May 03 09:26:23.931899 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1220/2615] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:26:23 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:26:24.949564 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9706cb1c-a6b2-47e2-8899-1860029417b2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:26:24.950186 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9706cb1c-a6b2-47e2-8899-1860029417b2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:26:24.957425 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9706cb1c-a6b2-47e2-8899-1860029417b2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:24.957877 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9706cb1c-a6b2-47e2-8899-1860029417b2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:24.958678 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9706cb1c-a6b2-47e2-8899-1860029417b2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:24.959109 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9706cb1c-a6b2-47e2-8899-1860029417b2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:25.087554 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9706cb1c-a6b2-47e2-8899-1860029417b2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:26:25.095855 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9706cb1c-a6b2-47e2-8899-1860029417b2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.150189 May 03 09:26:25.096616 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1396/2616] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:26:24 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:26:26.113892 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-3ce75568-0491-45a8-b105-c221b6df73ef tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:26:26.114615 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-3ce75568-0491-45a8-b105-c221b6df73ef tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:26:26.121059 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3ce75568-0491-45a8-b105-c221b6df73ef tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:26.121484 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3ce75568-0491-45a8-b105-c221b6df73ef tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:26.122237 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3ce75568-0491-45a8-b105-c221b6df73ef tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:26.122667 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3ce75568-0491-45a8-b105-c221b6df73ef tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:26.260602 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-3ce75568-0491-45a8-b105-c221b6df73ef tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:26:26.269045 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-3ce75568-0491-45a8-b105-c221b6df73ef tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.159508 May 03 09:26:26.269629 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1221/2617] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:26:26 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:26:27.286540 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5e304e58-5ba0-4750-8933-818adf3c34d3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:26:27.287205 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5e304e58-5ba0-4750-8933-818adf3c34d3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:26:27.293649 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5e304e58-5ba0-4750-8933-818adf3c34d3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:27.294101 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5e304e58-5ba0-4750-8933-818adf3c34d3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:27.294866 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5e304e58-5ba0-4750-8933-818adf3c34d3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:27.295302 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5e304e58-5ba0-4750-8933-818adf3c34d3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:27.430298 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5e304e58-5ba0-4750-8933-818adf3c34d3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:26:27.438456 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5e304e58-5ba0-4750-8933-818adf3c34d3 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.156238 May 03 09:26:27.439034 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1397/2618] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:26:27 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:26:28.456412 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9b274283-4f54-494a-9e25-879f7887ce8f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:26:28.457127 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9b274283-4f54-494a-9e25-879f7887ce8f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: 512c1f04-399e-4647-8bfe-f2c295397df2] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:26:28.463874 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9b274283-4f54-494a-9e25-879f7887ce8f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:28.464269 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9b274283-4f54-494a-9e25-879f7887ce8f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:28.465007 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9b274283-4f54-494a-9e25-879f7887ce8f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:28.465465 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9b274283-4f54-494a-9e25-879f7887ce8f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:28.597258 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9b274283-4f54-494a-9e25-879f7887ce8f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:26:28.605758 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9b274283-4f54-494a-9e25-879f7887ce8f tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2" status: 200 len: 1732 microversion: 2.1 time: 0.153702 May 03 09:26:28.606385 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1222/2619] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:26:28 2022] GET /compute/v2.1/servers/512c1f04-399e-4647-8bfe-f2c295397df2 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:26:28.623257 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9593302e-405d-411f-86e1-89aeb456251d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '.version_select at 0x7f09d3473310>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:26:28.626608 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9593302e-405d-411f-86e1-89aeb456251d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [fb140483-b012-46c4-bd94-2d7ecd436429] AMQP server on 10.222.0.11:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 03 09:26:29.636334 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO oslo.messaging._drivers.impl_rabbit [None req-9593302e-405d-411f-86e1-89aeb456251d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [fb140483-b012-46c4-bd94-2d7ecd436429] Reconnected to AMQP server on 10.222.0.11:5672 via [amqp] client with port 34464. May 03 09:26:29.657612 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9593302e-405d-411f-86e1-89aeb456251d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-240125214" status: 202 len: 0 microversion: 2.1 time: 1.038876 May 03 09:26:29.658213 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1398/2620] 10.222.0.11 () {58 vars in 1217 bytes} [Tue May 3 09:26:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-240125214 => generated 0 bytes in 1040 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 09:26:30.572349 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-eaf7809f-1121-4bb9-a95c-c1add9ef62f1 req-e992f924-d546-4f98-ba18-319a50b54329 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "512c1f04-399e-4647-8bfe-f2c295397df2", "tag": "fa2818f3-6dd4-4c2e-8c03-d124c2ac8ac8"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:26:30.581616 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-eaf7809f-1121-4bb9-a95c-c1add9ef62f1 req-e992f924-d546-4f98-ba18-319a50b54329 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:26:30.582111 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-eaf7809f-1121-4bb9-a95c-c1add9ef62f1 req-e992f924-d546-4f98-ba18-319a50b54329 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:26:30.593891 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-eaf7809f-1121-4bb9-a95c-c1add9ef62f1 req-e992f924-d546-4f98-ba18-319a50b54329 service nova] Creating event network-changed:fa2818f3-6dd4-4c2e-8c03-d124c2ac8ac8 for instance 512c1f04-399e-4647-8bfe-f2c295397df2 on hv-cinder-84027 May 03 09:26:30.597481 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: ERROR oslo.messaging._drivers.impl_rabbit [req-eaf7809f-1121-4bb9-a95c-c1add9ef62f1 req-e992f924-d546-4f98-ba18-319a50b54329 service nova] [e04e2d7e-dc18-4c93-8cc1-c54cc5ace650] AMQP server on 10.222.0.11:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 03 09:26:31.605534 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO oslo.messaging._drivers.impl_rabbit [req-eaf7809f-1121-4bb9-a95c-c1add9ef62f1 req-e992f924-d546-4f98-ba18-319a50b54329 service nova] [e04e2d7e-dc18-4c93-8cc1-c54cc5ace650] Reconnected to AMQP server on 10.222.0.11:5672 via [amqp] client with port 34476. May 03 09:26:31.610110 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-eaf7809f-1121-4bb9-a95c-c1add9ef62f1 req-e992f924-d546-4f98-ba18-319a50b54329 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.041643 May 03 09:26:31.610762 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1223/2621] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:26:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:27:03.626228 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 09:27:03.627364 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: Tue May 3 09:27:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 03 09:28:02.724984 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5171f508-01dc-43e8-be0c-c552110e72d0] AMQP server on 10.222.0.11:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 03 09:28:02.730472 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-2ac7ba42-c044-4882-8812-55f5e068c602 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:02.730941 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-2ac7ba42-c044-4882-8812-55f5e068c602 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:02.755800 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-fd281f60-7e86-4c47-b18b-f301c4991f1c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:02.757034 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-fd281f60-7e86-4c47-b18b-f301c4991f1c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:02.759272 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2ac7ba42-c044-4882-8812-55f5e068c602 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:02.759980 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2ac7ba42-c044-4882-8812-55f5e068c602 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:02.763702 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2ac7ba42-c044-4882-8812-55f5e068c602 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:02.764450 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2ac7ba42-c044-4882-8812-55f5e068c602 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:02.769886 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fd281f60-7e86-4c47-b18b-f301c4991f1c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:02.770377 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fd281f60-7e86-4c47-b18b-f301c4991f1c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:02.771297 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fd281f60-7e86-4c47-b18b-f301c4991f1c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:02.771868 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fd281f60-7e86-4c47-b18b-f301c4991f1c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:02.807920 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-2ac7ba42-c044-4882-8812-55f5e068c602 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Going to try to terminate instance {{(pid=123391) delete /opt/stack/nova/nova/compute/api.py:2664}} May 03 09:28:02.850830 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-fd281f60-7e86-4c47-b18b-f301c4991f1c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Going to try to terminate instance {{(pid=123392) delete /opt/stack/nova/nova/compute/api.py:2664}} May 03 09:28:02.895907 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-2ac7ba42-c044-4882-8812-55f5e068c602 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "DELETE /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 204 len: 0 microversion: 2.20 time: 0.173003 May 03 09:28:02.896580 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1399/2622] 10.222.0.11 () {60 vars in 1279 bytes} [Tue May 3 09:28:02 2022] DELETE /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 03 09:28:02.905029 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d58a05c0-5a8b-469d-b650-4a88aba6617d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:02.906184 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d58a05c0-5a8b-469d-b650-4a88aba6617d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:02.911989 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d58a05c0-5a8b-469d-b650-4a88aba6617d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:02.912572 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d58a05c0-5a8b-469d-b650-4a88aba6617d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:02.913363 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d58a05c0-5a8b-469d-b650-4a88aba6617d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:02.913791 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d58a05c0-5a8b-469d-b650-4a88aba6617d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:02.926951 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-fd281f60-7e86-4c47-b18b-f301c4991f1c tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "DELETE /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 204 len: 0 microversion: 2.1 time: 0.179346 May 03 09:28:02.927600 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1224/2623] 10.222.0.11 () {58 vars in 1238 bytes} [Tue May 3 09:28:02 2022] DELETE /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 03 09:28:02.936480 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-496ccabc-d9db-4ed4-9b2d-7704863e75d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:02.937168 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-496ccabc-d9db-4ed4-9b2d-7704863e75d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:02.942988 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-496ccabc-d9db-4ed4-9b2d-7704863e75d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:02.943433 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-496ccabc-d9db-4ed4-9b2d-7704863e75d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:02.944284 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-496ccabc-d9db-4ed4-9b2d-7704863e75d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:02.944713 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-496ccabc-d9db-4ed4-9b2d-7704863e75d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:02.945246 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d58a05c0-5a8b-469d-b650-4a88aba6617d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:02.945692 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d58a05c0-5a8b-469d-b650-4a88aba6617d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:02.946144 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.objects.instance [None req-d58a05c0-5a8b-469d-b650-4a88aba6617d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lazy-loading 'fault' on Instance uuid b68d79a3-e9c5-46b6-b8c0-a9d6017f388f {{(pid=123391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 03 09:28:02.980584 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-496ccabc-d9db-4ed4-9b2d-7704863e75d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:02.980817 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-496ccabc-d9db-4ed4-9b2d-7704863e75d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:02.981292 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.objects.instance [None req-496ccabc-d9db-4ed4-9b2d-7704863e75d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lazy-loading 'fault' on Instance uuid 309e7477-cc5c-4422-ac1e-46d32bc3991b {{(pid=123392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 03 09:28:03.030705 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-496ccabc-d9db-4ed4-9b2d-7704863e75d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027eeadca01b4c4f93b892ef0fbcb195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9159d65c5ca43edadaa60281f20c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:28:03.043367 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-496ccabc-d9db-4ed4-9b2d-7704863e75d4 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 200 len: 1469 microversion: 2.1 time: 0.110968 May 03 09:28:03.047919 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1225/2624] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:28:02 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 1469 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:28:03.150723 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d58a05c0-5a8b-469d-b650-4a88aba6617d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:28:03.159373 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d58a05c0-5a8b-469d-b650-4a88aba6617d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:28:03.160912 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d58a05c0-5a8b-469d-b650-4a88aba6617d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65620fcd12544f7094440d60b094cfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe13f4f312b145cbb904daebc75026d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:28:03.162084 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d58a05c0-5a8b-469d-b650-4a88aba6617d tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 200 len: 1543 microversion: 2.20 time: 0.261203 May 03 09:28:03.162651 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1400/2625] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:28:02 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 1543 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 09:28:04.061769 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e6133633-6635-428c-8c4c-e63e99cfaa63 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:04.062387 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e6133633-6635-428c-8c4c-e63e99cfaa63 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] [instance: 309e7477-cc5c-4422-ac1e-46d32bc3991b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:04.068768 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e6133633-6635-428c-8c4c-e63e99cfaa63 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:04.069213 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e6133633-6635-428c-8c4c-e63e99cfaa63 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:04.070928 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e6133633-6635-428c-8c4c-e63e99cfaa63 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:04.071701 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e6133633-6635-428c-8c4c-e63e99cfaa63 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:04.089052 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-e6133633-6635-428c-8c4c-e63e99cfaa63 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] HTTP exception thrown: Instance 309e7477-cc5c-4422-ac1e-46d32bc3991b could not be found. May 03 09:28:04.090026 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e6133633-6635-428c-8c4c-e63e99cfaa63 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] Returning 404 to user: Instance 309e7477-cc5c-4422-ac1e-46d32bc3991b could not be found. {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 09:28:04.091226 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e6133633-6635-428c-8c4c-e63e99cfaa63 tempest-AttachVolumeTestJSON-578129196 tempest-AttachVolumeTestJSON-578129196-project] 10.222.0.11 "GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b" status: 404 len: 111 microversion: 2.1 time: 0.033683 May 03 09:28:04.092358 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1226/2626] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:28:04 2022] GET /compute/v2.1/servers/309e7477-cc5c-4422-ac1e-46d32bc3991b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 09:28:04.181528 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e5bd6c3d-8f11-472c-a21e-b390d48189f2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:04.182844 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e5bd6c3d-8f11-472c-a21e-b390d48189f2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] [instance: b68d79a3-e9c5-46b6-b8c0-a9d6017f388f] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:04.194170 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e5bd6c3d-8f11-472c-a21e-b390d48189f2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:04.194954 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e5bd6c3d-8f11-472c-a21e-b390d48189f2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:04.196020 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e5bd6c3d-8f11-472c-a21e-b390d48189f2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:04.196657 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e5bd6c3d-8f11-472c-a21e-b390d48189f2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:04.216428 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.wsgi [None req-e5bd6c3d-8f11-472c-a21e-b390d48189f2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] HTTP exception thrown: Instance b68d79a3-e9c5-46b6-b8c0-a9d6017f388f could not be found. May 03 09:28:04.217254 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e5bd6c3d-8f11-472c-a21e-b390d48189f2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] Returning 404 to user: Instance b68d79a3-e9c5-46b6-b8c0-a9d6017f388f could not be found. {{(pid=123391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 09:28:04.218309 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e5bd6c3d-8f11-472c-a21e-b390d48189f2 tempest-AttachVolumeShelveTestJSON-1298756437 tempest-AttachVolumeShelveTestJSON-1298756437-project] 10.222.0.11 "GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f" status: 404 len: 111 microversion: 2.20 time: 0.041999 May 03 09:28:04.219887 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1401/2627] 10.222.0.11 () {60 vars in 1276 bytes} [Tue May 3 09:28:04 2022] GET /compute/v2.1/servers/b68d79a3-e9c5-46b6-b8c0-a9d6017f388f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 03 09:28:05.022281 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a0599194-a86b-4bc2-bcfd-906202f2127c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:05.022977 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a0599194-a86b-4bc2-bcfd-906202f2127c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:05.032820 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a0599194-a86b-4bc2-bcfd-906202f2127c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:05.033341 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a0599194-a86b-4bc2-bcfd-906202f2127c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:05.034249 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a0599194-a86b-4bc2-bcfd-906202f2127c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:05.034601 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a0599194-a86b-4bc2-bcfd-906202f2127c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:05.089852 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a0599194-a86b-4bc2-bcfd-906202f2127c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Going to try to terminate instance {{(pid=123392) delete /opt/stack/nova/nova/compute/api.py:2664}} May 03 09:28:05.201447 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a0599194-a86b-4bc2-bcfd-906202f2127c tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "DELETE /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 204 len: 0 microversion: 2.1 time: 0.183481 May 03 09:28:05.202571 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1227/2628] 10.222.0.11 () {58 vars in 1238 bytes} [Tue May 3 09:28:05 2022] DELETE /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 03 09:28:05.208140 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO oslo.messaging._drivers.impl_rabbit [-] [5171f508-01dc-43e8-be0c-c552110e72d0] Reconnected to AMQP server on 10.222.0.11:5672 via [amqp] client with port 34552. May 03 09:28:05.213820 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9ff06376-db02-49c3-bf17-f4111cfe6a58 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:05.214184 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9ff06376-db02-49c3-bf17-f4111cfe6a58 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:05.230242 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9ff06376-db02-49c3-bf17-f4111cfe6a58 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:05.230711 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9ff06376-db02-49c3-bf17-f4111cfe6a58 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:05.232820 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9ff06376-db02-49c3-bf17-f4111cfe6a58 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:05.234168 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9ff06376-db02-49c3-bf17-f4111cfe6a58 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:05.307024 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-263d57e7-625f-4647-8eee-ca85e69af774 req-a96d67c6-2118-4297-9860-7907ba05ce98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "512c1f04-399e-4647-8bfe-f2c295397df2", "name": "network-vif-deleted", "tag": "fa2818f3-6dd4-4c2e-8c03-d124c2ac8ac8"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:28:05.316558 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-263d57e7-625f-4647-8eee-ca85e69af774 req-a96d67c6-2118-4297-9860-7907ba05ce98 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:05.317004 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-263d57e7-625f-4647-8eee-ca85e69af774 req-a96d67c6-2118-4297-9860-7907ba05ce98 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:05.328640 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-263d57e7-625f-4647-8eee-ca85e69af774 req-a96d67c6-2118-4297-9860-7907ba05ce98 service nova] Creating event network-vif-deleted:fa2818f3-6dd4-4c2e-8c03-d124c2ac8ac8 for instance 512c1f04-399e-4647-8bfe-f2c295397df2 on hv-cinder-84027 May 03 09:28:05.333709 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-263d57e7-625f-4647-8eee-ca85e69af774 req-a96d67c6-2118-4297-9860-7907ba05ce98 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121727 May 03 09:28:05.334471 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1228/2629] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:28:05.648357 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9ff06376-db02-49c3-bf17-f4111cfe6a58 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:28:05.656005 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9ff06376-db02-49c3-bf17-f4111cfe6a58 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1508 microversion: 2.1 time: 0.448984 May 03 09:28:05.656947 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1402/2630] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:28:05 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1508 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:28:06.674877 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e7ba19b9-7318-4151-8d41-13a3a0cd877a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:06.675607 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e7ba19b9-7318-4151-8d41-13a3a0cd877a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:06.682043 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e7ba19b9-7318-4151-8d41-13a3a0cd877a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:06.682517 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e7ba19b9-7318-4151-8d41-13a3a0cd877a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:06.683293 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e7ba19b9-7318-4151-8d41-13a3a0cd877a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:06.683727 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e7ba19b9-7318-4151-8d41-13a3a0cd877a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:07.389515 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [req-3969d9e0-6a05-4984-bf88-0d77ca26278e req-c6adcbdc-c760-4e73-8827-c5286ad7e7df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5", "name": "network-vif-deleted", "tag": "a8f323e6-cec6-48ce-90cc-5cf13c67866e"}]} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:28:07.393470 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e7ba19b9-7318-4151-8d41-13a3a0cd877a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:28:07.402637 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-3969d9e0-6a05-4984-bf88-0d77ca26278e req-c6adcbdc-c760-4e73-8827-c5286ad7e7df service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:07.403562 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-3969d9e0-6a05-4984-bf88-0d77ca26278e req-c6adcbdc-c760-4e73-8827-c5286ad7e7df service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:07.405950 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e7ba19b9-7318-4151-8d41-13a3a0cd877a tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 200 len: 1508 microversion: 2.1 time: 0.735777 May 03 09:28:07.407666 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1229/2631] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:28:06 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 1508 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:28:07.421297 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.compute.server_external_events [req-3969d9e0-6a05-4984-bf88-0d77ca26278e req-c6adcbdc-c760-4e73-8827-c5286ad7e7df service nova] Creating event network-vif-deleted:a8f323e6-cec6-48ce-90cc-5cf13c67866e for instance 21d64b7e-a6a1-42f9-86b4-b398b1ae3ce5 on hv-cinder-84027 May 03 09:28:07.427140 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [req-3969d9e0-6a05-4984-bf88-0d77ca26278e req-c6adcbdc-c760-4e73-8827-c5286ad7e7df service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041734 May 03 09:28:07.427743 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1403/2632] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:28:08.428573 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ce855197-61ac-4785-91c9-d93b726b9b4d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:08.429334 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ce855197-61ac-4785-91c9-d93b726b9b4d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: e33ce07e-908a-4708-8aef-351bd3e02368] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:08.436795 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ce855197-61ac-4785-91c9-d93b726b9b4d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:08.437255 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ce855197-61ac-4785-91c9-d93b726b9b4d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:08.438076 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ce855197-61ac-4785-91c9-d93b726b9b4d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:08.438491 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ce855197-61ac-4785-91c9-d93b726b9b4d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:08.455110 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-ce855197-61ac-4785-91c9-d93b726b9b4d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] HTTP exception thrown: Instance e33ce07e-908a-4708-8aef-351bd3e02368 could not be found. May 03 09:28:08.456078 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ce855197-61ac-4785-91c9-d93b726b9b4d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Returning 404 to user: Instance e33ce07e-908a-4708-8aef-351bd3e02368 could not be found. {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 09:28:08.457077 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ce855197-61ac-4785-91c9-d93b726b9b4d tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368" status: 404 len: 111 microversion: 2.1 time: 0.033137 May 03 09:28:08.460603 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1230/2633] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:28:08 2022] GET /compute/v2.1/servers/e33ce07e-908a-4708-8aef-351bd3e02368 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 09:28:08.467517 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3414e1ca-bcd3-456f-a577-ad789778ab3b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:08.468192 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-3414e1ca-bcd3-456f-a577-ad789778ab3b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: a5e0d581-50da-4cfd-a5da-d35a632c7874] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:08.474888 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3414e1ca-bcd3-456f-a577-ad789778ab3b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:08.475376 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3414e1ca-bcd3-456f-a577-ad789778ab3b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:08.476455 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3414e1ca-bcd3-456f-a577-ad789778ab3b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:08.476887 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3414e1ca-bcd3-456f-a577-ad789778ab3b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:08.689098 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-3414e1ca-bcd3-456f-a577-ad789778ab3b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: a5e0d581-50da-4cfd-a5da-d35a632c7874] Going to try to terminate instance {{(pid=123391) delete /opt/stack/nova/nova/compute/api.py:2664}} May 03 09:28:08.780246 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-3414e1ca-bcd3-456f-a577-ad789778ab3b tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "DELETE /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874" status: 204 len: 0 microversion: 2.1 time: 0.316704 May 03 09:28:08.781390 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1404/2634] 10.222.0.11 () {58 vars in 1238 bytes} [Tue May 3 09:28:08 2022] DELETE /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 03 09:28:08.789930 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-55693c64-22a3-4484-8a6f-3fc89a9a3c04 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:08.791024 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-55693c64-22a3-4484-8a6f-3fc89a9a3c04 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: a5e0d581-50da-4cfd-a5da-d35a632c7874] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:08.800467 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-55693c64-22a3-4484-8a6f-3fc89a9a3c04 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:08.801050 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-55693c64-22a3-4484-8a6f-3fc89a9a3c04 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:08.802139 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-55693c64-22a3-4484-8a6f-3fc89a9a3c04 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:08.802825 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-55693c64-22a3-4484-8a6f-3fc89a9a3c04 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:09.175156 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-55693c64-22a3-4484-8a6f-3fc89a9a3c04 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:28:09.183402 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-55693c64-22a3-4484-8a6f-3fc89a9a3c04 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874" status: 200 len: 1520 microversion: 2.1 time: 0.397430 May 03 09:28:09.184436 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1231/2635] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:28:08 2022] GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874 => generated 1520 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:28:09.480162 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [req-68f6c4e1-b311-4ee6-9744-b7f737cbd181 req-793336f7-151b-46d4-b903-b5565f06dbd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e33ce07e-908a-4708-8aef-351bd3e02368", "name": "network-vif-deleted", "tag": "97dddf0c-2099-4aca-9f5f-d7bb688d0d06"}]} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:28:09.497843 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-68f6c4e1-b311-4ee6-9744-b7f737cbd181 req-793336f7-151b-46d4-b903-b5565f06dbd0 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:09.498559 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-68f6c4e1-b311-4ee6-9744-b7f737cbd181 req-793336f7-151b-46d4-b903-b5565f06dbd0 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:09.527686 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.compute.server_external_events [req-68f6c4e1-b311-4ee6-9744-b7f737cbd181 req-793336f7-151b-46d4-b903-b5565f06dbd0 service nova] Creating event network-vif-deleted:97dddf0c-2099-4aca-9f5f-d7bb688d0d06 for instance e33ce07e-908a-4708-8aef-351bd3e02368 on hv-cinder-84027 May 03 09:28:09.544644 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [req-68f6c4e1-b311-4ee6-9744-b7f737cbd181 req-793336f7-151b-46d4-b903-b5565f06dbd0 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069495 May 03 09:28:09.545738 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1405/2636] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:28:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:28:10.201612 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-35363995-8d2b-4866-8e31-d79ae47539be tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:10.202254 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-35363995-8d2b-4866-8e31-d79ae47539be tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: a5e0d581-50da-4cfd-a5da-d35a632c7874] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:10.221410 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-35363995-8d2b-4866-8e31-d79ae47539be tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:10.221864 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-35363995-8d2b-4866-8e31-d79ae47539be tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:10.222691 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-35363995-8d2b-4866-8e31-d79ae47539be tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:10.223119 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-35363995-8d2b-4866-8e31-d79ae47539be tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:10.578273 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-35363995-8d2b-4866-8e31-d79ae47539be tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d1a1b1c3754f0d856df4ca7a8e0269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ce599e490e457385310fcbca709c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:28:10.591669 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-35363995-8d2b-4866-8e31-d79ae47539be tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874" status: 200 len: 1520 microversion: 2.1 time: 0.394101 May 03 09:28:10.592622 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1232/2637] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:28:10 2022] GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874 => generated 1520 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:28:11.574584 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [req-12e2f068-5e68-45e2-9a7d-08f4643e6fed req-5f80a7df-8479-4aba-a782-e4addebc4a9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5e0d581-50da-4cfd-a5da-d35a632c7874", "name": "network-vif-deleted", "tag": "f4117f51-d987-48d6-86d6-80e550eb84f6"}]} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:28:11.615318 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-60f047c5-c33b-4e28-a33c-ff9394a80cf2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:11.615318 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-60f047c5-c33b-4e28-a33c-ff9394a80cf2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] [instance: a5e0d581-50da-4cfd-a5da-d35a632c7874] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:11.633522 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-12e2f068-5e68-45e2-9a7d-08f4643e6fed req-5f80a7df-8479-4aba-a782-e4addebc4a9d service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:11.634324 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-12e2f068-5e68-45e2-9a7d-08f4643e6fed req-5f80a7df-8479-4aba-a782-e4addebc4a9d service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:11.637166 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-60f047c5-c33b-4e28-a33c-ff9394a80cf2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:11.639007 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-60f047c5-c33b-4e28-a33c-ff9394a80cf2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:11.641320 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-60f047c5-c33b-4e28-a33c-ff9394a80cf2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:11.644133 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-60f047c5-c33b-4e28-a33c-ff9394a80cf2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:11.668275 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.compute.server_external_events [req-12e2f068-5e68-45e2-9a7d-08f4643e6fed req-5f80a7df-8479-4aba-a782-e4addebc4a9d service nova] Creating event network-vif-deleted:f4117f51-d987-48d6-86d6-80e550eb84f6 for instance a5e0d581-50da-4cfd-a5da-d35a632c7874 on hv-cinder-84027 May 03 09:28:11.676246 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [req-12e2f068-5e68-45e2-9a7d-08f4643e6fed req-5f80a7df-8479-4aba-a782-e4addebc4a9d service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105965 May 03 09:28:11.677519 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1406/2638] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:28:11.685874 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-60f047c5-c33b-4e28-a33c-ff9394a80cf2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] HTTP exception thrown: Instance a5e0d581-50da-4cfd-a5da-d35a632c7874 could not be found. May 03 09:28:11.687917 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-60f047c5-c33b-4e28-a33c-ff9394a80cf2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] Returning 404 to user: Instance a5e0d581-50da-4cfd-a5da-d35a632c7874 could not be found. {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 09:28:11.690330 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-60f047c5-c33b-4e28-a33c-ff9394a80cf2 tempest-ServerRescueNegativeTestJSON-944685940 tempest-ServerRescueNegativeTestJSON-944685940-project] 10.222.0.11 "GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874" status: 404 len: 111 microversion: 2.1 time: 0.083470 May 03 09:28:11.693631 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1233/2639] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:28:11 2022] GET /compute/v2.1/servers/a5e0d581-50da-4cfd-a5da-d35a632c7874 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 09:28:18.823116 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-933f0c97-93f7-42cb-a67a-354f731c1a3a tempest-VolumesGetTestJSON-2080239366 tempest-VolumesGetTestJSON-2080239366-project] Action: 'create', calling method: .version_select at 0x7f09d352cca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1536383405", "metadata": {"Type": "work"}}} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:28:19.353542 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-933f0c97-93f7-42cb-a67a-354f731c1a3a tempest-VolumesGetTestJSON-2080239366 tempest-VolumesGetTestJSON-2080239366-project] 10.222.0.11 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.658777 May 03 09:28:19.354772 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1407/2640] 10.222.0.11 () {60 vars in 1155 bytes} [Tue May 3 09:28:18 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 661 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 03 09:28:19.365339 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c1ed8b13-14e6-4880-b654-b86b87a96787 tempest-VolumesGetTestJSON-2080239366 tempest-VolumesGetTestJSON-2080239366-project] Calling method '.version_select at 0x7f09cdd0cb80>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:19.473510 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c1ed8b13-14e6-4880-b654-b86b87a96787 tempest-VolumesGetTestJSON-2080239366 tempest-VolumesGetTestJSON-2080239366-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/21ac4001-b495-425a-ae43-60091a0002a7" status: 200 len: 353 microversion: 2.1 time: 0.111881 May 03 09:28:19.474285 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1234/2641] 10.222.0.11 () {58 vars in 1244 bytes} [Tue May 3 09:28:19 2022] GET /compute/v2.1/os-volumes/21ac4001-b495-425a-ae43-60091a0002a7 => generated 353 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:28:20.486907 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-301405a2-cc54-4443-9a44-fb58fd8e3105 tempest-VolumesGetTestJSON-2080239366 tempest-VolumesGetTestJSON-2080239366-project] Calling method '.version_select at 0x7f09d3569e50>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:20.567636 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-301405a2-cc54-4443-9a44-fb58fd8e3105 tempest-VolumesGetTestJSON-2080239366 tempest-VolumesGetTestJSON-2080239366-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/21ac4001-b495-425a-ae43-60091a0002a7" status: 200 len: 354 microversion: 2.1 time: 0.084828 May 03 09:28:20.568354 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1408/2642] 10.222.0.11 () {58 vars in 1244 bytes} [Tue May 3 09:28:20 2022] GET /compute/v2.1/os-volumes/21ac4001-b495-425a-ae43-60091a0002a7 => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:28:20.581015 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-dce5cfd7-f75a-4e86-a9bf-4ad633e76e14 tempest-VolumesGetTestJSON-2080239366 tempest-VolumesGetTestJSON-2080239366-project] Calling method '.version_select at 0x7f09cdeb9af0>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:20.675439 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-dce5cfd7-f75a-4e86-a9bf-4ad633e76e14 tempest-VolumesGetTestJSON-2080239366 tempest-VolumesGetTestJSON-2080239366-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/21ac4001-b495-425a-ae43-60091a0002a7" status: 200 len: 354 microversion: 2.1 time: 0.098809 May 03 09:28:20.676461 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1235/2643] 10.222.0.11 () {58 vars in 1244 bytes} [Tue May 3 09:28:20 2022] GET /compute/v2.1/os-volumes/21ac4001-b495-425a-ae43-60091a0002a7 => generated 354 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:28:20.693574 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9b7f29fc-b912-4478-adc4-59b98583517f tempest-VolumesGetTestJSON-2080239366 tempest-VolumesGetTestJSON-2080239366-project] Calling method '.version_select at 0x7f09d352c5e0>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:20.798557 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9b7f29fc-b912-4478-adc4-59b98583517f tempest-VolumesGetTestJSON-2080239366 tempest-VolumesGetTestJSON-2080239366-project] 10.222.0.11 "DELETE /compute/v2.1/os-volumes/21ac4001-b495-425a-ae43-60091a0002a7" status: 202 len: 0 microversion: 2.1 time: 0.109196 May 03 09:28:20.800030 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1409/2644] 10.222.0.11 () {58 vars in 1247 bytes} [Tue May 3 09:28:20 2022] DELETE /compute/v2.1/os-volumes/21ac4001-b495-425a-ae43-60091a0002a7 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 09:28:20.808544 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-555bbe32-7ab7-465a-9750-2cc842bfb836 tempest-VolumesGetTestJSON-2080239366 tempest-VolumesGetTestJSON-2080239366-project] Calling method '.version_select at 0x7f09cdf01430>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:20.865652 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-555bbe32-7ab7-465a-9750-2cc842bfb836 tempest-VolumesGetTestJSON-2080239366 tempest-VolumesGetTestJSON-2080239366-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/21ac4001-b495-425a-ae43-60091a0002a7" status: 200 len: 353 microversion: 2.1 time: 0.061350 May 03 09:28:20.866327 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1236/2645] 10.222.0.11 () {58 vars in 1244 bytes} [Tue May 3 09:28:20 2022] GET /compute/v2.1/os-volumes/21ac4001-b495-425a-ae43-60091a0002a7 => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:28:21.882528 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-0eea13b5-3c06-41a2-8b0a-d3dac0157ba3 tempest-VolumesGetTestJSON-2080239366 tempest-VolumesGetTestJSON-2080239366-project] Calling method '.version_select at 0x7f09d34e1940>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:21.997861 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.wsgi [None req-0eea13b5-3c06-41a2-8b0a-d3dac0157ba3 tempest-VolumesGetTestJSON-2080239366 tempest-VolumesGetTestJSON-2080239366-project] HTTP exception thrown: Volume 21ac4001-b495-425a-ae43-60091a0002a7 could not be found. May 03 09:28:21.998465 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-0eea13b5-3c06-41a2-8b0a-d3dac0157ba3 tempest-VolumesGetTestJSON-2080239366 tempest-VolumesGetTestJSON-2080239366-project] Returning 404 to user: Volume 21ac4001-b495-425a-ae43-60091a0002a7 could not be found. {{(pid=123391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 09:28:22.000022 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-0eea13b5-3c06-41a2-8b0a-d3dac0157ba3 tempest-VolumesGetTestJSON-2080239366 tempest-VolumesGetTestJSON-2080239366-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/21ac4001-b495-425a-ae43-60091a0002a7" status: 404 len: 109 microversion: 2.1 time: 0.125190 May 03 09:28:22.001073 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1410/2646] 10.222.0.11 () {58 vars in 1244 bytes} [Tue May 3 09:28:21 2022] GET /compute/v2.1/os-volumes/21ac4001-b495-425a-ae43-60091a0002a7 => generated 109 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 09:28:24.717852 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f43c9a80-7c00-4336-8c3f-0b494200ba8b tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Action: 'create', calling method: .version_select at 0x7f09cdd0c3a0>, body: {"keypair": {"name": "tempest-keypair-877196112"}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:28:24.760393 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-f43c9a80-7c00-4336-8c3f-0b494200ba8b tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Getting quotas for project 273a7688b38c4558b4c223ba1d9ecdf2. Resources: {'key_pairs'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 03 09:28:24.769493 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-f43c9a80-7c00-4336-8c3f-0b494200ba8b tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Getting quotas for user 0f544c320b724a1fbd779f8ab51a7911 and project 273a7688b38c4558b4c223ba1d9ecdf2. Resources: {'key_pairs'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 03 09:28:25.313854 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-f43c9a80-7c00-4336-8c3f-0b494200ba8b tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Getting quotas for project 273a7688b38c4558b4c223ba1d9ecdf2. Resources: {'key_pairs'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 03 09:28:25.318109 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-f43c9a80-7c00-4336-8c3f-0b494200ba8b tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Getting quotas for user 0f544c320b724a1fbd779f8ab51a7911 and project 273a7688b38c4558b4c223ba1d9ecdf2. Resources: {'key_pairs'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 03 09:28:25.337368 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f43c9a80-7c00-4336-8c3f-0b494200ba8b tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 1.087009 May 03 09:28:25.339195 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1237/2647] 10.222.0.11 () {60 vars in 1157 bytes} [Tue May 3 09:28:24 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:28:28.328550 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-4b83ce84-7c0c-468c-ab5b-60ce25538e71 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2058345935", "imageRef": "bd46d67a-108d-4c0c-9f0b-cb6d41c82a32", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2256faa9-18d6-4935-a666-8ff2d1a854c4"}], "security_groups": [{"name": "tempest-securitygroup--1150400651"}], "key_name": "tempest-keypair-877196112", "user_data": "}} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:28:28.501169 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.network.neutron [None req-4b83ce84-7c0c-468c-ab5b-60ce25538e71 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] validate_networks() for [('2256faa9-18d6-4935-a666-8ff2d1a854c4', None, None, None, None, None)] {{(pid=123391) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 03 09:28:29.349869 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-4b83ce84-7c0c-468c-ab5b-60ce25538e71 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Flavor limits 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 03 09:28:29.351194 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-4b83ce84-7c0c-468c-ab5b-60ce25538e71 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Image limits 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 03 09:28:29.351886 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-4b83ce84-7c0c-468c-ab5b-60ce25538e71 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Flavor pref 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 03 09:28:29.352472 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-4b83ce84-7c0c-468c-ab5b-60ce25538e71 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Image pref 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 03 09:28:29.353035 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-4b83ce84-7c0c-468c-ab5b-60ce25538e71 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 03 09:28:29.365168 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4b83ce84-7c0c-468c-ab5b-60ce25538e71 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:29.365789 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4b83ce84-7c0c-468c-ab5b-60ce25538e71 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:29.366762 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4b83ce84-7c0c-468c-ab5b-60ce25538e71 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:29.367197 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4b83ce84-7c0c-468c-ab5b-60ce25538e71 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:29.428358 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.quota [None req-4b83ce84-7c0c-468c-ab5b-60ce25538e71 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Getting quotas for project 273a7688b38c4558b4c223ba1d9ecdf2. Resources: {'cores', 'ram', 'instances'} {{(pid=123391) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 03 09:28:29.436900 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.quota [None req-4b83ce84-7c0c-468c-ab5b-60ce25538e71 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Getting quotas for user 0f544c320b724a1fbd779f8ab51a7911 and project 273a7688b38c4558b4c223ba1d9ecdf2. Resources: {'cores', 'ram', 'instances'} {{(pid=123391) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 03 09:28:29.464131 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-4b83ce84-7c0c-468c-ab5b-60ce25538e71 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Going to run 1 instances... {{(pid=123391) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 03 09:28:29.469582 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-4b83ce84-7c0c-468c-ab5b-60ce25538e71 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 331f3231-997c-4260-8d91-d4dc89a10a36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd46d67a-108d-4c0c-9f0b-cb6d41c82a32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123391) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 03 09:28:29.560322 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4b83ce84-7c0c-468c-ab5b-60ce25538e71 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [5ae7ede5-2c24-49f7-a2ce-9b4826612d28] AMQP server on 10.222.0.11:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 03 09:28:30.571202 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO oslo.messaging._drivers.impl_rabbit [None req-4b83ce84-7c0c-468c-ab5b-60ce25538e71 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [5ae7ede5-2c24-49f7-a2ce-9b4826612d28] Reconnected to AMQP server on 10.222.0.11:5672 via [amqp] client with port 35100. May 03 09:28:30.576099 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-4b83ce84-7c0c-468c-ab5b-60ce25538e71 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.252417 May 03 09:28:30.590625 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-29748fed-3951-494b-b38a-72d11bd712b6 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:30.591307 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-29748fed-3951-494b-b38a-72d11bd712b6 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 331f3231-997c-4260-8d91-d4dc89a10a36] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:30.594049 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1411/2648] 10.222.0.11 () {60 vars in 1146 bytes} [Tue May 3 09:28:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 2271 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 03 09:28:30.718553 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-29748fed-3951-494b-b38a-72d11bd712b6 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:28:30.739090 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-29748fed-3951-494b-b38a-72d11bd712b6 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36" status: 200 len: 1241 microversion: 2.1 time: 0.140757 May 03 09:28:30.739683 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1238/2649] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:28:30 2022] GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36 => generated 1241 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:28:31.757159 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-6c1e8b1b-633d-4f0f-8f8c-d2fd7417b1f0 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:31.757777 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-6c1e8b1b-633d-4f0f-8f8c-d2fd7417b1f0 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 331f3231-997c-4260-8d91-d4dc89a10a36] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:31.767895 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6c1e8b1b-633d-4f0f-8f8c-d2fd7417b1f0 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:31.768408 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6c1e8b1b-633d-4f0f-8f8c-d2fd7417b1f0 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:31.770932 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6c1e8b1b-633d-4f0f-8f8c-d2fd7417b1f0 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:31.771445 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6c1e8b1b-633d-4f0f-8f8c-d2fd7417b1f0 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:31.858638 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-6c1e8b1b-633d-4f0f-8f8c-d2fd7417b1f0 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:28:31.869419 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-6c1e8b1b-633d-4f0f-8f8c-d2fd7417b1f0 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36" status: 200 len: 1237 microversion: 2.1 time: 0.116925 May 03 09:28:31.870643 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1412/2650] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:28:31 2022] GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36 => generated 1237 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:28:32.887097 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-91a77946-8a34-4c5c-a5f9-eb3c8e694215 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:32.889501 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-91a77946-8a34-4c5c-a5f9-eb3c8e694215 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 331f3231-997c-4260-8d91-d4dc89a10a36] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:32.898083 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-91a77946-8a34-4c5c-a5f9-eb3c8e694215 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:32.898753 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-91a77946-8a34-4c5c-a5f9-eb3c8e694215 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:32.899452 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-91a77946-8a34-4c5c-a5f9-eb3c8e694215 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:32.900251 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-91a77946-8a34-4c5c-a5f9-eb3c8e694215 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:32.991796 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-91a77946-8a34-4c5c-a5f9-eb3c8e694215 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:28:33.002407 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-91a77946-8a34-4c5c-a5f9-eb3c8e694215 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36" status: 200 len: 1293 microversion: 2.1 time: 0.119431 May 03 09:28:33.003437 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1239/2651] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:28:32 2022] GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36 => generated 1293 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:28:34.023069 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-698ed5fd-1f46-45b8-b809-539c48022512 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:34.023851 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-698ed5fd-1f46-45b8-b809-539c48022512 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 331f3231-997c-4260-8d91-d4dc89a10a36] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:34.036894 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-698ed5fd-1f46-45b8-b809-539c48022512 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:34.037637 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-698ed5fd-1f46-45b8-b809-539c48022512 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:34.038801 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-698ed5fd-1f46-45b8-b809-539c48022512 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:34.040441 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-698ed5fd-1f46-45b8-b809-539c48022512 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:34.112921 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-698ed5fd-1f46-45b8-b809-539c48022512 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:28:34.121671 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-698ed5fd-1f46-45b8-b809-539c48022512 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36" status: 200 len: 1293 microversion: 2.1 time: 0.104150 May 03 09:28:34.124291 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1413/2652] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:28:34 2022] GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36 => generated 1293 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:28:35.143899 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-adce5a28-4ad4-459f-a499-beb0ac402f08 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:35.144675 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-adce5a28-4ad4-459f-a499-beb0ac402f08 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 331f3231-997c-4260-8d91-d4dc89a10a36] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:35.170324 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-adce5a28-4ad4-459f-a499-beb0ac402f08 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:35.170781 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-adce5a28-4ad4-459f-a499-beb0ac402f08 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:35.171571 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-adce5a28-4ad4-459f-a499-beb0ac402f08 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:35.172040 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-adce5a28-4ad4-459f-a499-beb0ac402f08 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:35.312516 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-adce5a28-4ad4-459f-a499-beb0ac402f08 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:28:35.320850 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-adce5a28-4ad4-459f-a499-beb0ac402f08 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36" status: 200 len: 1299 microversion: 2.1 time: 0.181957 May 03 09:28:35.327542 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1240/2653] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:28:35 2022] GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36 => generated 1299 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:28:36.344635 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e5ae71f7-e7fc-49b9-b93a-0c104c106614 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:36.345859 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e5ae71f7-e7fc-49b9-b93a-0c104c106614 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 331f3231-997c-4260-8d91-d4dc89a10a36] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:36.359179 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e5ae71f7-e7fc-49b9-b93a-0c104c106614 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:36.365469 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e5ae71f7-e7fc-49b9-b93a-0c104c106614 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:36.366328 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e5ae71f7-e7fc-49b9-b93a-0c104c106614 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:36.367117 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e5ae71f7-e7fc-49b9-b93a-0c104c106614 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:36.780560 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e5ae71f7-e7fc-49b9-b93a-0c104c106614 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:28:36.794531 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e5ae71f7-e7fc-49b9-b93a-0c104c106614 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36" status: 200 len: 1367 microversion: 2.1 time: 0.454405 May 03 09:28:36.800128 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1414/2654] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:28:36 2022] GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36 => generated 1367 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:28:37.638708 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-71d9b53a-d2db-474b-a542-4156aefd8ecf req-6e6bded2-bbff-4ff1-a133-13ebe85e974a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "331f3231-997c-4260-8d91-d4dc89a10a36", "tag": "32d02ec6-75b8-4708-8af1-006306964125"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:28:37.663018 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-71d9b53a-d2db-474b-a542-4156aefd8ecf req-6e6bded2-bbff-4ff1-a133-13ebe85e974a service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:37.663464 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-71d9b53a-d2db-474b-a542-4156aefd8ecf req-6e6bded2-bbff-4ff1-a133-13ebe85e974a service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:37.683562 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-71d9b53a-d2db-474b-a542-4156aefd8ecf req-6e6bded2-bbff-4ff1-a133-13ebe85e974a service nova] Creating event network-changed:32d02ec6-75b8-4708-8af1-006306964125 for instance 331f3231-997c-4260-8d91-d4dc89a10a36 on hv-cinder-84027 May 03 09:28:37.688792 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-71d9b53a-d2db-474b-a542-4156aefd8ecf req-6e6bded2-bbff-4ff1-a133-13ebe85e974a service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055323 May 03 09:28:37.689746 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1241/2655] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:28:37.816300 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-1e40498f-3e45-42ed-aeaa-777bfd55fb60 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:37.817605 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-1e40498f-3e45-42ed-aeaa-777bfd55fb60 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 331f3231-997c-4260-8d91-d4dc89a10a36] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:37.829014 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1e40498f-3e45-42ed-aeaa-777bfd55fb60 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:37.829765 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1e40498f-3e45-42ed-aeaa-777bfd55fb60 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:37.830750 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1e40498f-3e45-42ed-aeaa-777bfd55fb60 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:37.831191 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1e40498f-3e45-42ed-aeaa-777bfd55fb60 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:37.982016 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-1e40498f-3e45-42ed-aeaa-777bfd55fb60 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:28:37.990077 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-1e40498f-3e45-42ed-aeaa-777bfd55fb60 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36" status: 200 len: 1367 microversion: 2.1 time: 0.178043 May 03 09:28:37.991140 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1415/2656] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:28:37 2022] GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36 => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:28:39.009053 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9dfcad56-6af3-4598-971d-7cd8af5b7e64 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:39.009759 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9dfcad56-6af3-4598-971d-7cd8af5b7e64 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 331f3231-997c-4260-8d91-d4dc89a10a36] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:39.016309 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9dfcad56-6af3-4598-971d-7cd8af5b7e64 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:39.017038 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9dfcad56-6af3-4598-971d-7cd8af5b7e64 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:39.018021 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9dfcad56-6af3-4598-971d-7cd8af5b7e64 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:39.018656 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9dfcad56-6af3-4598-971d-7cd8af5b7e64 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:39.177490 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9dfcad56-6af3-4598-971d-7cd8af5b7e64 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:28:39.185466 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9dfcad56-6af3-4598-971d-7cd8af5b7e64 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36" status: 200 len: 1367 microversion: 2.1 time: 0.181381 May 03 09:28:39.186626 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1242/2657] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:28:39 2022] GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:28:40.203845 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-aa3866af-aab9-4d92-92df-467f15731703 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:40.205436 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-aa3866af-aab9-4d92-92df-467f15731703 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 331f3231-997c-4260-8d91-d4dc89a10a36] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:40.216971 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-aa3866af-aab9-4d92-92df-467f15731703 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:40.217345 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-aa3866af-aab9-4d92-92df-467f15731703 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:40.218204 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-aa3866af-aab9-4d92-92df-467f15731703 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:40.218710 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-aa3866af-aab9-4d92-92df-467f15731703 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:40.485644 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-aa3866af-aab9-4d92-92df-467f15731703 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:28:40.496431 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-aa3866af-aab9-4d92-92df-467f15731703 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36" status: 200 len: 1367 microversion: 2.1 time: 0.296695 May 03 09:28:40.497571 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1416/2658] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:28:40 2022] GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36 => generated 1367 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:28:40.966107 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-97e656c2-e455-48a9-8445-e62dc248a673 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Action: 'create', calling method: .version_select at 0x7f09cddbddc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1110234858"}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:28:40.981822 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-97e656c2-e455-48a9-8445-e62dc248a673 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Getting quotas for project ee51b7929c5e4bcc845946df0d46f6c6. Resources: {'key_pairs'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 03 09:28:40.985613 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-97e656c2-e455-48a9-8445-e62dc248a673 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Getting quotas for user 8cc2d7dd95774cb2b0b9c695f222b6cc and project ee51b7929c5e4bcc845946df0d46f6c6. Resources: {'key_pairs'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 03 09:28:41.432891 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-97e656c2-e455-48a9-8445-e62dc248a673 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Getting quotas for project ee51b7929c5e4bcc845946df0d46f6c6. Resources: {'key_pairs'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 03 09:28:41.437111 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-97e656c2-e455-48a9-8445-e62dc248a673 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Getting quotas for user 8cc2d7dd95774cb2b0b9c695f222b6cc and project ee51b7929c5e4bcc845946df0d46f6c6. Resources: {'key_pairs'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 03 09:28:41.452772 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-97e656c2-e455-48a9-8445-e62dc248a673 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.490721 May 03 09:28:41.453405 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1243/2659] 10.222.0.11 () {60 vars in 1157 bytes} [Tue May 3 09:28:40 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:28:41.514476 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f0186760-1673-4008-9c66-2456857bd62f tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:41.515062 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f0186760-1673-4008-9c66-2456857bd62f tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 331f3231-997c-4260-8d91-d4dc89a10a36] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:41.522258 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f0186760-1673-4008-9c66-2456857bd62f tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:41.522852 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f0186760-1673-4008-9c66-2456857bd62f tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:41.523632 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f0186760-1673-4008-9c66-2456857bd62f tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:41.524178 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f0186760-1673-4008-9c66-2456857bd62f tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:41.553734 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-61405233-0c6f-44ad-952f-4a820f92f40e tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-939471034", "imageRef": "c4cf6511-73dd-4198-a38a-c1c3ffda1b77", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1110234858", "networks": [{"uuid": "90d870fb-9c64-446c-a279-ec20dbd75d0b"}]}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:28:41.605127 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.network.neutron [None req-61405233-0c6f-44ad-952f-4a820f92f40e tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] validate_networks() for [('90d870fb-9c64-446c-a279-ec20dbd75d0b', None, None, None, None, None)] {{(pid=123392) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 03 09:28:41.713984 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f0186760-1673-4008-9c66-2456857bd62f tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:28:41.723625 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f0186760-1673-4008-9c66-2456857bd62f tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36" status: 200 len: 1367 microversion: 2.1 time: 0.213166 May 03 09:28:41.724479 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1417/2660] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:28:41 2022] GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36 => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:28:42.435173 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-61405233-0c6f-44ad-952f-4a820f92f40e tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Flavor limits 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 03 09:28:42.435672 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-61405233-0c6f-44ad-952f-4a820f92f40e tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Image limits 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 03 09:28:42.436239 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-61405233-0c6f-44ad-952f-4a820f92f40e tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Flavor pref 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 03 09:28:42.436704 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-61405233-0c6f-44ad-952f-4a820f92f40e tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Image pref 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 03 09:28:42.437225 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-61405233-0c6f-44ad-952f-4a820f92f40e tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 03 09:28:42.446552 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-61405233-0c6f-44ad-952f-4a820f92f40e tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:42.447078 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-61405233-0c6f-44ad-952f-4a820f92f40e tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:42.448010 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-61405233-0c6f-44ad-952f-4a820f92f40e tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:42.448521 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-61405233-0c6f-44ad-952f-4a820f92f40e tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:42.465415 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-61405233-0c6f-44ad-952f-4a820f92f40e tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Getting quotas for project ee51b7929c5e4bcc845946df0d46f6c6. Resources: {'cores', 'ram', 'instances'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 03 09:28:42.469259 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-61405233-0c6f-44ad-952f-4a820f92f40e tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Getting quotas for user 8cc2d7dd95774cb2b0b9c695f222b6cc and project ee51b7929c5e4bcc845946df0d46f6c6. Resources: {'cores', 'ram', 'instances'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 03 09:28:42.480275 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-61405233-0c6f-44ad-952f-4a820f92f40e tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Going to run 1 instances... {{(pid=123392) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 03 09:28:42.482657 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-61405233-0c6f-44ad-952f-4a820f92f40e tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4cf6511-73dd-4198-a38a-c1c3ffda1b77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 03 09:28:42.528340 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: ERROR oslo.messaging._drivers.impl_rabbit [None req-61405233-0c6f-44ad-952f-4a820f92f40e tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [d6223384-b73e-4cc2-ba7f-3fea3fe9ae8c] AMQP server on 10.222.0.11:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 03 09:28:42.744648 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d2400577-40e8-4411-8ea0-4f8381b08390 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:42.745391 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d2400577-40e8-4411-8ea0-4f8381b08390 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 331f3231-997c-4260-8d91-d4dc89a10a36] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:42.755227 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d2400577-40e8-4411-8ea0-4f8381b08390 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:42.755751 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d2400577-40e8-4411-8ea0-4f8381b08390 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:42.756555 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d2400577-40e8-4411-8ea0-4f8381b08390 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:42.757018 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d2400577-40e8-4411-8ea0-4f8381b08390 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:42.902832 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d2400577-40e8-4411-8ea0-4f8381b08390 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:28:42.914379 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d2400577-40e8-4411-8ea0-4f8381b08390 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36" status: 200 len: 1367 microversion: 2.1 time: 0.176350 May 03 09:28:42.915176 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1418/2661] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:28:42 2022] GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:28:43.536435 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO oslo.messaging._drivers.impl_rabbit [None req-61405233-0c6f-44ad-952f-4a820f92f40e tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [d6223384-b73e-4cc2-ba7f-3fea3fe9ae8c] Reconnected to AMQP server on 10.222.0.11:5672 via [amqp] client with port 35350. May 03 09:28:43.541265 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-61405233-0c6f-44ad-952f-4a820f92f40e tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.991357 May 03 09:28:43.542183 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1244/2662] 10.222.0.11 () {60 vars in 1146 bytes} [Tue May 3 09:28:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1993 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 03 09:28:43.552601 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-18fb643b-b58e-43ba-8ad5-17782178768d tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:43.553207 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-18fb643b-b58e-43ba-8ad5-17782178768d tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:43.608471 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-18fb643b-b58e-43ba-8ad5-17782178768d tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc2d7dd95774cb2b0b9c695f222b6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee51b7929c5e4bcc845946df0d46f6c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:28:43.615999 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-18fb643b-b58e-43ba-8ad5-17782178768d tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4" status: 200 len: 1258 microversion: 2.1 time: 0.067421 May 03 09:28:43.616571 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1419/2663] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:28:43 2022] GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4 => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:28:43.939260 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e0b5a12c-60bc-4442-8fe5-df132b7e0875 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:43.940630 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e0b5a12c-60bc-4442-8fe5-df132b7e0875 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 331f3231-997c-4260-8d91-d4dc89a10a36] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:43.948402 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e0b5a12c-60bc-4442-8fe5-df132b7e0875 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:43.949067 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e0b5a12c-60bc-4442-8fe5-df132b7e0875 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:43.950864 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e0b5a12c-60bc-4442-8fe5-df132b7e0875 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:43.951454 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e0b5a12c-60bc-4442-8fe5-df132b7e0875 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:44.120802 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e0b5a12c-60bc-4442-8fe5-df132b7e0875 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:28:44.128500 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e0b5a12c-60bc-4442-8fe5-df132b7e0875 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36" status: 200 len: 1367 microversion: 2.1 time: 0.194344 May 03 09:28:44.129114 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1245/2664] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:28:43 2022] GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36 => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:28:44.633820 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-07ff80f7-4e84-4ce2-8bc9-7430e0556c46 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:44.635790 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-07ff80f7-4e84-4ce2-8bc9-7430e0556c46 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:44.702687 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-07ff80f7-4e84-4ce2-8bc9-7430e0556c46 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc2d7dd95774cb2b0b9c695f222b6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee51b7929c5e4bcc845946df0d46f6c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:28:44.709881 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-07ff80f7-4e84-4ce2-8bc9-7430e0556c46 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4" status: 200 len: 1258 microversion: 2.1 time: 0.080199 May 03 09:28:44.710431 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1420/2665] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:28:44 2022] GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4 => generated 1258 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:28:45.146124 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b12c74a6-7fa4-4d44-aaf1-e05d80215bf7 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:45.146694 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b12c74a6-7fa4-4d44-aaf1-e05d80215bf7 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 331f3231-997c-4260-8d91-d4dc89a10a36] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:45.153612 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b12c74a6-7fa4-4d44-aaf1-e05d80215bf7 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:45.154132 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b12c74a6-7fa4-4d44-aaf1-e05d80215bf7 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:45.154946 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b12c74a6-7fa4-4d44-aaf1-e05d80215bf7 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:45.155373 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b12c74a6-7fa4-4d44-aaf1-e05d80215bf7 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:45.297704 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b12c74a6-7fa4-4d44-aaf1-e05d80215bf7 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:28:45.305459 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b12c74a6-7fa4-4d44-aaf1-e05d80215bf7 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36" status: 200 len: 1367 microversion: 2.1 time: 0.163536 May 03 09:28:45.306225 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1246/2666] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:28:45 2022] GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:28:45.727431 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f058b203-0b19-40bb-bae4-a651b521ca75 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:45.728080 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f058b203-0b19-40bb-bae4-a651b521ca75 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:45.808000 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f058b203-0b19-40bb-bae4-a651b521ca75 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc2d7dd95774cb2b0b9c695f222b6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee51b7929c5e4bcc845946df0d46f6c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:28:45.814712 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f058b203-0b19-40bb-bae4-a651b521ca75 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4" status: 200 len: 1258 microversion: 2.1 time: 0.091424 May 03 09:28:45.815276 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1421/2667] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:28:45 2022] GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4 => generated 1258 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:28:46.322993 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e9690f27-cfee-463b-b2c0-30d9f4a69802 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:46.323595 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e9690f27-cfee-463b-b2c0-30d9f4a69802 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 331f3231-997c-4260-8d91-d4dc89a10a36] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:46.330712 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e9690f27-cfee-463b-b2c0-30d9f4a69802 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:46.331144 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e9690f27-cfee-463b-b2c0-30d9f4a69802 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:46.331961 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e9690f27-cfee-463b-b2c0-30d9f4a69802 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:46.332393 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e9690f27-cfee-463b-b2c0-30d9f4a69802 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:46.561575 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e9690f27-cfee-463b-b2c0-30d9f4a69802 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:28:46.571116 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e9690f27-cfee-463b-b2c0-30d9f4a69802 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36" status: 200 len: 1367 microversion: 2.1 time: 0.252084 May 03 09:28:46.583938 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1247/2668] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:28:46 2022] GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36 => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:28:46.832834 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-1cc450ae-99b6-4ceb-aad0-36c51857e333 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:46.834531 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-1cc450ae-99b6-4ceb-aad0-36c51857e333 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:46.944867 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-1cc450ae-99b6-4ceb-aad0-36c51857e333 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc2d7dd95774cb2b0b9c695f222b6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee51b7929c5e4bcc845946df0d46f6c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:28:46.953758 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-1cc450ae-99b6-4ceb-aad0-36c51857e333 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4" status: 200 len: 1258 microversion: 2.1 time: 0.124768 May 03 09:28:46.955159 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1422/2669] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:28:46 2022] GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4 => generated 1258 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:28:47.597763 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-1c26daf5-5b18-416d-b657-f27cc1e8dd4d tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:47.598625 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-1c26daf5-5b18-416d-b657-f27cc1e8dd4d tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 331f3231-997c-4260-8d91-d4dc89a10a36] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:47.605737 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1c26daf5-5b18-416d-b657-f27cc1e8dd4d tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:47.606181 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1c26daf5-5b18-416d-b657-f27cc1e8dd4d tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:47.607574 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1c26daf5-5b18-416d-b657-f27cc1e8dd4d tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:47.608150 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1c26daf5-5b18-416d-b657-f27cc1e8dd4d tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:47.797038 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-1c26daf5-5b18-416d-b657-f27cc1e8dd4d tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:28:47.805266 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-1c26daf5-5b18-416d-b657-f27cc1e8dd4d tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36" status: 200 len: 1367 microversion: 2.1 time: 0.211661 May 03 09:28:47.806148 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1248/2670] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:28:47 2022] GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36 => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:28:47.910592 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [req-1744c50d-e198-4e5a-982a-d1ba9b9ecc48 req-074f29eb-ed40-46ee-92f3-57da6543b3a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "331f3231-997c-4260-8d91-d4dc89a10a36", "name": "network-vif-plugged", "status": "completed", "tag": "32d02ec6-75b8-4708-8af1-006306964125"}]} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:28:47.919341 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-1744c50d-e198-4e5a-982a-d1ba9b9ecc48 req-074f29eb-ed40-46ee-92f3-57da6543b3a1 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:47.920153 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-1744c50d-e198-4e5a-982a-d1ba9b9ecc48 req-074f29eb-ed40-46ee-92f3-57da6543b3a1 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:47.932444 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.compute.server_external_events [req-1744c50d-e198-4e5a-982a-d1ba9b9ecc48 req-074f29eb-ed40-46ee-92f3-57da6543b3a1 service nova] Creating event network-vif-plugged:32d02ec6-75b8-4708-8af1-006306964125 for instance 331f3231-997c-4260-8d91-d4dc89a10a36 on hv-cinder-84027 May 03 09:28:47.938573 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [req-1744c50d-e198-4e5a-982a-d1ba9b9ecc48 req-074f29eb-ed40-46ee-92f3-57da6543b3a1 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177583 May 03 09:28:47.939794 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1423/2671] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 09:28:47.986350 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-27f3035b-1813-4966-b6a8-368111c3dc63 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:47.987000 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-27f3035b-1813-4966-b6a8-368111c3dc63 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:47.993657 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-27f3035b-1813-4966-b6a8-368111c3dc63 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:47.994730 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-27f3035b-1813-4966-b6a8-368111c3dc63 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:47.996580 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-27f3035b-1813-4966-b6a8-368111c3dc63 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:47.997216 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-27f3035b-1813-4966-b6a8-368111c3dc63 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:48.065484 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-27f3035b-1813-4966-b6a8-368111c3dc63 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc2d7dd95774cb2b0b9c695f222b6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee51b7929c5e4bcc845946df0d46f6c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:28:48.073902 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-27f3035b-1813-4966-b6a8-368111c3dc63 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4" status: 200 len: 1262 microversion: 2.1 time: 0.092281 May 03 09:28:48.074840 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1249/2672] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:28:47 2022] GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4 => generated 1262 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:28:48.516965 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-27a36051-a83b-4637-a665-2f74cdf8e70d tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-502689782", "imageRef": "bd46d67a-108d-4c0c-9f0b-cb6d41c82a32", "flavorRef": "452", "networks": [{"uuid": "29fb7b07-95a4-4a0c-bae8-90cb0decdfff"}]}} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:28:48.572033 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.network.neutron [None req-27a36051-a83b-4637-a665-2f74cdf8e70d tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] validate_networks() for [('29fb7b07-95a4-4a0c-bae8-90cb0decdfff', None, None, None, None, None)] {{(pid=123391) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 03 09:28:48.823497 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6560310f-6671-488b-b028-feb37466f84d tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:48.824739 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6560310f-6671-488b-b028-feb37466f84d tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 331f3231-997c-4260-8d91-d4dc89a10a36] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:48.834347 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6560310f-6671-488b-b028-feb37466f84d tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:48.835307 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6560310f-6671-488b-b028-feb37466f84d tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:48.836766 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6560310f-6671-488b-b028-feb37466f84d tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:48.837561 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6560310f-6671-488b-b028-feb37466f84d tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:48.964443 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-27a36051-a83b-4637-a665-2f74cdf8e70d tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Flavor limits 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 03 09:28:48.965294 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-27a36051-a83b-4637-a665-2f74cdf8e70d tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Image limits 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 03 09:28:48.965825 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-27a36051-a83b-4637-a665-2f74cdf8e70d tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Flavor pref 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 03 09:28:48.966437 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-27a36051-a83b-4637-a665-2f74cdf8e70d tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Image pref 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 03 09:28:48.966972 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-27a36051-a83b-4637-a665-2f74cdf8e70d tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 03 09:28:48.977195 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-27a36051-a83b-4637-a665-2f74cdf8e70d tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:48.977632 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-27a36051-a83b-4637-a665-2f74cdf8e70d tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:48.978538 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-27a36051-a83b-4637-a665-2f74cdf8e70d tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:48.978966 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-27a36051-a83b-4637-a665-2f74cdf8e70d tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:48.996663 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.quota [None req-27a36051-a83b-4637-a665-2f74cdf8e70d tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Getting quotas for project 776d8b4a6b184d36853b520eb08eb38b. Resources: {'cores', 'ram', 'instances'} {{(pid=123391) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 03 09:28:49.001041 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.quota [None req-27a36051-a83b-4637-a665-2f74cdf8e70d tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Getting quotas for user 2e3d79c36cb244279d8b1f3ff1ca9c1f and project 776d8b4a6b184d36853b520eb08eb38b. Resources: {'cores', 'ram', 'instances'} {{(pid=123391) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 03 09:28:49.015319 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-27a36051-a83b-4637-a665-2f74cdf8e70d tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Going to run 1 instances... {{(pid=123391) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 03 09:28:49.016535 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6560310f-6671-488b-b028-feb37466f84d tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:28:49.019159 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-27a36051-a83b-4637-a665-2f74cdf8e70d tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] [instance: 44596b51-b2a3-4280-a38e-2305f666b661] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd46d67a-108d-4c0c-9f0b-cb6d41c82a32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123391) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 03 09:28:49.024018 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6560310f-6671-488b-b028-feb37466f84d tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36" status: 200 len: 1367 microversion: 2.1 time: 0.205145 May 03 09:28:49.024615 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1250/2673] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:28:48 2022] GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36 => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:28:49.072085 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-27a36051-a83b-4637-a665-2f74cdf8e70d tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.559441 May 03 09:28:49.072694 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1424/2674] 10.222.0.11 () {60 vars in 1146 bytes} [Tue May 3 09:28:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 03 09:28:49.084658 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6cbee769-21c4-455a-abbc-31b522c22d15 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:49.086248 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6cbee769-21c4-455a-abbc-31b522c22d15 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] [instance: 44596b51-b2a3-4280-a38e-2305f666b661] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:49.094774 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d47d5803-37a5-4214-8625-1d8ce0979b6d tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:49.095829 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d47d5803-37a5-4214-8625-1d8ce0979b6d tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:49.106239 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d47d5803-37a5-4214-8625-1d8ce0979b6d tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:49.107164 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d47d5803-37a5-4214-8625-1d8ce0979b6d tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:49.108427 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d47d5803-37a5-4214-8625-1d8ce0979b6d tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:49.109116 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d47d5803-37a5-4214-8625-1d8ce0979b6d tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:49.157371 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6cbee769-21c4-455a-abbc-31b522c22d15 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3d79c36cb244279d8b1f3ff1ca9c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '776d8b4a6b184d36853b520eb08eb38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:28:49.166501 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6cbee769-21c4-455a-abbc-31b522c22d15 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] 10.222.0.11 "GET /compute/v2.1/servers/44596b51-b2a3-4280-a38e-2305f666b661" status: 200 len: 1213 microversion: 2.1 time: 0.086454 May 03 09:28:49.168069 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1251/2675] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:28:49 2022] GET /compute/v2.1/servers/44596b51-b2a3-4280-a38e-2305f666b661 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:28:49.192652 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d47d5803-37a5-4214-8625-1d8ce0979b6d tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc2d7dd95774cb2b0b9c695f222b6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee51b7929c5e4bcc845946df0d46f6c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:28:49.206314 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d47d5803-37a5-4214-8625-1d8ce0979b6d tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4" status: 200 len: 1310 microversion: 2.1 time: 0.117605 May 03 09:28:49.207091 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1425/2676] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:28:49 2022] GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4 => generated 1310 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:28:50.043224 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f860be27-f6eb-4890-9bb5-0a77d50d7717 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:50.043966 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f860be27-f6eb-4890-9bb5-0a77d50d7717 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 331f3231-997c-4260-8d91-d4dc89a10a36] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:50.051241 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f860be27-f6eb-4890-9bb5-0a77d50d7717 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:50.051691 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f860be27-f6eb-4890-9bb5-0a77d50d7717 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:50.052497 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f860be27-f6eb-4890-9bb5-0a77d50d7717 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:50.052932 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f860be27-f6eb-4890-9bb5-0a77d50d7717 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:50.182399 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f860be27-f6eb-4890-9bb5-0a77d50d7717 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:28:50.184324 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-0a13ef65-ba2b-44b2-8a6b-7d249c595912 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:50.185020 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-0a13ef65-ba2b-44b2-8a6b-7d249c595912 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] [instance: 44596b51-b2a3-4280-a38e-2305f666b661] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:50.190216 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f860be27-f6eb-4890-9bb5-0a77d50d7717 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36" status: 200 len: 1367 microversion: 2.1 time: 0.152063 May 03 09:28:50.190802 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1252/2677] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:28:50 2022] GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:28:50.192370 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0a13ef65-ba2b-44b2-8a6b-7d249c595912 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:50.193008 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0a13ef65-ba2b-44b2-8a6b-7d249c595912 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:50.194113 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0a13ef65-ba2b-44b2-8a6b-7d249c595912 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:50.194698 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0a13ef65-ba2b-44b2-8a6b-7d249c595912 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:50.223757 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-50227b97-0a2e-4742-92fe-8d655882d2ac tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:50.224519 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-50227b97-0a2e-4742-92fe-8d655882d2ac tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:50.234006 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-50227b97-0a2e-4742-92fe-8d655882d2ac tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:50.234901 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-50227b97-0a2e-4742-92fe-8d655882d2ac tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:50.236333 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-50227b97-0a2e-4742-92fe-8d655882d2ac tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:50.237544 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-50227b97-0a2e-4742-92fe-8d655882d2ac tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:50.264968 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-0a13ef65-ba2b-44b2-8a6b-7d249c595912 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3d79c36cb244279d8b1f3ff1ca9c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '776d8b4a6b184d36853b520eb08eb38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:28:50.272689 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-0a13ef65-ba2b-44b2-8a6b-7d249c595912 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] 10.222.0.11 "GET /compute/v2.1/servers/44596b51-b2a3-4280-a38e-2305f666b661" status: 200 len: 1217 microversion: 2.1 time: 0.092269 May 03 09:28:50.273265 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1426/2678] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:28:50 2022] GET /compute/v2.1/servers/44596b51-b2a3-4280-a38e-2305f666b661 => generated 1217 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:28:50.303934 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-50227b97-0a2e-4742-92fe-8d655882d2ac tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc2d7dd95774cb2b0b9c695f222b6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee51b7929c5e4bcc845946df0d46f6c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:28:50.312195 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-50227b97-0a2e-4742-92fe-8d655882d2ac tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4" status: 200 len: 1310 microversion: 2.1 time: 0.092400 May 03 09:28:50.312982 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1253/2679] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:28:50 2022] GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4 => generated 1310 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:28:51.207922 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-acb3c111-6ecf-4bc9-ad3e-71f3c68d6ce1 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:51.208650 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-acb3c111-6ecf-4bc9-ad3e-71f3c68d6ce1 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 331f3231-997c-4260-8d91-d4dc89a10a36] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:51.216243 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-acb3c111-6ecf-4bc9-ad3e-71f3c68d6ce1 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:51.216845 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-acb3c111-6ecf-4bc9-ad3e-71f3c68d6ce1 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:51.217799 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-acb3c111-6ecf-4bc9-ad3e-71f3c68d6ce1 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:51.218400 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-acb3c111-6ecf-4bc9-ad3e-71f3c68d6ce1 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:51.290369 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-956c015d-b986-4041-ba98-142048e6dd51 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:51.291121 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-956c015d-b986-4041-ba98-142048e6dd51 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] [instance: 44596b51-b2a3-4280-a38e-2305f666b661] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:51.297942 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-956c015d-b986-4041-ba98-142048e6dd51 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:51.298397 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-956c015d-b986-4041-ba98-142048e6dd51 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:51.299189 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-956c015d-b986-4041-ba98-142048e6dd51 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:51.299629 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-956c015d-b986-4041-ba98-142048e6dd51 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:51.392070 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-956c015d-b986-4041-ba98-142048e6dd51 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3d79c36cb244279d8b1f3ff1ca9c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '776d8b4a6b184d36853b520eb08eb38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:28:51.392329 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-acb3c111-6ecf-4bc9-ad3e-71f3c68d6ce1 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:28:51.400913 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-956c015d-b986-4041-ba98-142048e6dd51 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] 10.222.0.11 "GET /compute/v2.1/servers/44596b51-b2a3-4280-a38e-2305f666b661" status: 200 len: 1209 microversion: 2.1 time: 0.114577 May 03 09:28:51.401891 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1254/2680] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:28:51 2022] GET /compute/v2.1/servers/44596b51-b2a3-4280-a38e-2305f666b661 => generated 1209 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:28:51.405104 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-acb3c111-6ecf-4bc9-ad3e-71f3c68d6ce1 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36" status: 200 len: 1367 microversion: 2.1 time: 0.201012 May 03 09:28:51.407989 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f268420a-8b2d-4771-9184-983e85430c5b tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:51.408954 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f268420a-8b2d-4771-9184-983e85430c5b tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:51.415471 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f268420a-8b2d-4771-9184-983e85430c5b tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:51.416297 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f268420a-8b2d-4771-9184-983e85430c5b tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:51.417344 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f268420a-8b2d-4771-9184-983e85430c5b tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:51.418129 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f268420a-8b2d-4771-9184-983e85430c5b tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:51.420549 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1427/2681] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:28:51 2022] GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36 => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:28:51.490983 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f268420a-8b2d-4771-9184-983e85430c5b tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc2d7dd95774cb2b0b9c695f222b6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee51b7929c5e4bcc845946df0d46f6c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:28:51.499266 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f268420a-8b2d-4771-9184-983e85430c5b tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4" status: 200 len: 1310 microversion: 2.1 time: 0.095960 May 03 09:28:51.499866 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1255/2682] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:28:51 2022] GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4 => generated 1310 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:28:52.419123 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-11475766-528e-4472-8e93-63d92ca6105d tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:52.420068 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-11475766-528e-4472-8e93-63d92ca6105d tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] [instance: 44596b51-b2a3-4280-a38e-2305f666b661] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:52.426283 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-11475766-528e-4472-8e93-63d92ca6105d tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:52.427016 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-11475766-528e-4472-8e93-63d92ca6105d tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:52.428002 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-11475766-528e-4472-8e93-63d92ca6105d tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:52.428596 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-11475766-528e-4472-8e93-63d92ca6105d tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:52.466799 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-fe857b37-c3e0-42b4-ba33-143fbff536cc tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:52.470004 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-fe857b37-c3e0-42b4-ba33-143fbff536cc tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 331f3231-997c-4260-8d91-d4dc89a10a36] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:52.485871 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fe857b37-c3e0-42b4-ba33-143fbff536cc tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:52.486867 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fe857b37-c3e0-42b4-ba33-143fbff536cc tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:52.488547 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fe857b37-c3e0-42b4-ba33-143fbff536cc tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:52.491185 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fe857b37-c3e0-42b4-ba33-143fbff536cc tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:52.569691 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-11475766-528e-4472-8e93-63d92ca6105d tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3d79c36cb244279d8b1f3ff1ca9c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '776d8b4a6b184d36853b520eb08eb38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:28:52.585341 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-11475766-528e-4472-8e93-63d92ca6105d tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] 10.222.0.11 "GET /compute/v2.1/servers/44596b51-b2a3-4280-a38e-2305f666b661" status: 200 len: 1273 microversion: 2.1 time: 0.169743 May 03 09:28:52.596389 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1428/2683] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:28:52 2022] GET /compute/v2.1/servers/44596b51-b2a3-4280-a38e-2305f666b661 => generated 1273 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:28:52.613019 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-cb4189f9-e38c-4157-9f00-b6a6abf8d1ff tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:52.613866 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-cb4189f9-e38c-4157-9f00-b6a6abf8d1ff tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:52.634876 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cb4189f9-e38c-4157-9f00-b6a6abf8d1ff tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:52.635334 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cb4189f9-e38c-4157-9f00-b6a6abf8d1ff tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:52.636164 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cb4189f9-e38c-4157-9f00-b6a6abf8d1ff tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:52.636668 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cb4189f9-e38c-4157-9f00-b6a6abf8d1ff tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:52.852621 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-cb4189f9-e38c-4157-9f00-b6a6abf8d1ff tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc2d7dd95774cb2b0b9c695f222b6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee51b7929c5e4bcc845946df0d46f6c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:28:52.864644 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-cb4189f9-e38c-4157-9f00-b6a6abf8d1ff tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4" status: 200 len: 1316 microversion: 2.1 time: 0.266033 May 03 09:28:52.865691 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1429/2684] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:28:52 2022] GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4 => generated 1316 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:28:53.022172 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-fe857b37-c3e0-42b4-ba33-143fbff536cc tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:28:53.031994 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-fe857b37-c3e0-42b4-ba33-143fbff536cc tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36" status: 200 len: 1556 microversion: 2.1 time: 0.592314 May 03 09:28:53.033146 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1256/2685] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:28:52 2022] GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36 => generated 1556 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:28:53.069700 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b32fe8e9-5f71-48f5-8ff3-6107cdcf4925 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:53.070820 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b32fe8e9-5f71-48f5-8ff3-6107cdcf4925 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 331f3231-997c-4260-8d91-d4dc89a10a36] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:53.083098 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b32fe8e9-5f71-48f5-8ff3-6107cdcf4925 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:53.084069 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b32fe8e9-5f71-48f5-8ff3-6107cdcf4925 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:53.085995 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b32fe8e9-5f71-48f5-8ff3-6107cdcf4925 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:53.086790 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b32fe8e9-5f71-48f5-8ff3-6107cdcf4925 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:53.330518 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b32fe8e9-5f71-48f5-8ff3-6107cdcf4925 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.273453 May 03 09:28:53.331661 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1430/2686] 10.222.0.11 () {58 vars in 1274 bytes} [Tue May 3 09:28:53 2022] GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36/os-interface => generated 284 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:28:53.618196 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9fe7649c-6340-47b7-99ec-74e061efc49d tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:53.620114 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9fe7649c-6340-47b7-99ec-74e061efc49d tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] [instance: 44596b51-b2a3-4280-a38e-2305f666b661] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:53.640587 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9fe7649c-6340-47b7-99ec-74e061efc49d tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:53.645300 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9fe7649c-6340-47b7-99ec-74e061efc49d tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:53.656166 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9fe7649c-6340-47b7-99ec-74e061efc49d tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:53.656838 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9fe7649c-6340-47b7-99ec-74e061efc49d tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:53.868590 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9fe7649c-6340-47b7-99ec-74e061efc49d tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3d79c36cb244279d8b1f3ff1ca9c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '776d8b4a6b184d36853b520eb08eb38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:28:53.887018 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-513e57a0-1151-41c8-bcd3-88d5706f3b94 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:53.897161 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-513e57a0-1151-41c8-bcd3-88d5706f3b94 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:53.908437 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9fe7649c-6340-47b7-99ec-74e061efc49d tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] 10.222.0.11 "GET /compute/v2.1/servers/44596b51-b2a3-4280-a38e-2305f666b661" status: 200 len: 1271 microversion: 2.1 time: 0.293584 May 03 09:28:53.915574 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1257/2687] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:28:53 2022] GET /compute/v2.1/servers/44596b51-b2a3-4280-a38e-2305f666b661 => generated 1271 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:28:53.918042 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-513e57a0-1151-41c8-bcd3-88d5706f3b94 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:53.928844 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-513e57a0-1151-41c8-bcd3-88d5706f3b94 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:53.930560 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-513e57a0-1151-41c8-bcd3-88d5706f3b94 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:53.931484 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-513e57a0-1151-41c8-bcd3-88d5706f3b94 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:54.409039 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-513e57a0-1151-41c8-bcd3-88d5706f3b94 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc2d7dd95774cb2b0b9c695f222b6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee51b7929c5e4bcc845946df0d46f6c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:28:54.423444 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-513e57a0-1151-41c8-bcd3-88d5706f3b94 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4" status: 200 len: 1358 microversion: 2.1 time: 0.543624 May 03 09:28:54.424852 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1431/2688] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:28:53 2022] GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4 => generated 1358 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:28:54.936420 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-1edb7a1d-87bd-4f84-9954-fa6e6fa157a0 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:54.937349 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-1edb7a1d-87bd-4f84-9954-fa6e6fa157a0 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] [instance: 44596b51-b2a3-4280-a38e-2305f666b661] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:54.959459 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1edb7a1d-87bd-4f84-9954-fa6e6fa157a0 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:54.960184 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1edb7a1d-87bd-4f84-9954-fa6e6fa157a0 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:54.961861 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1edb7a1d-87bd-4f84-9954-fa6e6fa157a0 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:54.962511 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1edb7a1d-87bd-4f84-9954-fa6e6fa157a0 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:55.382843 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [req-8118199f-1497-4c37-8c96-cb8a31b0421c req-6a1dc46b-7b39-4301-ac69-eb2235b6b6b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "331f3231-997c-4260-8d91-d4dc89a10a36", "tag": "32d02ec6-75b8-4708-8af1-006306964125"}]} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:28:55.399480 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-8118199f-1497-4c37-8c96-cb8a31b0421c req-6a1dc46b-7b39-4301-ac69-eb2235b6b6b1 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:55.400517 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-8118199f-1497-4c37-8c96-cb8a31b0421c req-6a1dc46b-7b39-4301-ac69-eb2235b6b6b1 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:55.437035 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.compute.server_external_events [req-8118199f-1497-4c37-8c96-cb8a31b0421c req-6a1dc46b-7b39-4301-ac69-eb2235b6b6b1 service nova] Creating event network-changed:32d02ec6-75b8-4708-8af1-006306964125 for instance 331f3231-997c-4260-8d91-d4dc89a10a36 on hv-cinder-84027 May 03 09:28:55.457672 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [req-8118199f-1497-4c37-8c96-cb8a31b0421c req-6a1dc46b-7b39-4301-ac69-eb2235b6b6b1 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082167 May 03 09:28:55.460719 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1432/2689] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:28:55.478226 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5d2756d1-2d65-4689-a2e1-6dae16b84c50 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:55.479730 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5d2756d1-2d65-4689-a2e1-6dae16b84c50 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:55.498920 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5d2756d1-2d65-4689-a2e1-6dae16b84c50 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:55.507453 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5d2756d1-2d65-4689-a2e1-6dae16b84c50 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:55.514025 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5d2756d1-2d65-4689-a2e1-6dae16b84c50 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:55.514584 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5d2756d1-2d65-4689-a2e1-6dae16b84c50 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:55.773075 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-1edb7a1d-87bd-4f84-9954-fa6e6fa157a0 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3d79c36cb244279d8b1f3ff1ca9c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '776d8b4a6b184d36853b520eb08eb38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:28:55.797726 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-1edb7a1d-87bd-4f84-9954-fa6e6fa157a0 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] 10.222.0.11 "GET /compute/v2.1/servers/44596b51-b2a3-4280-a38e-2305f666b661" status: 200 len: 1313 microversion: 2.1 time: 0.867758 May 03 09:28:55.813273 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1258/2690] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:28:54 2022] GET /compute/v2.1/servers/44596b51-b2a3-4280-a38e-2305f666b661 => generated 1313 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:28:55.977588 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5d2756d1-2d65-4689-a2e1-6dae16b84c50 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc2d7dd95774cb2b0b9c695f222b6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee51b7929c5e4bcc845946df0d46f6c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:28:55.991154 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5d2756d1-2d65-4689-a2e1-6dae16b84c50 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4" status: 200 len: 1358 microversion: 2.1 time: 0.522132 May 03 09:28:55.995233 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1433/2691] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:28:55 2022] GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4 => generated 1358 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:28:56.668427 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-c6c66d46-bb1e-4584-9f04-2057615c18af req-a40766ab-7669-40fb-ba0f-1bdc13180896 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55e6edb6-95bf-495b-8b94-b39ddffeadc4", "tag": "b896e9bb-b27d-45be-9b1c-47d98fd08dd5"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:28:56.712770 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-c6c66d46-bb1e-4584-9f04-2057615c18af req-a40766ab-7669-40fb-ba0f-1bdc13180896 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:56.713426 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-c6c66d46-bb1e-4584-9f04-2057615c18af req-a40766ab-7669-40fb-ba0f-1bdc13180896 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:56.796549 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-c6c66d46-bb1e-4584-9f04-2057615c18af req-a40766ab-7669-40fb-ba0f-1bdc13180896 service nova] Creating event network-changed:b896e9bb-b27d-45be-9b1c-47d98fd08dd5 for instance 55e6edb6-95bf-495b-8b94-b39ddffeadc4 on hv-cinder-84027 May 03 09:28:56.815357 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a40ab047-56d9-419a-b8a2-1011740e7631 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:56.817095 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a40ab047-56d9-419a-b8a2-1011740e7631 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] [instance: 44596b51-b2a3-4280-a38e-2305f666b661] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:56.820637 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-c6c66d46-bb1e-4584-9f04-2057615c18af req-a40766ab-7669-40fb-ba0f-1bdc13180896 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156702 May 03 09:28:56.822636 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1259/2692] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:28:56.859676 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a40ab047-56d9-419a-b8a2-1011740e7631 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:56.861908 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a40ab047-56d9-419a-b8a2-1011740e7631 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:56.864657 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a40ab047-56d9-419a-b8a2-1011740e7631 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:56.868649 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a40ab047-56d9-419a-b8a2-1011740e7631 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:57.026657 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ebe941bb-4f74-45bc-ab49-4b40db5dface tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:57.029004 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ebe941bb-4f74-45bc-ab49-4b40db5dface tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:57.054637 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ebe941bb-4f74-45bc-ab49-4b40db5dface tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:57.060144 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ebe941bb-4f74-45bc-ab49-4b40db5dface tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:57.062329 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ebe941bb-4f74-45bc-ab49-4b40db5dface tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:57.063241 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ebe941bb-4f74-45bc-ab49-4b40db5dface tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:58.438972 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a40ab047-56d9-419a-b8a2-1011740e7631 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3d79c36cb244279d8b1f3ff1ca9c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '776d8b4a6b184d36853b520eb08eb38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:28:58.463332 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a40ab047-56d9-419a-b8a2-1011740e7631 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] 10.222.0.11 "GET /compute/v2.1/servers/44596b51-b2a3-4280-a38e-2305f666b661" status: 200 len: 1313 microversion: 2.1 time: 1.650578 May 03 09:28:58.466310 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1434/2693] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:28:56 2022] GET /compute/v2.1/servers/44596b51-b2a3-4280-a38e-2305f666b661 => generated 1313 bytes in 1656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:28:58.567557 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ebe941bb-4f74-45bc-ab49-4b40db5dface tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc2d7dd95774cb2b0b9c695f222b6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee51b7929c5e4bcc845946df0d46f6c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:28:58.576899 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ebe941bb-4f74-45bc-ab49-4b40db5dface tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4" status: 200 len: 1358 microversion: 2.1 time: 1.558072 May 03 09:28:58.588521 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1260/2694] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:28:57 2022] GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4 => generated 1358 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:28:59.121133 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [req-e62798ff-ca06-40d2-884b-d473bdc1837e req-071c259f-cc33-4646-958a-ca0a6e8d0b73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44596b51-b2a3-4280-a38e-2305f666b661", "tag": "24ce1d78-e275-4e98-a4ee-8a93b7f781a6"}]} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:28:59.153203 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-e62798ff-ca06-40d2-884b-d473bdc1837e req-071c259f-cc33-4646-958a-ca0a6e8d0b73 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:59.157106 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-e62798ff-ca06-40d2-884b-d473bdc1837e req-071c259f-cc33-4646-958a-ca0a6e8d0b73 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:59.190670 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.compute.server_external_events [req-e62798ff-ca06-40d2-884b-d473bdc1837e req-071c259f-cc33-4646-958a-ca0a6e8d0b73 service nova] Creating event network-changed:24ce1d78-e275-4e98-a4ee-8a93b7f781a6 for instance 44596b51-b2a3-4280-a38e-2305f666b661 on hv-cinder-84027 May 03 09:28:59.197134 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [req-e62798ff-ca06-40d2-884b-d473bdc1837e req-071c259f-cc33-4646-958a-ca0a6e8d0b73 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081390 May 03 09:28:59.198502 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1435/2695] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:28:59.489402 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-748c1f36-2014-4a65-a90d-cb83f079e36d tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:59.491716 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-748c1f36-2014-4a65-a90d-cb83f079e36d tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] [instance: 44596b51-b2a3-4280-a38e-2305f666b661] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:59.516968 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-748c1f36-2014-4a65-a90d-cb83f079e36d tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:59.518214 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-748c1f36-2014-4a65-a90d-cb83f079e36d tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:59.520091 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-748c1f36-2014-4a65-a90d-cb83f079e36d tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:59.521818 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-748c1f36-2014-4a65-a90d-cb83f079e36d tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:59.597259 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c5476fae-24ca-46f0-8d76-c53090985876 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:28:59.598227 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c5476fae-24ca-46f0-8d76-c53090985876 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:28:59.608221 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c5476fae-24ca-46f0-8d76-c53090985876 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:59.608665 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c5476fae-24ca-46f0-8d76-c53090985876 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:59.617628 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c5476fae-24ca-46f0-8d76-c53090985876 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:28:59.618352 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c5476fae-24ca-46f0-8d76-c53090985876 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:28:59.949530 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-748c1f36-2014-4a65-a90d-cb83f079e36d tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3d79c36cb244279d8b1f3ff1ca9c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '776d8b4a6b184d36853b520eb08eb38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:28:59.960925 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-748c1f36-2014-4a65-a90d-cb83f079e36d tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] 10.222.0.11 "GET /compute/v2.1/servers/44596b51-b2a3-4280-a38e-2305f666b661" status: 200 len: 1313 microversion: 2.1 time: 0.478319 May 03 09:28:59.962236 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1261/2696] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:28:59 2022] GET /compute/v2.1/servers/44596b51-b2a3-4280-a38e-2305f666b661 => generated 1313 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:00.018116 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c5476fae-24ca-46f0-8d76-c53090985876 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc2d7dd95774cb2b0b9c695f222b6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee51b7929c5e4bcc845946df0d46f6c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:00.034980 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c5476fae-24ca-46f0-8d76-c53090985876 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4" status: 200 len: 1358 microversion: 2.1 time: 0.442677 May 03 09:29:00.041497 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1436/2697] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:28:59 2022] GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4 => generated 1358 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:29:00.990291 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-aa28f0e2-6c0f-4a02-ab20-f09cd83118c0 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:00.991144 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-aa28f0e2-6c0f-4a02-ab20-f09cd83118c0 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] [instance: 44596b51-b2a3-4280-a38e-2305f666b661] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:00.998112 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aa28f0e2-6c0f-4a02-ab20-f09cd83118c0 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:00.998807 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aa28f0e2-6c0f-4a02-ab20-f09cd83118c0 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:00.999593 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aa28f0e2-6c0f-4a02-ab20-f09cd83118c0 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:01.000537 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aa28f0e2-6c0f-4a02-ab20-f09cd83118c0 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:01.059633 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-7360e6d9-5cb0-4bdc-835f-17ee17faf5b6 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:01.060624 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-7360e6d9-5cb0-4bdc-835f-17ee17faf5b6 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:01.072620 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7360e6d9-5cb0-4bdc-835f-17ee17faf5b6 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:01.073451 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7360e6d9-5cb0-4bdc-835f-17ee17faf5b6 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:01.080931 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7360e6d9-5cb0-4bdc-835f-17ee17faf5b6 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:01.081772 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7360e6d9-5cb0-4bdc-835f-17ee17faf5b6 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:01.335060 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-aa28f0e2-6c0f-4a02-ab20-f09cd83118c0 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3d79c36cb244279d8b1f3ff1ca9c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '776d8b4a6b184d36853b520eb08eb38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:01.354425 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-aa28f0e2-6c0f-4a02-ab20-f09cd83118c0 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] 10.222.0.11 "GET /compute/v2.1/servers/44596b51-b2a3-4280-a38e-2305f666b661" status: 200 len: 1313 microversion: 2.1 time: 0.367992 May 03 09:29:01.355021 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1262/2698] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:00 2022] GET /compute/v2.1/servers/44596b51-b2a3-4280-a38e-2305f666b661 => generated 1313 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:29:01.377374 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7360e6d9-5cb0-4bdc-835f-17ee17faf5b6 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc2d7dd95774cb2b0b9c695f222b6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee51b7929c5e4bcc845946df0d46f6c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:01.385971 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-7360e6d9-5cb0-4bdc-835f-17ee17faf5b6 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4" status: 200 len: 1358 microversion: 2.1 time: 0.330169 May 03 09:29:01.394695 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1437/2699] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:01 2022] GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4 => generated 1358 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:02.384243 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-1c371b57-6f77-41e6-972d-06407495c8d3 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:02.385437 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-1c371b57-6f77-41e6-972d-06407495c8d3 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] [instance: 44596b51-b2a3-4280-a38e-2305f666b661] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:02.395342 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1c371b57-6f77-41e6-972d-06407495c8d3 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:02.396097 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1c371b57-6f77-41e6-972d-06407495c8d3 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:02.397319 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1c371b57-6f77-41e6-972d-06407495c8d3 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:02.398431 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1c371b57-6f77-41e6-972d-06407495c8d3 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:02.405037 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-31305a19-365e-43c4-8a2c-4f80e2dee105 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:02.405873 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-31305a19-365e-43c4-8a2c-4f80e2dee105 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:02.418296 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-31305a19-365e-43c4-8a2c-4f80e2dee105 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:02.418791 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-31305a19-365e-43c4-8a2c-4f80e2dee105 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:02.419564 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-31305a19-365e-43c4-8a2c-4f80e2dee105 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:02.420214 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-31305a19-365e-43c4-8a2c-4f80e2dee105 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:02.621226 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-1c371b57-6f77-41e6-972d-06407495c8d3 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3d79c36cb244279d8b1f3ff1ca9c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '776d8b4a6b184d36853b520eb08eb38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:02.632600 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-1c371b57-6f77-41e6-972d-06407495c8d3 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] 10.222.0.11 "GET /compute/v2.1/servers/44596b51-b2a3-4280-a38e-2305f666b661" status: 200 len: 1313 microversion: 2.1 time: 0.254716 May 03 09:29:02.633506 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1263/2700] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:02 2022] GET /compute/v2.1/servers/44596b51-b2a3-4280-a38e-2305f666b661 => generated 1313 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:02.635349 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-31305a19-365e-43c4-8a2c-4f80e2dee105 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc2d7dd95774cb2b0b9c695f222b6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee51b7929c5e4bcc845946df0d46f6c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:02.644299 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-31305a19-365e-43c4-8a2c-4f80e2dee105 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4" status: 200 len: 1358 microversion: 2.1 time: 0.245394 May 03 09:29:02.645121 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1438/2701] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:02 2022] GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4 => generated 1358 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:03.649911 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-92d7d16c-6d17-4be8-8b15-14c87fe0b926 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:03.650535 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-92d7d16c-6d17-4be8-8b15-14c87fe0b926 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] [instance: 44596b51-b2a3-4280-a38e-2305f666b661] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:03.657678 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-92d7d16c-6d17-4be8-8b15-14c87fe0b926 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:03.658126 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-92d7d16c-6d17-4be8-8b15-14c87fe0b926 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:03.658888 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-92d7d16c-6d17-4be8-8b15-14c87fe0b926 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:03.659313 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-92d7d16c-6d17-4be8-8b15-14c87fe0b926 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:03.661570 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ed7a7030-3869-47d0-990e-81bc6ff7857c tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:03.662226 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ed7a7030-3869-47d0-990e-81bc6ff7857c tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:03.669245 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ed7a7030-3869-47d0-990e-81bc6ff7857c tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:03.669693 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ed7a7030-3869-47d0-990e-81bc6ff7857c tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:03.670449 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ed7a7030-3869-47d0-990e-81bc6ff7857c tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:03.670875 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ed7a7030-3869-47d0-990e-81bc6ff7857c tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:03.868192 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ed7a7030-3869-47d0-990e-81bc6ff7857c tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc2d7dd95774cb2b0b9c695f222b6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee51b7929c5e4bcc845946df0d46f6c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:03.871338 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-92d7d16c-6d17-4be8-8b15-14c87fe0b926 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3d79c36cb244279d8b1f3ff1ca9c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '776d8b4a6b184d36853b520eb08eb38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:03.876328 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ed7a7030-3869-47d0-990e-81bc6ff7857c tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4" status: 200 len: 1358 microversion: 2.1 time: 0.218514 May 03 09:29:03.877001 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1439/2702] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:03 2022] GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4 => generated 1358 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:03.879464 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-92d7d16c-6d17-4be8-8b15-14c87fe0b926 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] 10.222.0.11 "GET /compute/v2.1/servers/44596b51-b2a3-4280-a38e-2305f666b661" status: 200 len: 1313 microversion: 2.1 time: 0.233438 May 03 09:29:03.880031 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1264/2703] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:03 2022] GET /compute/v2.1/servers/44596b51-b2a3-4280-a38e-2305f666b661 => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:04.899009 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5d6bf323-de13-41f7-b439-f81a82907b4f tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:04.899614 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5d6bf323-de13-41f7-b439-f81a82907b4f tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:04.901396 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-efcc18e1-cc11-46cb-a64a-e021f29e3d18 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:04.902217 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-efcc18e1-cc11-46cb-a64a-e021f29e3d18 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] [instance: 44596b51-b2a3-4280-a38e-2305f666b661] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:04.906342 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5d6bf323-de13-41f7-b439-f81a82907b4f tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:04.906988 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5d6bf323-de13-41f7-b439-f81a82907b4f tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:04.907881 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5d6bf323-de13-41f7-b439-f81a82907b4f tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:04.908316 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5d6bf323-de13-41f7-b439-f81a82907b4f tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:04.909825 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-efcc18e1-cc11-46cb-a64a-e021f29e3d18 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:04.910328 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-efcc18e1-cc11-46cb-a64a-e021f29e3d18 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:04.911216 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-efcc18e1-cc11-46cb-a64a-e021f29e3d18 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:04.911707 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-efcc18e1-cc11-46cb-a64a-e021f29e3d18 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:05.271290 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5d6bf323-de13-41f7-b439-f81a82907b4f tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc2d7dd95774cb2b0b9c695f222b6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee51b7929c5e4bcc845946df0d46f6c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:05.274200 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-efcc18e1-cc11-46cb-a64a-e021f29e3d18 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3d79c36cb244279d8b1f3ff1ca9c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '776d8b4a6b184d36853b520eb08eb38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:05.284380 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-efcc18e1-cc11-46cb-a64a-e021f29e3d18 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] 10.222.0.11 "GET /compute/v2.1/servers/44596b51-b2a3-4280-a38e-2305f666b661" status: 200 len: 1313 microversion: 2.1 time: 0.387355 May 03 09:29:05.286162 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5d6bf323-de13-41f7-b439-f81a82907b4f tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4" status: 200 len: 1358 microversion: 2.1 time: 0.390917 May 03 09:29:05.287296 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1440/2704] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:04 2022] GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4 => generated 1358 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:05.294744 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1265/2705] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:04 2022] GET /compute/v2.1/servers/44596b51-b2a3-4280-a38e-2305f666b661 => generated 1313 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:29:06.304949 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-648ddfc3-6b65-4aaf-bdf8-ad8723be603b tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:06.306497 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-3146793d-513f-4958-9282-3b552a24b124 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:06.307238 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-648ddfc3-6b65-4aaf-bdf8-ad8723be603b tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] [instance: 44596b51-b2a3-4280-a38e-2305f666b661] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:06.307633 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-3146793d-513f-4958-9282-3b552a24b124 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:06.317918 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-648ddfc3-6b65-4aaf-bdf8-ad8723be603b tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:06.318188 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3146793d-513f-4958-9282-3b552a24b124 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:06.318650 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-648ddfc3-6b65-4aaf-bdf8-ad8723be603b tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:06.318778 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3146793d-513f-4958-9282-3b552a24b124 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:06.320055 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-648ddfc3-6b65-4aaf-bdf8-ad8723be603b tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:06.320247 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3146793d-513f-4958-9282-3b552a24b124 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:06.321319 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-648ddfc3-6b65-4aaf-bdf8-ad8723be603b tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:06.321485 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3146793d-513f-4958-9282-3b552a24b124 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:06.984215 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-3146793d-513f-4958-9282-3b552a24b124 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc2d7dd95774cb2b0b9c695f222b6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee51b7929c5e4bcc845946df0d46f6c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:06.992142 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-3146793d-513f-4958-9282-3b552a24b124 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4" status: 200 len: 1358 microversion: 2.1 time: 0.691952 May 03 09:29:06.992731 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1266/2706] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:06 2022] GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4 => generated 1358 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:07.006075 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-648ddfc3-6b65-4aaf-bdf8-ad8723be603b tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3d79c36cb244279d8b1f3ff1ca9c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '776d8b4a6b184d36853b520eb08eb38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:07.015314 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-648ddfc3-6b65-4aaf-bdf8-ad8723be603b tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] 10.222.0.11 "GET /compute/v2.1/servers/44596b51-b2a3-4280-a38e-2305f666b661" status: 200 len: 1313 microversion: 2.1 time: 0.718081 May 03 09:29:07.016157 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1441/2707] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:06 2022] GET /compute/v2.1/servers/44596b51-b2a3-4280-a38e-2305f666b661 => generated 1313 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:08.011041 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-91669673-60c2-425c-8d2b-2c88271fd437 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:08.011685 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-91669673-60c2-425c-8d2b-2c88271fd437 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:08.018300 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-91669673-60c2-425c-8d2b-2c88271fd437 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:08.018677 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-91669673-60c2-425c-8d2b-2c88271fd437 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:08.019522 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-91669673-60c2-425c-8d2b-2c88271fd437 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:08.019923 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-91669673-60c2-425c-8d2b-2c88271fd437 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:08.036229 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-8b054b2d-fa92-4386-90e5-f190ab6648ed tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:08.037810 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-8b054b2d-fa92-4386-90e5-f190ab6648ed tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] [instance: 44596b51-b2a3-4280-a38e-2305f666b661] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:08.045845 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8b054b2d-fa92-4386-90e5-f190ab6648ed tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:08.046392 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8b054b2d-fa92-4386-90e5-f190ab6648ed tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:08.047347 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8b054b2d-fa92-4386-90e5-f190ab6648ed tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:08.048002 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8b054b2d-fa92-4386-90e5-f190ab6648ed tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:08.231612 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-91669673-60c2-425c-8d2b-2c88271fd437 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc2d7dd95774cb2b0b9c695f222b6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee51b7929c5e4bcc845946df0d46f6c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:08.236577 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-8b054b2d-fa92-4386-90e5-f190ab6648ed tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3d79c36cb244279d8b1f3ff1ca9c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '776d8b4a6b184d36853b520eb08eb38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:08.245025 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-91669673-60c2-425c-8d2b-2c88271fd437 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4" status: 200 len: 1358 microversion: 2.1 time: 0.238208 May 03 09:29:08.246483 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1267/2708] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:08 2022] GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4 => generated 1358 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:08.249551 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-8b054b2d-fa92-4386-90e5-f190ab6648ed tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] 10.222.0.11 "GET /compute/v2.1/servers/44596b51-b2a3-4280-a38e-2305f666b661" status: 200 len: 1313 microversion: 2.1 time: 0.218927 May 03 09:29:08.250905 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1442/2709] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:08 2022] GET /compute/v2.1/servers/44596b51-b2a3-4280-a38e-2305f666b661 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:29:09.266462 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-55b6c6b3-6fea-43f8-9d37-cdda24055afa tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:09.267342 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d44d9e0f-3864-4af8-b290-1db726b62a18 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:09.267891 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-55b6c6b3-6fea-43f8-9d37-cdda24055afa tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:09.268048 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d44d9e0f-3864-4af8-b290-1db726b62a18 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] [instance: 44596b51-b2a3-4280-a38e-2305f666b661] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:09.274249 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d44d9e0f-3864-4af8-b290-1db726b62a18 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:09.274626 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-55b6c6b3-6fea-43f8-9d37-cdda24055afa tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:09.274812 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d44d9e0f-3864-4af8-b290-1db726b62a18 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:09.275020 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-55b6c6b3-6fea-43f8-9d37-cdda24055afa tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:09.275524 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d44d9e0f-3864-4af8-b290-1db726b62a18 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:09.275714 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-55b6c6b3-6fea-43f8-9d37-cdda24055afa tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:09.276021 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d44d9e0f-3864-4af8-b290-1db726b62a18 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:09.276221 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-55b6c6b3-6fea-43f8-9d37-cdda24055afa tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:09.494120 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d44d9e0f-3864-4af8-b290-1db726b62a18 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3d79c36cb244279d8b1f3ff1ca9c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '776d8b4a6b184d36853b520eb08eb38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:09.501545 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-55b6c6b3-6fea-43f8-9d37-cdda24055afa tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc2d7dd95774cb2b0b9c695f222b6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee51b7929c5e4bcc845946df0d46f6c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:09.506475 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d44d9e0f-3864-4af8-b290-1db726b62a18 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] 10.222.0.11 "GET /compute/v2.1/servers/44596b51-b2a3-4280-a38e-2305f666b661" status: 200 len: 1313 microversion: 2.1 time: 0.243456 May 03 09:29:09.507989 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1443/2710] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:09 2022] GET /compute/v2.1/servers/44596b51-b2a3-4280-a38e-2305f666b661 => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:29:09.518579 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-55b6c6b3-6fea-43f8-9d37-cdda24055afa tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4" status: 200 len: 1358 microversion: 2.1 time: 0.247300 May 03 09:29:09.518579 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1268/2711] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:09 2022] GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4 => generated 1358 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:10.046644 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-566a7dbc-555a-4187-89fc-75417f07ad5d req-a2c582bf-2491-4470-afbc-090f01fa6c77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55e6edb6-95bf-495b-8b94-b39ddffeadc4", "name": "network-vif-plugged", "status": "completed", "tag": "b896e9bb-b27d-45be-9b1c-47d98fd08dd5"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:29:10.060303 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-566a7dbc-555a-4187-89fc-75417f07ad5d req-a2c582bf-2491-4470-afbc-090f01fa6c77 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:10.060759 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-566a7dbc-555a-4187-89fc-75417f07ad5d req-a2c582bf-2491-4470-afbc-090f01fa6c77 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:10.075370 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-566a7dbc-555a-4187-89fc-75417f07ad5d req-a2c582bf-2491-4470-afbc-090f01fa6c77 service nova] Creating event network-vif-plugged:b896e9bb-b27d-45be-9b1c-47d98fd08dd5 for instance 55e6edb6-95bf-495b-8b94-b39ddffeadc4 on hv-cinder-84027 May 03 09:29:10.082248 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-566a7dbc-555a-4187-89fc-75417f07ad5d req-a2c582bf-2491-4470-afbc-090f01fa6c77 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044312 May 03 09:29:10.082880 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1269/2712] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:29:10.529070 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ac510d63-3b18-4c55-b573-121e9bb207c1 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:10.531482 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ac510d63-3b18-4c55-b573-121e9bb207c1 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] [instance: 44596b51-b2a3-4280-a38e-2305f666b661] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:10.532515 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-8f9ae8e8-84bf-4650-9462-370aa3aa192c tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:10.533691 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-8f9ae8e8-84bf-4650-9462-370aa3aa192c tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:10.543409 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ac510d63-3b18-4c55-b573-121e9bb207c1 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:10.543951 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8f9ae8e8-84bf-4650-9462-370aa3aa192c tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:10.544162 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ac510d63-3b18-4c55-b573-121e9bb207c1 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:10.544626 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8f9ae8e8-84bf-4650-9462-370aa3aa192c tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:10.545618 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ac510d63-3b18-4c55-b573-121e9bb207c1 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:10.546127 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8f9ae8e8-84bf-4650-9462-370aa3aa192c tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:10.546811 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8f9ae8e8-84bf-4650-9462-370aa3aa192c tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:10.546950 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ac510d63-3b18-4c55-b573-121e9bb207c1 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:10.776602 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ac510d63-3b18-4c55-b573-121e9bb207c1 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3d79c36cb244279d8b1f3ff1ca9c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '776d8b4a6b184d36853b520eb08eb38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:10.776887 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-8f9ae8e8-84bf-4650-9462-370aa3aa192c tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc2d7dd95774cb2b0b9c695f222b6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee51b7929c5e4bcc845946df0d46f6c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:10.785243 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ac510d63-3b18-4c55-b573-121e9bb207c1 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] 10.222.0.11 "GET /compute/v2.1/servers/44596b51-b2a3-4280-a38e-2305f666b661" status: 200 len: 1313 microversion: 2.1 time: 0.262270 May 03 09:29:10.786199 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1444/2713] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:10 2022] GET /compute/v2.1/servers/44596b51-b2a3-4280-a38e-2305f666b661 => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:10.790917 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-8f9ae8e8-84bf-4650-9462-370aa3aa192c tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4" status: 200 len: 1358 microversion: 2.1 time: 0.265484 May 03 09:29:10.791701 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1270/2714] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:10 2022] GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4 => generated 1358 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:11.811484 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-10f84eb2-37de-4324-b06d-c859485d4b88 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:11.812551 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-10f84eb2-37de-4324-b06d-c859485d4b88 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] [instance: 44596b51-b2a3-4280-a38e-2305f666b661] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:11.815191 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-99ad0525-37cd-4819-9eb8-0baacefc402e tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:11.817903 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-99ad0525-37cd-4819-9eb8-0baacefc402e tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:11.821295 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-10f84eb2-37de-4324-b06d-c859485d4b88 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:11.821819 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-10f84eb2-37de-4324-b06d-c859485d4b88 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:11.822795 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-10f84eb2-37de-4324-b06d-c859485d4b88 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:11.823614 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-10f84eb2-37de-4324-b06d-c859485d4b88 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:11.834745 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-99ad0525-37cd-4819-9eb8-0baacefc402e tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:11.834745 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-99ad0525-37cd-4819-9eb8-0baacefc402e tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:11.834745 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-99ad0525-37cd-4819-9eb8-0baacefc402e tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:11.836120 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-99ad0525-37cd-4819-9eb8-0baacefc402e tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:12.072960 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-99ad0525-37cd-4819-9eb8-0baacefc402e tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc2d7dd95774cb2b0b9c695f222b6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee51b7929c5e4bcc845946df0d46f6c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:12.084063 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-99ad0525-37cd-4819-9eb8-0baacefc402e tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4" status: 200 len: 1549 microversion: 2.1 time: 0.280219 May 03 09:29:12.084402 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-10f84eb2-37de-4324-b06d-c859485d4b88 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3d79c36cb244279d8b1f3ff1ca9c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '776d8b4a6b184d36853b520eb08eb38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:12.086375 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1445/2715] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:11 2022] GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4 => generated 1549 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:12.092998 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-10f84eb2-37de-4324-b06d-c859485d4b88 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] 10.222.0.11 "GET /compute/v2.1/servers/44596b51-b2a3-4280-a38e-2305f666b661" status: 200 len: 1313 microversion: 2.1 time: 0.286736 May 03 09:29:12.093555 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1271/2716] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:11 2022] GET /compute/v2.1/servers/44596b51-b2a3-4280-a38e-2305f666b661 => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:29:12.113170 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-076b28a1-096c-4063-82be-c2d0a50f04d6 req-8384bf0e-69e4-4f26-9380-5c386599e2d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44596b51-b2a3-4280-a38e-2305f666b661", "name": "network-vif-plugged", "status": "completed", "tag": "24ce1d78-e275-4e98-a4ee-8a93b7f781a6"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:29:12.115972 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3faa68f4-4cce-4e5f-8f7e-fc2cd5708de1 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:12.117066 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-3faa68f4-4cce-4e5f-8f7e-fc2cd5708de1 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:12.121551 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-076b28a1-096c-4063-82be-c2d0a50f04d6 req-8384bf0e-69e4-4f26-9380-5c386599e2d9 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:12.121982 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-076b28a1-096c-4063-82be-c2d0a50f04d6 req-8384bf0e-69e4-4f26-9380-5c386599e2d9 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:12.126183 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3faa68f4-4cce-4e5f-8f7e-fc2cd5708de1 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:12.127200 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3faa68f4-4cce-4e5f-8f7e-fc2cd5708de1 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:12.128829 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3faa68f4-4cce-4e5f-8f7e-fc2cd5708de1 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:12.129541 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3faa68f4-4cce-4e5f-8f7e-fc2cd5708de1 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:12.140645 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-076b28a1-096c-4063-82be-c2d0a50f04d6 req-8384bf0e-69e4-4f26-9380-5c386599e2d9 service nova] Creating event network-vif-plugged:24ce1d78-e275-4e98-a4ee-8a93b7f781a6 for instance 44596b51-b2a3-4280-a38e-2305f666b661 on hv-cinder-84027 May 03 09:29:12.149204 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-076b28a1-096c-4063-82be-c2d0a50f04d6 req-8384bf0e-69e4-4f26-9380-5c386599e2d9 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039504 May 03 09:29:12.150482 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1272/2717] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:29:12.325326 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-3faa68f4-4cce-4e5f-8f7e-fc2cd5708de1 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc2d7dd95774cb2b0b9c695f222b6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee51b7929c5e4bcc845946df0d46f6c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:12.337478 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-3faa68f4-4cce-4e5f-8f7e-fc2cd5708de1 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4" status: 200 len: 1549 microversion: 2.1 time: 0.227903 May 03 09:29:12.338856 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1446/2718] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:12 2022] GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4 => generated 1549 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:12.366449 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-bf911771-b46a-43e3-b560-e4390e5e1b2c tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:12.372469 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-bf911771-b46a-43e3-b560-e4390e5e1b2c tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8cc2d7dd95774cb2b0b9c695f222b6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee51b7929c5e4bcc845946df0d46f6c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:12.373725 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-bf911771-b46a-43e3-b560-e4390e5e1b2c tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Searching by: {'deleted': False, 'project_id': 'ee51b7929c5e4bcc845946df0d46f6c6'} {{(pid=123392) get_all /opt/stack/nova/nova/compute/api.py:2960}} May 03 09:29:12.384372 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bf911771-b46a-43e3-b560-e4390e5e1b2c tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:12.385045 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bf911771-b46a-43e3-b560-e4390e5e1b2c tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:12.386467 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bf911771-b46a-43e3-b560-e4390e5e1b2c tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:12.387152 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bf911771-b46a-43e3-b560-e4390e5e1b2c tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:12.517785 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.multi_cell_list [None req-bf911771-b46a-43e3-b560-e4390e5e1b2c tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123392) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 03 09:29:12.638806 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-bf911771-b46a-43e3-b560-e4390e5e1b2c tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.279466 May 03 09:29:12.639406 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1273/2719] 10.222.0.11 () {58 vars in 1124 bytes} [Tue May 3 09:29:12 2022] GET /compute/v2.1/servers => generated 342 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:29:12.651269 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e3d0cf5f-a980-4e81-b0b6-9388182159bb tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:12.652079 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e3d0cf5f-a980-4e81-b0b6-9388182159bb tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:12.659588 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e3d0cf5f-a980-4e81-b0b6-9388182159bb tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:12.660325 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e3d0cf5f-a980-4e81-b0b6-9388182159bb tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:12.661185 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e3d0cf5f-a980-4e81-b0b6-9388182159bb tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:12.661700 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e3d0cf5f-a980-4e81-b0b6-9388182159bb tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:12.849535 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e3d0cf5f-a980-4e81-b0b6-9388182159bb tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc2d7dd95774cb2b0b9c695f222b6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee51b7929c5e4bcc845946df0d46f6c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:12.862897 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e3d0cf5f-a980-4e81-b0b6-9388182159bb tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4" status: 200 len: 1549 microversion: 2.1 time: 0.216258 May 03 09:29:12.863566 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1447/2720] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:12 2022] GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4 => generated 1549 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:29:13.118426 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ca5bda15-4b33-45e7-8f33-0efe14e112ea tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:13.119424 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ca5bda15-4b33-45e7-8f33-0efe14e112ea tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] [instance: 44596b51-b2a3-4280-a38e-2305f666b661] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:13.130907 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ca5bda15-4b33-45e7-8f33-0efe14e112ea tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:13.132148 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ca5bda15-4b33-45e7-8f33-0efe14e112ea tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:13.133199 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ca5bda15-4b33-45e7-8f33-0efe14e112ea tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:13.133960 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ca5bda15-4b33-45e7-8f33-0efe14e112ea tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:13.357753 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ca5bda15-4b33-45e7-8f33-0efe14e112ea tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3d79c36cb244279d8b1f3ff1ca9c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '776d8b4a6b184d36853b520eb08eb38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:13.365697 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ca5bda15-4b33-45e7-8f33-0efe14e112ea tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] 10.222.0.11 "GET /compute/v2.1/servers/44596b51-b2a3-4280-a38e-2305f666b661" status: 200 len: 1313 microversion: 2.1 time: 0.254960 May 03 09:29:13.366295 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1274/2721] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:13 2022] GET /compute/v2.1/servers/44596b51-b2a3-4280-a38e-2305f666b661 => generated 1313 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:29:14.392927 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-76d1c2ec-e14f-4a0e-80a6-5afd3e70b252 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:14.393950 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-76d1c2ec-e14f-4a0e-80a6-5afd3e70b252 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] [instance: 44596b51-b2a3-4280-a38e-2305f666b661] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:14.408438 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-76d1c2ec-e14f-4a0e-80a6-5afd3e70b252 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:14.409240 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-76d1c2ec-e14f-4a0e-80a6-5afd3e70b252 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:14.417425 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-76d1c2ec-e14f-4a0e-80a6-5afd3e70b252 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:14.417873 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-76d1c2ec-e14f-4a0e-80a6-5afd3e70b252 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:14.523839 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-55e7a68c-c8af-4ba5-bee9-d3b9d0510009 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1814ded1-e16e-4470-814c-5da825f9b099"}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:29:14.525496 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-55e7a68c-c8af-4ba5-bee9-d3b9d0510009 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:14.532945 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-55e7a68c-c8af-4ba5-bee9-d3b9d0510009 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:14.533635 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-55e7a68c-c8af-4ba5-bee9-d3b9d0510009 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:14.534573 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-55e7a68c-c8af-4ba5-bee9-d3b9d0510009 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:14.535170 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-55e7a68c-c8af-4ba5-bee9-d3b9d0510009 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:14.588069 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-76d1c2ec-e14f-4a0e-80a6-5afd3e70b252 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3d79c36cb244279d8b1f3ff1ca9c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '776d8b4a6b184d36853b520eb08eb38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:14.596066 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-76d1c2ec-e14f-4a0e-80a6-5afd3e70b252 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] 10.222.0.11 "GET /compute/v2.1/servers/44596b51-b2a3-4280-a38e-2305f666b661" status: 200 len: 1496 microversion: 2.1 time: 0.210904 May 03 09:29:14.596634 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1448/2722] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:14 2022] GET /compute/v2.1/servers/44596b51-b2a3-4280-a38e-2305f666b661 => generated 1496 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:14.954486 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-55e7a68c-c8af-4ba5-bee9-d3b9d0510009 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "POST /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.434239 May 03 09:29:14.955806 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1275/2723] 10.222.0.11 () {60 vars in 1322 bytes} [Tue May 3 09:29:14 2022] POST /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4/os-volume_attachments => generated 194 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 09:29:15.086412 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-809b2a0c-0667-48b4-a918-a33861dec9a9 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:15.086973 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-809b2a0c-0667-48b4-a918-a33861dec9a9 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] [instance: 44596b51-b2a3-4280-a38e-2305f666b661] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:15.094865 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-809b2a0c-0667-48b4-a918-a33861dec9a9 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:15.095378 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-809b2a0c-0667-48b4-a918-a33861dec9a9 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:15.096364 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-809b2a0c-0667-48b4-a918-a33861dec9a9 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:15.096910 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-809b2a0c-0667-48b4-a918-a33861dec9a9 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:15.122961 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-809b2a0c-0667-48b4-a918-a33861dec9a9 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] [instance: 44596b51-b2a3-4280-a38e-2305f666b661] Going to try to terminate instance {{(pid=123391) delete /opt/stack/nova/nova/compute/api.py:2664}} May 03 09:29:15.206895 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-809b2a0c-0667-48b4-a918-a33861dec9a9 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] 10.222.0.11 "DELETE /compute/v2.1/servers/44596b51-b2a3-4280-a38e-2305f666b661" status: 204 len: 0 microversion: 2.1 time: 0.124497 May 03 09:29:15.210947 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1449/2724] 10.222.0.11 () {58 vars in 1238 bytes} [Tue May 3 09:29:15 2022] DELETE /compute/v2.1/servers/44596b51-b2a3-4280-a38e-2305f666b661 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 03 09:29:15.225160 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-12fcf353-0d7c-4ed0-805d-6dff7aecb2cb tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:15.225973 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-12fcf353-0d7c-4ed0-805d-6dff7aecb2cb tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] [instance: 44596b51-b2a3-4280-a38e-2305f666b661] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:15.233081 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-12fcf353-0d7c-4ed0-805d-6dff7aecb2cb tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:15.233532 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-12fcf353-0d7c-4ed0-805d-6dff7aecb2cb tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:15.234307 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-12fcf353-0d7c-4ed0-805d-6dff7aecb2cb tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:15.234726 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-12fcf353-0d7c-4ed0-805d-6dff7aecb2cb tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:15.368994 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-12fcf353-0d7c-4ed0-805d-6dff7aecb2cb tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3d79c36cb244279d8b1f3ff1ca9c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '776d8b4a6b184d36853b520eb08eb38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:15.377022 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-12fcf353-0d7c-4ed0-805d-6dff7aecb2cb tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] 10.222.0.11 "GET /compute/v2.1/servers/44596b51-b2a3-4280-a38e-2305f666b661" status: 200 len: 1502 microversion: 2.1 time: 0.163460 May 03 09:29:15.377591 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1276/2725] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:15 2022] GET /compute/v2.1/servers/44596b51-b2a3-4280-a38e-2305f666b661 => generated 1502 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:16.395455 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5cb6cd5e-4ff3-489e-9b51-ece698ee4646 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:16.396308 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5cb6cd5e-4ff3-489e-9b51-ece698ee4646 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] [instance: 44596b51-b2a3-4280-a38e-2305f666b661] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:16.402934 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5cb6cd5e-4ff3-489e-9b51-ece698ee4646 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:16.403381 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5cb6cd5e-4ff3-489e-9b51-ece698ee4646 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:16.404220 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5cb6cd5e-4ff3-489e-9b51-ece698ee4646 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:16.404696 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5cb6cd5e-4ff3-489e-9b51-ece698ee4646 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:16.552682 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5cb6cd5e-4ff3-489e-9b51-ece698ee4646 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3d79c36cb244279d8b1f3ff1ca9c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '776d8b4a6b184d36853b520eb08eb38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:16.560448 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5cb6cd5e-4ff3-489e-9b51-ece698ee4646 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] 10.222.0.11 "GET /compute/v2.1/servers/44596b51-b2a3-4280-a38e-2305f666b661" status: 200 len: 1502 microversion: 2.1 time: 0.169333 May 03 09:29:16.561026 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1450/2726] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:16 2022] GET /compute/v2.1/servers/44596b51-b2a3-4280-a38e-2305f666b661 => generated 1502 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:17.109336 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-b58d6dd0-4ebf-4e52-87ad-99d3a70f260d req-8121c211-5714-498a-a2ce-25f965c7e9d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44596b51-b2a3-4280-a38e-2305f666b661", "name": "network-vif-deleted", "tag": "24ce1d78-e275-4e98-a4ee-8a93b7f781a6"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:29:17.129133 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-b58d6dd0-4ebf-4e52-87ad-99d3a70f260d req-8121c211-5714-498a-a2ce-25f965c7e9d1 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:17.130375 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-b58d6dd0-4ebf-4e52-87ad-99d3a70f260d req-8121c211-5714-498a-a2ce-25f965c7e9d1 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:17.155115 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-b58d6dd0-4ebf-4e52-87ad-99d3a70f260d req-8121c211-5714-498a-a2ce-25f965c7e9d1 service nova] Creating event network-vif-deleted:24ce1d78-e275-4e98-a4ee-8a93b7f781a6 for instance 44596b51-b2a3-4280-a38e-2305f666b661 on hv-cinder-84027 May 03 09:29:17.164971 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-b58d6dd0-4ebf-4e52-87ad-99d3a70f260d req-8121c211-5714-498a-a2ce-25f965c7e9d1 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062207 May 03 09:29:17.167084 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1277/2727] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 09:29:17.580293 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-bcabd5cc-97de-4f14-8666-110b30116882 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:17.583027 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-bcabd5cc-97de-4f14-8666-110b30116882 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] [instance: 44596b51-b2a3-4280-a38e-2305f666b661] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:17.593398 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bcabd5cc-97de-4f14-8666-110b30116882 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:17.594249 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bcabd5cc-97de-4f14-8666-110b30116882 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:17.595512 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bcabd5cc-97de-4f14-8666-110b30116882 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:17.596526 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bcabd5cc-97de-4f14-8666-110b30116882 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:17.639317 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bcabd5cc-97de-4f14-8666-110b30116882 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:17.639902 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bcabd5cc-97de-4f14-8666-110b30116882 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:17.640434 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.objects.instance [None req-bcabd5cc-97de-4f14-8666-110b30116882 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lazy-loading 'fault' on Instance uuid 44596b51-b2a3-4280-a38e-2305f666b661 {{(pid=123391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 03 09:29:17.687986 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-bcabd5cc-97de-4f14-8666-110b30116882 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3d79c36cb244279d8b1f3ff1ca9c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '776d8b4a6b184d36853b520eb08eb38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:17.704041 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-bcabd5cc-97de-4f14-8666-110b30116882 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] 10.222.0.11 "GET /compute/v2.1/servers/44596b51-b2a3-4280-a38e-2305f666b661" status: 200 len: 1303 microversion: 2.1 time: 0.129046 May 03 09:29:17.705259 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1451/2728] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:17 2022] GET /compute/v2.1/servers/44596b51-b2a3-4280-a38e-2305f666b661 => generated 1303 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:18.723505 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-185bc274-a809-4570-8df0-23ce165cc555 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:18.724365 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-185bc274-a809-4570-8df0-23ce165cc555 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] [instance: 44596b51-b2a3-4280-a38e-2305f666b661] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:18.731075 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-185bc274-a809-4570-8df0-23ce165cc555 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:18.731552 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-185bc274-a809-4570-8df0-23ce165cc555 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:18.732360 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-185bc274-a809-4570-8df0-23ce165cc555 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:18.732770 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-185bc274-a809-4570-8df0-23ce165cc555 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:18.746457 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-185bc274-a809-4570-8df0-23ce165cc555 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] HTTP exception thrown: Instance 44596b51-b2a3-4280-a38e-2305f666b661 could not be found. May 03 09:29:18.747023 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-185bc274-a809-4570-8df0-23ce165cc555 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Returning 404 to user: Instance 44596b51-b2a3-4280-a38e-2305f666b661 could not be found. {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 09:29:18.747880 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-185bc274-a809-4570-8df0-23ce165cc555 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] 10.222.0.11 "GET /compute/v2.1/servers/44596b51-b2a3-4280-a38e-2305f666b661" status: 404 len: 111 microversion: 2.1 time: 0.028731 May 03 09:29:18.748416 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1278/2729] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:18 2022] GET /compute/v2.1/servers/44596b51-b2a3-4280-a38e-2305f666b661 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 09:29:18.858113 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-4bc881ce-1109-47ef-8ff7-6b0b82d7f8eb tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-711807351", "imageRef": "bd46d67a-108d-4c0c-9f0b-cb6d41c82a32", "flavorRef": "452", "networks": [{"uuid": "29fb7b07-95a4-4a0c-bae8-90cb0decdfff"}]}} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:29:18.909183 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.network.neutron [None req-4bc881ce-1109-47ef-8ff7-6b0b82d7f8eb tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] validate_networks() for [('29fb7b07-95a4-4a0c-bae8-90cb0decdfff', None, None, None, None, None)] {{(pid=123391) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 03 09:29:19.273052 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-4bc881ce-1109-47ef-8ff7-6b0b82d7f8eb tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Flavor limits 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 03 09:29:19.273477 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-4bc881ce-1109-47ef-8ff7-6b0b82d7f8eb tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Image limits 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 03 09:29:19.274193 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-4bc881ce-1109-47ef-8ff7-6b0b82d7f8eb tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Flavor pref 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 03 09:29:19.274942 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-4bc881ce-1109-47ef-8ff7-6b0b82d7f8eb tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Image pref 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 03 09:29:19.275122 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-4bc881ce-1109-47ef-8ff7-6b0b82d7f8eb tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 03 09:29:19.284183 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4bc881ce-1109-47ef-8ff7-6b0b82d7f8eb tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:19.284658 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4bc881ce-1109-47ef-8ff7-6b0b82d7f8eb tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:19.285483 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4bc881ce-1109-47ef-8ff7-6b0b82d7f8eb tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:19.285910 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4bc881ce-1109-47ef-8ff7-6b0b82d7f8eb tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:19.304432 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.quota [None req-4bc881ce-1109-47ef-8ff7-6b0b82d7f8eb tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Getting quotas for project 776d8b4a6b184d36853b520eb08eb38b. Resources: {'cores', 'ram', 'instances'} {{(pid=123391) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 03 09:29:19.308398 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.quota [None req-4bc881ce-1109-47ef-8ff7-6b0b82d7f8eb tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Getting quotas for user 2e3d79c36cb244279d8b1f3ff1ca9c1f and project 776d8b4a6b184d36853b520eb08eb38b. Resources: {'cores', 'ram', 'instances'} {{(pid=123391) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 03 09:29:19.319254 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-4bc881ce-1109-47ef-8ff7-6b0b82d7f8eb tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Going to run 1 instances... {{(pid=123391) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 03 09:29:19.321588 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-4bc881ce-1109-47ef-8ff7-6b0b82d7f8eb tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] [instance: d9f079aa-40fc-4e57-974a-bb99493b50eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd46d67a-108d-4c0c-9f0b-cb6d41c82a32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123391) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 03 09:29:19.368164 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-4bc881ce-1109-47ef-8ff7-6b0b82d7f8eb tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.513906 May 03 09:29:19.368833 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1452/2730] 10.222.0.11 () {60 vars in 1146 bytes} [Tue May 3 09:29:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 515 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 03 09:29:19.381932 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e7a33865-7ea1-41b0-9209-190bd338d527 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:19.382644 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e7a33865-7ea1-41b0-9209-190bd338d527 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] [instance: d9f079aa-40fc-4e57-974a-bb99493b50eb] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:19.437773 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e7a33865-7ea1-41b0-9209-190bd338d527 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3d79c36cb244279d8b1f3ff1ca9c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '776d8b4a6b184d36853b520eb08eb38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:19.444660 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e7a33865-7ea1-41b0-9209-190bd338d527 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] 10.222.0.11 "GET /compute/v2.1/servers/d9f079aa-40fc-4e57-974a-bb99493b50eb" status: 200 len: 1213 microversion: 2.1 time: 0.066648 May 03 09:29:19.445650 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1279/2731] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:19 2022] GET /compute/v2.1/servers/d9f079aa-40fc-4e57-974a-bb99493b50eb => generated 1213 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:29:20.462996 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-84df154d-9715-4d74-9d45-927807884c2b tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:20.463547 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-84df154d-9715-4d74-9d45-927807884c2b tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] [instance: d9f079aa-40fc-4e57-974a-bb99493b50eb] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:20.470269 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-84df154d-9715-4d74-9d45-927807884c2b tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:20.470722 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-84df154d-9715-4d74-9d45-927807884c2b tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:20.471493 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-84df154d-9715-4d74-9d45-927807884c2b tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:20.472052 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-84df154d-9715-4d74-9d45-927807884c2b tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:20.547746 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-84df154d-9715-4d74-9d45-927807884c2b tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3d79c36cb244279d8b1f3ff1ca9c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '776d8b4a6b184d36853b520eb08eb38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:20.555667 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-84df154d-9715-4d74-9d45-927807884c2b tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] 10.222.0.11 "GET /compute/v2.1/servers/d9f079aa-40fc-4e57-974a-bb99493b50eb" status: 200 len: 1271 microversion: 2.1 time: 0.097160 May 03 09:29:20.556302 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1453/2732] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:20 2022] GET /compute/v2.1/servers/d9f079aa-40fc-4e57-974a-bb99493b50eb => generated 1271 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:21.578319 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-bf915cc0-8ccd-44b7-b9d6-fc0769c52193 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:21.579235 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-17e90633-3dce-4420-8a3e-5e8dc2c6a86e req-90ced750-c42d-4224-9a55-c32300230997 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9f079aa-40fc-4e57-974a-bb99493b50eb", "tag": "9d04ad9d-f569-4d81-9307-bc8d18095d10"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:29:21.580240 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-bf915cc0-8ccd-44b7-b9d6-fc0769c52193 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] [instance: d9f079aa-40fc-4e57-974a-bb99493b50eb] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:21.593681 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bf915cc0-8ccd-44b7-b9d6-fc0769c52193 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:21.594124 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bf915cc0-8ccd-44b7-b9d6-fc0769c52193 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:21.594896 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bf915cc0-8ccd-44b7-b9d6-fc0769c52193 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:21.595324 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bf915cc0-8ccd-44b7-b9d6-fc0769c52193 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:21.601831 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-17e90633-3dce-4420-8a3e-5e8dc2c6a86e req-90ced750-c42d-4224-9a55-c32300230997 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:21.602271 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-17e90633-3dce-4420-8a3e-5e8dc2c6a86e req-90ced750-c42d-4224-9a55-c32300230997 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:21.612653 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-17e90633-3dce-4420-8a3e-5e8dc2c6a86e req-90ced750-c42d-4224-9a55-c32300230997 service nova] Creating event network-changed:9d04ad9d-f569-4d81-9307-bc8d18095d10 for instance d9f079aa-40fc-4e57-974a-bb99493b50eb on hv-cinder-84027 May 03 09:29:21.617614 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-17e90633-3dce-4420-8a3e-5e8dc2c6a86e req-90ced750-c42d-4224-9a55-c32300230997 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050212 May 03 09:29:21.618187 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1280/2733] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 09:29:21.729582 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-bf915cc0-8ccd-44b7-b9d6-fc0769c52193 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3d79c36cb244279d8b1f3ff1ca9c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '776d8b4a6b184d36853b520eb08eb38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:21.737856 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-bf915cc0-8ccd-44b7-b9d6-fc0769c52193 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] 10.222.0.11 "GET /compute/v2.1/servers/d9f079aa-40fc-4e57-974a-bb99493b50eb" status: 200 len: 1313 microversion: 2.1 time: 0.167679 May 03 09:29:21.738423 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1454/2734] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:21 2022] GET /compute/v2.1/servers/d9f079aa-40fc-4e57-974a-bb99493b50eb => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:22.757192 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-873c8e51-4cf1-402a-8e0d-c55dc355b775 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:22.758618 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-873c8e51-4cf1-402a-8e0d-c55dc355b775 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] [instance: d9f079aa-40fc-4e57-974a-bb99493b50eb] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:22.765251 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-873c8e51-4cf1-402a-8e0d-c55dc355b775 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:22.765701 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-873c8e51-4cf1-402a-8e0d-c55dc355b775 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:22.766530 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-873c8e51-4cf1-402a-8e0d-c55dc355b775 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:22.766968 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-873c8e51-4cf1-402a-8e0d-c55dc355b775 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:22.961171 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-873c8e51-4cf1-402a-8e0d-c55dc355b775 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3d79c36cb244279d8b1f3ff1ca9c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '776d8b4a6b184d36853b520eb08eb38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:22.969442 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-873c8e51-4cf1-402a-8e0d-c55dc355b775 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] 10.222.0.11 "GET /compute/v2.1/servers/d9f079aa-40fc-4e57-974a-bb99493b50eb" status: 200 len: 1313 microversion: 2.1 time: 0.218198 May 03 09:29:22.970521 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1281/2735] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:22 2022] GET /compute/v2.1/servers/d9f079aa-40fc-4e57-974a-bb99493b50eb => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:23.648215 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-80d8fb0e-a6d1-4cae-abdc-aca9b3ee5ae7 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:23.648838 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-80d8fb0e-a6d1-4cae-abdc-aca9b3ee5ae7 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:23.655522 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-80d8fb0e-a6d1-4cae-abdc-aca9b3ee5ae7 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:23.656010 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-80d8fb0e-a6d1-4cae-abdc-aca9b3ee5ae7 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:23.656790 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-80d8fb0e-a6d1-4cae-abdc-aca9b3ee5ae7 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:23.657221 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-80d8fb0e-a6d1-4cae-abdc-aca9b3ee5ae7 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:23.792222 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-80d8fb0e-a6d1-4cae-abdc-aca9b3ee5ae7 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc2d7dd95774cb2b0b9c695f222b6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee51b7929c5e4bcc845946df0d46f6c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:23.801199 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-80d8fb0e-a6d1-4cae-abdc-aca9b3ee5ae7 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4" status: 200 len: 1595 microversion: 2.1 time: 0.157078 May 03 09:29:23.801968 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1455/2736] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:23 2022] GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4 => generated 1595 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:23.986288 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-93a472ac-8a2c-401d-992b-ef6c92e957ce tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:23.986868 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-93a472ac-8a2c-401d-992b-ef6c92e957ce tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] [instance: d9f079aa-40fc-4e57-974a-bb99493b50eb] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:23.993501 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-93a472ac-8a2c-401d-992b-ef6c92e957ce tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:23.993941 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-93a472ac-8a2c-401d-992b-ef6c92e957ce tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:23.994697 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-93a472ac-8a2c-401d-992b-ef6c92e957ce tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:23.995132 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-93a472ac-8a2c-401d-992b-ef6c92e957ce tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:24.132754 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-93a472ac-8a2c-401d-992b-ef6c92e957ce tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3d79c36cb244279d8b1f3ff1ca9c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '776d8b4a6b184d36853b520eb08eb38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:24.140407 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-93a472ac-8a2c-401d-992b-ef6c92e957ce tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] 10.222.0.11 "GET /compute/v2.1/servers/d9f079aa-40fc-4e57-974a-bb99493b50eb" status: 200 len: 1313 microversion: 2.1 time: 0.157947 May 03 09:29:24.140975 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1282/2737] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:23 2022] GET /compute/v2.1/servers/d9f079aa-40fc-4e57-974a-bb99493b50eb => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:29:25.158296 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d77a2165-ff6a-4d7e-9efa-797a65741ece tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:25.159441 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d77a2165-ff6a-4d7e-9efa-797a65741ece tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] [instance: d9f079aa-40fc-4e57-974a-bb99493b50eb] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:25.168786 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d77a2165-ff6a-4d7e-9efa-797a65741ece tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:25.169265 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d77a2165-ff6a-4d7e-9efa-797a65741ece tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:25.170558 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d77a2165-ff6a-4d7e-9efa-797a65741ece tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:25.170988 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d77a2165-ff6a-4d7e-9efa-797a65741ece tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:25.314911 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d77a2165-ff6a-4d7e-9efa-797a65741ece tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3d79c36cb244279d8b1f3ff1ca9c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '776d8b4a6b184d36853b520eb08eb38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:25.322324 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d77a2165-ff6a-4d7e-9efa-797a65741ece tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] 10.222.0.11 "GET /compute/v2.1/servers/d9f079aa-40fc-4e57-974a-bb99493b50eb" status: 200 len: 1313 microversion: 2.1 time: 0.168077 May 03 09:29:25.323195 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1456/2738] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:25 2022] GET /compute/v2.1/servers/d9f079aa-40fc-4e57-974a-bb99493b50eb => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:25.772732 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-51f56098-1495-4d17-bbd4-5ef4fe8409a4 req-8985c6bf-9d14-4a33-ba4d-84502f97207e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55e6edb6-95bf-495b-8b94-b39ddffeadc4", "tag": "b896e9bb-b27d-45be-9b1c-47d98fd08dd5"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:29:25.785368 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-51f56098-1495-4d17-bbd4-5ef4fe8409a4 req-8985c6bf-9d14-4a33-ba4d-84502f97207e service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:25.786688 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-51f56098-1495-4d17-bbd4-5ef4fe8409a4 req-8985c6bf-9d14-4a33-ba4d-84502f97207e service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:25.805973 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-51f56098-1495-4d17-bbd4-5ef4fe8409a4 req-8985c6bf-9d14-4a33-ba4d-84502f97207e service nova] Creating event network-changed:b896e9bb-b27d-45be-9b1c-47d98fd08dd5 for instance 55e6edb6-95bf-495b-8b94-b39ddffeadc4 on hv-cinder-84027 May 03 09:29:25.816461 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-51f56098-1495-4d17-bbd4-5ef4fe8409a4 req-8985c6bf-9d14-4a33-ba4d-84502f97207e service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181923 May 03 09:29:25.817438 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1283/2739] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:29:26.338576 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5a5dc306-3dcd-4300-b7e5-ff6538fbf0e2 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:26.339163 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5a5dc306-3dcd-4300-b7e5-ff6538fbf0e2 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] [instance: d9f079aa-40fc-4e57-974a-bb99493b50eb] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:26.347647 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5a5dc306-3dcd-4300-b7e5-ff6538fbf0e2 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:26.348133 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5a5dc306-3dcd-4300-b7e5-ff6538fbf0e2 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:26.348899 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5a5dc306-3dcd-4300-b7e5-ff6538fbf0e2 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:26.349352 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5a5dc306-3dcd-4300-b7e5-ff6538fbf0e2 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:26.713999 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5a5dc306-3dcd-4300-b7e5-ff6538fbf0e2 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3d79c36cb244279d8b1f3ff1ca9c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '776d8b4a6b184d36853b520eb08eb38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:26.721789 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5a5dc306-3dcd-4300-b7e5-ff6538fbf0e2 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] 10.222.0.11 "GET /compute/v2.1/servers/d9f079aa-40fc-4e57-974a-bb99493b50eb" status: 200 len: 1313 microversion: 2.1 time: 0.386994 May 03 09:29:26.723892 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1457/2740] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:26 2022] GET /compute/v2.1/servers/d9f079aa-40fc-4e57-974a-bb99493b50eb => generated 1313 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:26.870848 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b31a1434-cc78-45b2-8d0f-2eb48199a4ca tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1900297798"}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:29:26.871468 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b31a1434-cc78-45b2-8d0f-2eb48199a4ca tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:26.878438 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b31a1434-cc78-45b2-8d0f-2eb48199a4ca tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:26.879178 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b31a1434-cc78-45b2-8d0f-2eb48199a4ca tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:26.880280 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b31a1434-cc78-45b2-8d0f-2eb48199a4ca tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:26.881028 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b31a1434-cc78-45b2-8d0f-2eb48199a4ca tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:27.095971 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.network.security_group_api [None req-b31a1434-cc78-45b2-8d0f-2eb48199a4ca tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Adding security group 289614e2-6802-463b-89f8-f9caf87a4df7 to port b896e9bb-b27d-45be-9b1c-47d98fd08dd5 May 03 09:29:27.479267 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b31a1434-cc78-45b2-8d0f-2eb48199a4ca tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "POST /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4/action" status: 202 len: 0 microversion: 2.1 time: 0.615419 May 03 09:29:27.480270 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1284/2741] 10.222.0.11 () {60 vars in 1277 bytes} [Tue May 3 09:29:26 2022] POST /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4/action => generated 0 bytes in 618 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 09:29:27.488262 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-76469fc9-4b0c-4823-800a-a6c9a51b7117 req-256de7e1-d63b-49e4-b1e3-9579fa3fbc78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55e6edb6-95bf-495b-8b94-b39ddffeadc4", "tag": "b896e9bb-b27d-45be-9b1c-47d98fd08dd5"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:29:27.489276 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a92b58cc-01a3-49a8-9654-107bde7a9060 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:27.491318 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a92b58cc-01a3-49a8-9654-107bde7a9060 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:27.502166 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a92b58cc-01a3-49a8-9654-107bde7a9060 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:27.503007 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a92b58cc-01a3-49a8-9654-107bde7a9060 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:27.504177 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a92b58cc-01a3-49a8-9654-107bde7a9060 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:27.505246 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a92b58cc-01a3-49a8-9654-107bde7a9060 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:27.506571 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-76469fc9-4b0c-4823-800a-a6c9a51b7117 req-256de7e1-d63b-49e4-b1e3-9579fa3fbc78 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:27.507282 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-76469fc9-4b0c-4823-800a-a6c9a51b7117 req-256de7e1-d63b-49e4-b1e3-9579fa3fbc78 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:27.528124 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-76469fc9-4b0c-4823-800a-a6c9a51b7117 req-256de7e1-d63b-49e4-b1e3-9579fa3fbc78 service nova] Creating event network-changed:b896e9bb-b27d-45be-9b1c-47d98fd08dd5 for instance 55e6edb6-95bf-495b-8b94-b39ddffeadc4 on hv-cinder-84027 May 03 09:29:27.534276 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-76469fc9-4b0c-4823-800a-a6c9a51b7117 req-256de7e1-d63b-49e4-b1e3-9579fa3fbc78 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048968 May 03 09:29:27.535720 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1285/2742] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 09:29:27.739093 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-db3d7073-afb8-442f-ba81-0b280da98a57 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:27.739842 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-db3d7073-afb8-442f-ba81-0b280da98a57 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] [instance: d9f079aa-40fc-4e57-974a-bb99493b50eb] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:27.746218 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-db3d7073-afb8-442f-ba81-0b280da98a57 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:27.746686 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-db3d7073-afb8-442f-ba81-0b280da98a57 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:27.747456 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-db3d7073-afb8-442f-ba81-0b280da98a57 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:27.747977 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-db3d7073-afb8-442f-ba81-0b280da98a57 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:27.767904 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a92b58cc-01a3-49a8-9654-107bde7a9060 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc2d7dd95774cb2b0b9c695f222b6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee51b7929c5e4bcc845946df0d46f6c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:27.776542 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a92b58cc-01a3-49a8-9654-107bde7a9060 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4" status: 200 len: 1760 microversion: 2.1 time: 0.292001 May 03 09:29:27.777127 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1458/2743] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:27 2022] GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4 => generated 1760 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:27.978082 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-db3d7073-afb8-442f-ba81-0b280da98a57 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3d79c36cb244279d8b1f3ff1ca9c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '776d8b4a6b184d36853b520eb08eb38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:27.986101 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-db3d7073-afb8-442f-ba81-0b280da98a57 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] 10.222.0.11 "GET /compute/v2.1/servers/d9f079aa-40fc-4e57-974a-bb99493b50eb" status: 200 len: 1313 microversion: 2.1 time: 0.251284 May 03 09:29:27.995618 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1286/2744] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:27 2022] GET /compute/v2.1/servers/d9f079aa-40fc-4e57-974a-bb99493b50eb => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:29:28.228606 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [req-3f9c34a3-4227-499c-8744-3ef1b3581c11 req-ec5e8066-a1a2-41e9-9044-cefd0fd69247 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9f079aa-40fc-4e57-974a-bb99493b50eb", "name": "network-vif-plugged", "status": "completed", "tag": "9d04ad9d-f569-4d81-9307-bc8d18095d10"}]} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:29:28.239127 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-3f9c34a3-4227-499c-8744-3ef1b3581c11 req-ec5e8066-a1a2-41e9-9044-cefd0fd69247 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:28.239663 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-3f9c34a3-4227-499c-8744-3ef1b3581c11 req-ec5e8066-a1a2-41e9-9044-cefd0fd69247 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:28.251017 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.compute.server_external_events [req-3f9c34a3-4227-499c-8744-3ef1b3581c11 req-ec5e8066-a1a2-41e9-9044-cefd0fd69247 service nova] Creating event network-vif-plugged:9d04ad9d-f569-4d81-9307-bc8d18095d10 for instance d9f079aa-40fc-4e57-974a-bb99493b50eb on hv-cinder-84027 May 03 09:29:28.256499 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [req-3f9c34a3-4227-499c-8744-3ef1b3581c11 req-ec5e8066-a1a2-41e9-9044-cefd0fd69247 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032955 May 03 09:29:28.257623 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1459/2745] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:29:29.002575 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-529e9ff4-10a9-4b84-a523-530c62882a7e tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:29.003188 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-529e9ff4-10a9-4b84-a523-530c62882a7e tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] [instance: d9f079aa-40fc-4e57-974a-bb99493b50eb] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:29.009678 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-529e9ff4-10a9-4b84-a523-530c62882a7e tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:29.010129 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-529e9ff4-10a9-4b84-a523-530c62882a7e tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:29.010889 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-529e9ff4-10a9-4b84-a523-530c62882a7e tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:29.011322 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-529e9ff4-10a9-4b84-a523-530c62882a7e tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:29.243170 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-529e9ff4-10a9-4b84-a523-530c62882a7e tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3d79c36cb244279d8b1f3ff1ca9c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '776d8b4a6b184d36853b520eb08eb38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:29.251233 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-529e9ff4-10a9-4b84-a523-530c62882a7e tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] 10.222.0.11 "GET /compute/v2.1/servers/d9f079aa-40fc-4e57-974a-bb99493b50eb" status: 200 len: 1313 microversion: 2.1 time: 0.252628 May 03 09:29:29.261272 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1287/2746] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:28 2022] GET /compute/v2.1/servers/d9f079aa-40fc-4e57-974a-bb99493b50eb => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:30.269800 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-2075ca40-5e22-46b3-9b3e-9aa3b590fa13 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:30.270480 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-2075ca40-5e22-46b3-9b3e-9aa3b590fa13 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] [instance: d9f079aa-40fc-4e57-974a-bb99493b50eb] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:30.276483 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2075ca40-5e22-46b3-9b3e-9aa3b590fa13 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:30.276924 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2075ca40-5e22-46b3-9b3e-9aa3b590fa13 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:30.277920 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2075ca40-5e22-46b3-9b3e-9aa3b590fa13 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:30.278356 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2075ca40-5e22-46b3-9b3e-9aa3b590fa13 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:30.377846 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e28a9e22-21b1-4f2d-bffc-a623b32c6aaa tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:30.378425 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e28a9e22-21b1-4f2d-bffc-a623b32c6aaa tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 331f3231-997c-4260-8d91-d4dc89a10a36] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:30.384864 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e28a9e22-21b1-4f2d-bffc-a623b32c6aaa tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:30.385313 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e28a9e22-21b1-4f2d-bffc-a623b32c6aaa tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:30.386144 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e28a9e22-21b1-4f2d-bffc-a623b32c6aaa tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:30.386511 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e28a9e22-21b1-4f2d-bffc-a623b32c6aaa tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:30.413249 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-2075ca40-5e22-46b3-9b3e-9aa3b590fa13 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3d79c36cb244279d8b1f3ff1ca9c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '776d8b4a6b184d36853b520eb08eb38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:30.420939 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-2075ca40-5e22-46b3-9b3e-9aa3b590fa13 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] 10.222.0.11 "GET /compute/v2.1/servers/d9f079aa-40fc-4e57-974a-bb99493b50eb" status: 200 len: 1496 microversion: 2.1 time: 0.155813 May 03 09:29:30.423290 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e28a9e22-21b1-4f2d-bffc-a623b32c6aaa tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36/ips" status: 200 len: 149 microversion: 2.1 time: 0.049218 May 03 09:29:30.424302 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1288/2747] 10.222.0.11 () {58 vars in 1247 bytes} [Tue May 3 09:29:30 2022] GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36/ips => generated 149 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:29:30.428766 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1460/2748] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:30 2022] GET /compute/v2.1/servers/d9f079aa-40fc-4e57-974a-bb99493b50eb => generated 1496 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:30.992922 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-69d9c762-9a70-40a0-909c-c7bef0a516b3 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:30.993397 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-69d9c762-9a70-40a0-909c-c7bef0a516b3 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] [instance: d9f079aa-40fc-4e57-974a-bb99493b50eb] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:30.999204 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-69d9c762-9a70-40a0-909c-c7bef0a516b3 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:30.999669 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-69d9c762-9a70-40a0-909c-c7bef0a516b3 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:31.000456 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-69d9c762-9a70-40a0-909c-c7bef0a516b3 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:31.001104 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-69d9c762-9a70-40a0-909c-c7bef0a516b3 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:31.026065 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-69d9c762-9a70-40a0-909c-c7bef0a516b3 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] [instance: d9f079aa-40fc-4e57-974a-bb99493b50eb] Going to try to terminate instance {{(pid=123392) delete /opt/stack/nova/nova/compute/api.py:2664}} May 03 09:29:31.107788 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-69d9c762-9a70-40a0-909c-c7bef0a516b3 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] 10.222.0.11 "DELETE /compute/v2.1/servers/d9f079aa-40fc-4e57-974a-bb99493b50eb" status: 204 len: 0 microversion: 2.1 time: 0.118521 May 03 09:29:31.108382 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1289/2749] 10.222.0.11 () {58 vars in 1238 bytes} [Tue May 3 09:29:30 2022] DELETE /compute/v2.1/servers/d9f079aa-40fc-4e57-974a-bb99493b50eb => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 03 09:29:31.117838 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-7c9e5234-cf6a-4b36-9bbb-b39d69123407 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:31.118548 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-7c9e5234-cf6a-4b36-9bbb-b39d69123407 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] [instance: d9f079aa-40fc-4e57-974a-bb99493b50eb] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:31.124565 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7c9e5234-cf6a-4b36-9bbb-b39d69123407 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:31.125033 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7c9e5234-cf6a-4b36-9bbb-b39d69123407 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:31.125800 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7c9e5234-cf6a-4b36-9bbb-b39d69123407 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:31.126233 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-7c9e5234-cf6a-4b36-9bbb-b39d69123407 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:31.262334 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-7c9e5234-cf6a-4b36-9bbb-b39d69123407 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3d79c36cb244279d8b1f3ff1ca9c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '776d8b4a6b184d36853b520eb08eb38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:31.270577 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-7c9e5234-cf6a-4b36-9bbb-b39d69123407 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] 10.222.0.11 "GET /compute/v2.1/servers/d9f079aa-40fc-4e57-974a-bb99493b50eb" status: 200 len: 1502 microversion: 2.1 time: 0.157330 May 03 09:29:31.271220 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1461/2750] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:31 2022] GET /compute/v2.1/servers/d9f079aa-40fc-4e57-974a-bb99493b50eb => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:31.840851 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-361d3edd-7bdc-4727-9acf-25d62233e7d6 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0467e70-7420-4759-a35d-5053388ad9c2"}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:29:31.841998 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-361d3edd-7bdc-4727-9acf-25d62233e7d6 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 331f3231-997c-4260-8d91-d4dc89a10a36] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:31.848711 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-361d3edd-7bdc-4727-9acf-25d62233e7d6 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:31.849159 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-361d3edd-7bdc-4727-9acf-25d62233e7d6 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:31.849926 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-361d3edd-7bdc-4727-9acf-25d62233e7d6 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:31.850358 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-361d3edd-7bdc-4727-9acf-25d62233e7d6 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:32.289892 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-dcd5bd97-3c18-4726-a679-5dc8f8d1aad7 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:32.290517 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-dcd5bd97-3c18-4726-a679-5dc8f8d1aad7 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] [instance: d9f079aa-40fc-4e57-974a-bb99493b50eb] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:32.298488 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dcd5bd97-3c18-4726-a679-5dc8f8d1aad7 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:32.299019 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dcd5bd97-3c18-4726-a679-5dc8f8d1aad7 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:32.300022 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dcd5bd97-3c18-4726-a679-5dc8f8d1aad7 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:32.300561 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-dcd5bd97-3c18-4726-a679-5dc8f8d1aad7 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:32.447282 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-dcd5bd97-3c18-4726-a679-5dc8f8d1aad7 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3d79c36cb244279d8b1f3ff1ca9c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '776d8b4a6b184d36853b520eb08eb38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:32.456724 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-dcd5bd97-3c18-4726-a679-5dc8f8d1aad7 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] 10.222.0.11 "GET /compute/v2.1/servers/d9f079aa-40fc-4e57-974a-bb99493b50eb" status: 200 len: 1502 microversion: 2.1 time: 0.171576 May 03 09:29:32.457752 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1462/2751] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:32 2022] GET /compute/v2.1/servers/d9f079aa-40fc-4e57-974a-bb99493b50eb => generated 1502 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:32.462811 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-6fbbc59a-a14f-480f-8987-1fa262b6dd5f tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1093803456", "imageRef": "bd46d67a-108d-4c0c-9f0b-cb6d41c82a32", "flavorRef": "452"}} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:29:32.485302 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-361d3edd-7bdc-4727-9acf-25d62233e7d6 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "POST /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.648658 May 03 09:29:32.485913 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1290/2752] 10.222.0.11 () {60 vars in 1322 bytes} [Tue May 3 09:29:31 2022] POST /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36/os-volume_attachments => generated 194 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 09:29:32.514560 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.network.neutron [None req-6fbbc59a-a14f-480f-8987-1fa262b6dd5f tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] validate_networks() for None {{(pid=123391) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 03 09:29:32.872373 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-6fbbc59a-a14f-480f-8987-1fa262b6dd5f tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Flavor limits 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 03 09:29:32.872792 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-6fbbc59a-a14f-480f-8987-1fa262b6dd5f tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Image limits 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 03 09:29:32.873280 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-6fbbc59a-a14f-480f-8987-1fa262b6dd5f tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Flavor pref 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 03 09:29:32.873667 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-6fbbc59a-a14f-480f-8987-1fa262b6dd5f tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Image pref 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 03 09:29:32.874111 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-6fbbc59a-a14f-480f-8987-1fa262b6dd5f tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 03 09:29:32.884142 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6fbbc59a-a14f-480f-8987-1fa262b6dd5f tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:32.884592 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6fbbc59a-a14f-480f-8987-1fa262b6dd5f tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:32.885391 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6fbbc59a-a14f-480f-8987-1fa262b6dd5f tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:32.885821 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6fbbc59a-a14f-480f-8987-1fa262b6dd5f tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:32.902565 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.quota [None req-6fbbc59a-a14f-480f-8987-1fa262b6dd5f tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Getting quotas for project d04759dc6f8f44a9b5e4981515bc6ba3. Resources: {'cores', 'ram', 'instances'} {{(pid=123391) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 03 09:29:32.906530 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.quota [None req-6fbbc59a-a14f-480f-8987-1fa262b6dd5f tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Getting quotas for user 2d23edac9e224b4d9fe9e9f190628772 and project d04759dc6f8f44a9b5e4981515bc6ba3. Resources: {'cores', 'ram', 'instances'} {{(pid=123391) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 03 09:29:32.917852 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-6fbbc59a-a14f-480f-8987-1fa262b6dd5f tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Going to run 1 instances... {{(pid=123391) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 03 09:29:32.920037 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-6fbbc59a-a14f-480f-8987-1fa262b6dd5f tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] [instance: 184401ec-9908-42d7-a64c-ee7df46e1533] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd46d67a-108d-4c0c-9f0b-cb6d41c82a32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123391) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 03 09:29:32.964928 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-6fbbc59a-a14f-480f-8987-1fa262b6dd5f tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.505745 May 03 09:29:32.970648 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1463/2753] 10.222.0.11 () {60 vars in 1146 bytes} [Tue May 3 09:29:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 03 09:29:32.976700 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-fa529230-b703-489e-a926-5fd8c67151f0 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:32.977329 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-fa529230-b703-489e-a926-5fd8c67151f0 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] [instance: 184401ec-9908-42d7-a64c-ee7df46e1533] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:33.065535 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-fa529230-b703-489e-a926-5fd8c67151f0 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d23edac9e224b4d9fe9e9f190628772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04759dc6f8f44a9b5e4981515bc6ba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:33.073037 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-fa529230-b703-489e-a926-5fd8c67151f0 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] 10.222.0.11 "GET /compute/v2.1/servers/184401ec-9908-42d7-a64c-ee7df46e1533" status: 200 len: 1215 microversion: 2.1 time: 0.100798 May 03 09:29:33.073665 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1291/2754] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:32 2022] GET /compute/v2.1/servers/184401ec-9908-42d7-a64c-ee7df46e1533 => generated 1215 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:29:33.247713 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [req-b3474dd8-f611-43b8-bade-9430bd6f206e req-dded41db-6c2e-4df4-9d8d-84fdcc27dee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9f079aa-40fc-4e57-974a-bb99493b50eb", "name": "network-vif-deleted", "tag": "9d04ad9d-f569-4d81-9307-bc8d18095d10"}]} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:29:33.256673 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-b3474dd8-f611-43b8-bade-9430bd6f206e req-dded41db-6c2e-4df4-9d8d-84fdcc27dee7 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:33.257162 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-b3474dd8-f611-43b8-bade-9430bd6f206e req-dded41db-6c2e-4df4-9d8d-84fdcc27dee7 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:33.269692 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.compute.server_external_events [req-b3474dd8-f611-43b8-bade-9430bd6f206e req-dded41db-6c2e-4df4-9d8d-84fdcc27dee7 service nova] Creating event network-vif-deleted:9d04ad9d-f569-4d81-9307-bc8d18095d10 for instance d9f079aa-40fc-4e57-974a-bb99493b50eb on hv-cinder-84027 May 03 09:29:33.275595 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [req-b3474dd8-f611-43b8-bade-9430bd6f206e req-dded41db-6c2e-4df4-9d8d-84fdcc27dee7 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031728 May 03 09:29:33.276271 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1464/2755] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:29:33.476325 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7d9b97ea-d7d5-428c-bc36-c63136787926 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:33.476929 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7d9b97ea-d7d5-428c-bc36-c63136787926 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] [instance: d9f079aa-40fc-4e57-974a-bb99493b50eb] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:33.485588 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7d9b97ea-d7d5-428c-bc36-c63136787926 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:33.486027 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7d9b97ea-d7d5-428c-bc36-c63136787926 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:33.486791 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7d9b97ea-d7d5-428c-bc36-c63136787926 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:33.487217 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7d9b97ea-d7d5-428c-bc36-c63136787926 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:33.524596 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7d9b97ea-d7d5-428c-bc36-c63136787926 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:33.524944 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7d9b97ea-d7d5-428c-bc36-c63136787926 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:33.525385 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.objects.instance [None req-7d9b97ea-d7d5-428c-bc36-c63136787926 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lazy-loading 'fault' on Instance uuid d9f079aa-40fc-4e57-974a-bb99493b50eb {{(pid=123392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 03 09:29:33.569517 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7d9b97ea-d7d5-428c-bc36-c63136787926 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3d79c36cb244279d8b1f3ff1ca9c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '776d8b4a6b184d36853b520eb08eb38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:33.577721 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7d9b97ea-d7d5-428c-bc36-c63136787926 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] 10.222.0.11 "GET /compute/v2.1/servers/d9f079aa-40fc-4e57-974a-bb99493b50eb" status: 200 len: 1303 microversion: 2.1 time: 0.106571 May 03 09:29:33.578315 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1292/2756] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:33 2022] GET /compute/v2.1/servers/d9f079aa-40fc-4e57-974a-bb99493b50eb => generated 1303 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:34.091991 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-1add36da-5ec3-45d0-a585-09dfe8e8a506 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:34.092631 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-1add36da-5ec3-45d0-a585-09dfe8e8a506 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] [instance: 184401ec-9908-42d7-a64c-ee7df46e1533] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:34.099459 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1add36da-5ec3-45d0-a585-09dfe8e8a506 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:34.099932 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1add36da-5ec3-45d0-a585-09dfe8e8a506 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:34.100690 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1add36da-5ec3-45d0-a585-09dfe8e8a506 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:34.101121 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-1add36da-5ec3-45d0-a585-09dfe8e8a506 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:34.166170 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-1add36da-5ec3-45d0-a585-09dfe8e8a506 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d23edac9e224b4d9fe9e9f190628772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04759dc6f8f44a9b5e4981515bc6ba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:34.174188 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-1add36da-5ec3-45d0-a585-09dfe8e8a506 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] 10.222.0.11 "GET /compute/v2.1/servers/184401ec-9908-42d7-a64c-ee7df46e1533" status: 200 len: 1267 microversion: 2.1 time: 0.087000 May 03 09:29:34.174969 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1465/2757] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:34 2022] GET /compute/v2.1/servers/184401ec-9908-42d7-a64c-ee7df46e1533 => generated 1267 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:34.595047 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-68a23bf5-24ec-4596-a9af-ac2103c518a9 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:34.595741 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-68a23bf5-24ec-4596-a9af-ac2103c518a9 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] [instance: d9f079aa-40fc-4e57-974a-bb99493b50eb] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:34.602480 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-68a23bf5-24ec-4596-a9af-ac2103c518a9 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:34.602946 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-68a23bf5-24ec-4596-a9af-ac2103c518a9 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:34.603714 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-68a23bf5-24ec-4596-a9af-ac2103c518a9 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:34.604173 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-68a23bf5-24ec-4596-a9af-ac2103c518a9 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:34.618267 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-68a23bf5-24ec-4596-a9af-ac2103c518a9 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] HTTP exception thrown: Instance d9f079aa-40fc-4e57-974a-bb99493b50eb could not be found. May 03 09:29:34.619066 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-68a23bf5-24ec-4596-a9af-ac2103c518a9 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] Returning 404 to user: Instance d9f079aa-40fc-4e57-974a-bb99493b50eb could not be found. {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 09:29:34.619944 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-68a23bf5-24ec-4596-a9af-ac2103c518a9 tempest-VolumesActionsTest-280287419 tempest-VolumesActionsTest-280287419-project] 10.222.0.11 "GET /compute/v2.1/servers/d9f079aa-40fc-4e57-974a-bb99493b50eb" status: 404 len: 111 microversion: 2.1 time: 0.028881 May 03 09:29:34.620485 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1293/2758] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:34 2022] GET /compute/v2.1/servers/d9f079aa-40fc-4e57-974a-bb99493b50eb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 09:29:35.191411 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-77b1e3b8-a1c2-4a83-9440-5ac435a7b6ed tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:35.192245 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-77b1e3b8-a1c2-4a83-9440-5ac435a7b6ed tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] [instance: 184401ec-9908-42d7-a64c-ee7df46e1533] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:35.198857 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-77b1e3b8-a1c2-4a83-9440-5ac435a7b6ed tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:35.199389 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-77b1e3b8-a1c2-4a83-9440-5ac435a7b6ed tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:35.200658 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-77b1e3b8-a1c2-4a83-9440-5ac435a7b6ed tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:35.201241 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-77b1e3b8-a1c2-4a83-9440-5ac435a7b6ed tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:35.398283 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-77b1e3b8-a1c2-4a83-9440-5ac435a7b6ed tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d23edac9e224b4d9fe9e9f190628772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04759dc6f8f44a9b5e4981515bc6ba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:35.406105 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-77b1e3b8-a1c2-4a83-9440-5ac435a7b6ed tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] 10.222.0.11 "GET /compute/v2.1/servers/184401ec-9908-42d7-a64c-ee7df46e1533" status: 200 len: 1315 microversion: 2.1 time: 0.218720 May 03 09:29:35.406779 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1466/2759] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:35 2022] GET /compute/v2.1/servers/184401ec-9908-42d7-a64c-ee7df46e1533 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:35.680860 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-3d699694-8f33-4acd-b48d-696e3099d54c req-cdd38a26-b2e6-46e6-8d9a-f8d10173677e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "184401ec-9908-42d7-a64c-ee7df46e1533", "tag": "daf1cca5-f087-4c6f-8631-fc1475413e8a"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:29:35.692569 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-3d699694-8f33-4acd-b48d-696e3099d54c req-cdd38a26-b2e6-46e6-8d9a-f8d10173677e service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:35.693376 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-3d699694-8f33-4acd-b48d-696e3099d54c req-cdd38a26-b2e6-46e6-8d9a-f8d10173677e service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:35.705712 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-3d699694-8f33-4acd-b48d-696e3099d54c req-cdd38a26-b2e6-46e6-8d9a-f8d10173677e service nova] Creating event network-changed:daf1cca5-f087-4c6f-8631-fc1475413e8a for instance 184401ec-9908-42d7-a64c-ee7df46e1533 on hv-cinder-84027 May 03 09:29:35.711855 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-3d699694-8f33-4acd-b48d-696e3099d54c req-cdd38a26-b2e6-46e6-8d9a-f8d10173677e service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035612 May 03 09:29:35.712706 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1294/2760] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:29:36.424759 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-0db2ad41-1a90-48ae-acec-bc2cae312460 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:36.425370 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-0db2ad41-1a90-48ae-acec-bc2cae312460 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] [instance: 184401ec-9908-42d7-a64c-ee7df46e1533] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:36.431608 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0db2ad41-1a90-48ae-acec-bc2cae312460 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:36.432105 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0db2ad41-1a90-48ae-acec-bc2cae312460 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:36.432874 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0db2ad41-1a90-48ae-acec-bc2cae312460 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:36.433310 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0db2ad41-1a90-48ae-acec-bc2cae312460 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:36.575558 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-0db2ad41-1a90-48ae-acec-bc2cae312460 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d23edac9e224b4d9fe9e9f190628772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04759dc6f8f44a9b5e4981515bc6ba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:36.583225 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-0db2ad41-1a90-48ae-acec-bc2cae312460 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] 10.222.0.11 "GET /compute/v2.1/servers/184401ec-9908-42d7-a64c-ee7df46e1533" status: 200 len: 1315 microversion: 2.1 time: 0.162916 May 03 09:29:36.583803 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1467/2761] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:36 2022] GET /compute/v2.1/servers/184401ec-9908-42d7-a64c-ee7df46e1533 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:37.606106 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0b49a7d0-f753-46c7-b4fb-43c172aac3bf tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:37.607266 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0b49a7d0-f753-46c7-b4fb-43c172aac3bf tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] [instance: 184401ec-9908-42d7-a64c-ee7df46e1533] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:37.617226 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0b49a7d0-f753-46c7-b4fb-43c172aac3bf tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:37.617670 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0b49a7d0-f753-46c7-b4fb-43c172aac3bf tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:37.618436 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0b49a7d0-f753-46c7-b4fb-43c172aac3bf tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:37.618864 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0b49a7d0-f753-46c7-b4fb-43c172aac3bf tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:37.769890 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0b49a7d0-f753-46c7-b4fb-43c172aac3bf tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d23edac9e224b4d9fe9e9f190628772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04759dc6f8f44a9b5e4981515bc6ba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:37.778145 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0b49a7d0-f753-46c7-b4fb-43c172aac3bf tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] 10.222.0.11 "GET /compute/v2.1/servers/184401ec-9908-42d7-a64c-ee7df46e1533" status: 200 len: 1315 microversion: 2.1 time: 0.179892 May 03 09:29:37.778729 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1295/2762] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:37 2022] GET /compute/v2.1/servers/184401ec-9908-42d7-a64c-ee7df46e1533 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:38.796170 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-afab1b84-d588-470a-85ac-6051d6fe784b tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:38.796900 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-afab1b84-d588-470a-85ac-6051d6fe784b tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] [instance: 184401ec-9908-42d7-a64c-ee7df46e1533] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:38.803684 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-afab1b84-d588-470a-85ac-6051d6fe784b tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:38.804190 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-afab1b84-d588-470a-85ac-6051d6fe784b tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:38.804967 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-afab1b84-d588-470a-85ac-6051d6fe784b tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:38.805393 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-afab1b84-d588-470a-85ac-6051d6fe784b tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:38.955104 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-afab1b84-d588-470a-85ac-6051d6fe784b tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d23edac9e224b4d9fe9e9f190628772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04759dc6f8f44a9b5e4981515bc6ba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:38.966219 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-afab1b84-d588-470a-85ac-6051d6fe784b tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] 10.222.0.11 "GET /compute/v2.1/servers/184401ec-9908-42d7-a64c-ee7df46e1533" status: 200 len: 1315 microversion: 2.1 time: 0.174608 May 03 09:29:38.966798 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1468/2763] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:38 2022] GET /compute/v2.1/servers/184401ec-9908-42d7-a64c-ee7df46e1533 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:40.012425 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c247b396-510f-4335-b5e0-d455c8d80bb0 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:40.013917 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c247b396-510f-4335-b5e0-d455c8d80bb0 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] [instance: 184401ec-9908-42d7-a64c-ee7df46e1533] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:40.021488 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c247b396-510f-4335-b5e0-d455c8d80bb0 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:40.022174 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c247b396-510f-4335-b5e0-d455c8d80bb0 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:40.023123 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c247b396-510f-4335-b5e0-d455c8d80bb0 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:40.023733 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c247b396-510f-4335-b5e0-d455c8d80bb0 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:40.075970 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-213000a3-6093-4605-b1a6-9a354ca82f4d tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Action: 'create', calling method: .version_select at 0x7f09ce6d1c10>, body: {"keypair": {"name": "tempest-keypair-133452775"}} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:29:40.105663 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.quota [None req-213000a3-6093-4605-b1a6-9a354ca82f4d tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Getting quotas for project 273a7688b38c4558b4c223ba1d9ecdf2. Resources: {'key_pairs'} {{(pid=123391) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 03 09:29:40.109517 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.quota [None req-213000a3-6093-4605-b1a6-9a354ca82f4d tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Getting quotas for user 0f544c320b724a1fbd779f8ab51a7911 and project 273a7688b38c4558b4c223ba1d9ecdf2. Resources: {'key_pairs'} {{(pid=123391) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 03 09:29:40.193762 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c247b396-510f-4335-b5e0-d455c8d80bb0 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d23edac9e224b4d9fe9e9f190628772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04759dc6f8f44a9b5e4981515bc6ba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:40.213216 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c247b396-510f-4335-b5e0-d455c8d80bb0 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] 10.222.0.11 "GET /compute/v2.1/servers/184401ec-9908-42d7-a64c-ee7df46e1533" status: 200 len: 1315 microversion: 2.1 time: 0.233408 May 03 09:29:40.214335 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1296/2764] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:39 2022] GET /compute/v2.1/servers/184401ec-9908-42d7-a64c-ee7df46e1533 => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:40.433729 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.quota [None req-213000a3-6093-4605-b1a6-9a354ca82f4d tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Getting quotas for project 273a7688b38c4558b4c223ba1d9ecdf2. Resources: {'key_pairs'} {{(pid=123391) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 03 09:29:40.437837 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.quota [None req-213000a3-6093-4605-b1a6-9a354ca82f4d tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Getting quotas for user 0f544c320b724a1fbd779f8ab51a7911 and project 273a7688b38c4558b4c223ba1d9ecdf2. Resources: {'key_pairs'} {{(pid=123391) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 03 09:29:40.453228 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-213000a3-6093-4605-b1a6-9a354ca82f4d tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.385811 May 03 09:29:40.460010 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1469/2765] 10.222.0.11 () {60 vars in 1157 bytes} [Tue May 3 09:29:40 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:29:41.230721 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ca386f88-0187-43f6-8d35-30cb55a14657 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:41.231374 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ca386f88-0187-43f6-8d35-30cb55a14657 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] [instance: 184401ec-9908-42d7-a64c-ee7df46e1533] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:41.238296 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ca386f88-0187-43f6-8d35-30cb55a14657 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:41.239040 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ca386f88-0187-43f6-8d35-30cb55a14657 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:41.240213 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ca386f88-0187-43f6-8d35-30cb55a14657 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:41.241091 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ca386f88-0187-43f6-8d35-30cb55a14657 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:41.396327 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ca386f88-0187-43f6-8d35-30cb55a14657 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d23edac9e224b4d9fe9e9f190628772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04759dc6f8f44a9b5e4981515bc6ba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:41.405057 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ca386f88-0187-43f6-8d35-30cb55a14657 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] 10.222.0.11 "GET /compute/v2.1/servers/184401ec-9908-42d7-a64c-ee7df46e1533" status: 200 len: 1315 microversion: 2.1 time: 0.178064 May 03 09:29:41.405939 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1297/2766] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:41 2022] GET /compute/v2.1/servers/184401ec-9908-42d7-a64c-ee7df46e1533 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:42.162828 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-cd50afe3-0a80-4667-8792-11cee61f7e1a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1914800189", "imageRef": "bd46d67a-108d-4c0c-9f0b-cb6d41c82a32", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2256faa9-18d6-4935-a666-8ff2d1a854c4"}], "security_groups": [{"name": "tempest-securitygroup--1766842852"}], "key_name": "tempest-keypair-133452775", "user_data": "}} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:29:42.273616 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.network.neutron [None req-cd50afe3-0a80-4667-8792-11cee61f7e1a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] validate_networks() for [('2256faa9-18d6-4935-a666-8ff2d1a854c4', None, None, None, None, None)] {{(pid=123391) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 03 09:29:42.422869 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-eadca310-1383-4621-99ea-4fc9ce82668f tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:42.423562 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-eadca310-1383-4621-99ea-4fc9ce82668f tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] [instance: 184401ec-9908-42d7-a64c-ee7df46e1533] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:42.430625 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-eadca310-1383-4621-99ea-4fc9ce82668f tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:42.431169 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-eadca310-1383-4621-99ea-4fc9ce82668f tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:42.432124 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-eadca310-1383-4621-99ea-4fc9ce82668f tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:42.433797 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-eadca310-1383-4621-99ea-4fc9ce82668f tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:42.814985 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-eadca310-1383-4621-99ea-4fc9ce82668f tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d23edac9e224b4d9fe9e9f190628772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04759dc6f8f44a9b5e4981515bc6ba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:42.823441 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-eadca310-1383-4621-99ea-4fc9ce82668f tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] 10.222.0.11 "GET /compute/v2.1/servers/184401ec-9908-42d7-a64c-ee7df46e1533" status: 200 len: 1315 microversion: 2.1 time: 0.404619 May 03 09:29:42.824130 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1298/2767] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:42 2022] GET /compute/v2.1/servers/184401ec-9908-42d7-a64c-ee7df46e1533 => generated 1315 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:29:43.057107 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-cd50afe3-0a80-4667-8792-11cee61f7e1a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Flavor limits 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 03 09:29:43.057522 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-cd50afe3-0a80-4667-8792-11cee61f7e1a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Image limits 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 03 09:29:43.058191 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-cd50afe3-0a80-4667-8792-11cee61f7e1a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Flavor pref 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 03 09:29:43.058834 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-cd50afe3-0a80-4667-8792-11cee61f7e1a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Image pref 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 03 09:29:43.059449 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-cd50afe3-0a80-4667-8792-11cee61f7e1a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 03 09:29:43.068685 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cd50afe3-0a80-4667-8792-11cee61f7e1a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:43.069039 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cd50afe3-0a80-4667-8792-11cee61f7e1a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:43.069826 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cd50afe3-0a80-4667-8792-11cee61f7e1a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:43.070253 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cd50afe3-0a80-4667-8792-11cee61f7e1a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:43.087481 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.quota [None req-cd50afe3-0a80-4667-8792-11cee61f7e1a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Getting quotas for project 273a7688b38c4558b4c223ba1d9ecdf2. Resources: {'cores', 'ram', 'instances'} {{(pid=123391) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 03 09:29:43.091894 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.quota [None req-cd50afe3-0a80-4667-8792-11cee61f7e1a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Getting quotas for user 0f544c320b724a1fbd779f8ab51a7911 and project 273a7688b38c4558b4c223ba1d9ecdf2. Resources: {'cores', 'ram', 'instances'} {{(pid=123391) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 03 09:29:43.103431 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-cd50afe3-0a80-4667-8792-11cee61f7e1a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Going to run 1 instances... {{(pid=123391) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 03 09:29:43.106070 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-cd50afe3-0a80-4667-8792-11cee61f7e1a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 63e35bee-5659-46a2-94e7-4f1957860019] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd46d67a-108d-4c0c-9f0b-cb6d41c82a32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123391) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 03 09:29:43.155831 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-cd50afe3-0a80-4667-8792-11cee61f7e1a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.997216 May 03 09:29:43.162358 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1470/2768] 10.222.0.11 () {60 vars in 1146 bytes} [Tue May 3 09:29:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 1004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 03 09:29:43.167218 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9650f75d-994e-4432-8bc8-123b30f32a53 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:43.167885 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9650f75d-994e-4432-8bc8-123b30f32a53 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 63e35bee-5659-46a2-94e7-4f1957860019] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:43.266144 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9650f75d-994e-4432-8bc8-123b30f32a53 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:43.274088 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9650f75d-994e-4432-8bc8-123b30f32a53 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/63e35bee-5659-46a2-94e7-4f1957860019" status: 200 len: 1241 microversion: 2.1 time: 0.110823 May 03 09:29:43.283737 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1299/2769] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:43 2022] GET /compute/v2.1/servers/63e35bee-5659-46a2-94e7-4f1957860019 => generated 1241 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:29:43.841818 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f3c6c1dd-1b75-436d-9ae6-db5affaf3c9a tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:43.843239 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f3c6c1dd-1b75-436d-9ae6-db5affaf3c9a tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] [instance: 184401ec-9908-42d7-a64c-ee7df46e1533] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:43.850959 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f3c6c1dd-1b75-436d-9ae6-db5affaf3c9a tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:43.851317 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f3c6c1dd-1b75-436d-9ae6-db5affaf3c9a tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:43.852115 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f3c6c1dd-1b75-436d-9ae6-db5affaf3c9a tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:43.852763 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f3c6c1dd-1b75-436d-9ae6-db5affaf3c9a tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:44.010401 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f3c6c1dd-1b75-436d-9ae6-db5affaf3c9a tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d23edac9e224b4d9fe9e9f190628772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04759dc6f8f44a9b5e4981515bc6ba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:44.021330 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f3c6c1dd-1b75-436d-9ae6-db5affaf3c9a tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] 10.222.0.11 "GET /compute/v2.1/servers/184401ec-9908-42d7-a64c-ee7df46e1533" status: 200 len: 1315 microversion: 2.1 time: 0.184256 May 03 09:29:44.022028 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1471/2770] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:43 2022] GET /compute/v2.1/servers/184401ec-9908-42d7-a64c-ee7df46e1533 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:44.292945 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4aabdc45-7d89-44f3-a199-d729e80bf263 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:44.295234 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4aabdc45-7d89-44f3-a199-d729e80bf263 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 63e35bee-5659-46a2-94e7-4f1957860019] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:44.313095 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4aabdc45-7d89-44f3-a199-d729e80bf263 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:44.313688 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4aabdc45-7d89-44f3-a199-d729e80bf263 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:44.318754 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4aabdc45-7d89-44f3-a199-d729e80bf263 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:44.320063 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4aabdc45-7d89-44f3-a199-d729e80bf263 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:44.423273 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-4aabdc45-7d89-44f3-a199-d729e80bf263 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:44.437232 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-4aabdc45-7d89-44f3-a199-d729e80bf263 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/63e35bee-5659-46a2-94e7-4f1957860019" status: 200 len: 1301 microversion: 2.1 time: 0.148510 May 03 09:29:44.440104 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1300/2771] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:44 2022] GET /compute/v2.1/servers/63e35bee-5659-46a2-94e7-4f1957860019 => generated 1301 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:45.040050 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5379ed4f-6916-4dbd-86d2-df768f9d65e9 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:45.041744 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5379ed4f-6916-4dbd-86d2-df768f9d65e9 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] [instance: 184401ec-9908-42d7-a64c-ee7df46e1533] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:45.051660 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5379ed4f-6916-4dbd-86d2-df768f9d65e9 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:45.052456 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5379ed4f-6916-4dbd-86d2-df768f9d65e9 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:45.053440 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5379ed4f-6916-4dbd-86d2-df768f9d65e9 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:45.054051 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5379ed4f-6916-4dbd-86d2-df768f9d65e9 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:45.369518 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-5379ed4f-6916-4dbd-86d2-df768f9d65e9 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d23edac9e224b4d9fe9e9f190628772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04759dc6f8f44a9b5e4981515bc6ba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:45.395103 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5379ed4f-6916-4dbd-86d2-df768f9d65e9 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] 10.222.0.11 "GET /compute/v2.1/servers/184401ec-9908-42d7-a64c-ee7df46e1533" status: 200 len: 1315 microversion: 2.1 time: 0.360021 May 03 09:29:45.404616 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1472/2772] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:45 2022] GET /compute/v2.1/servers/184401ec-9908-42d7-a64c-ee7df46e1533 => generated 1315 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:45.468513 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-8c709ee8-7e2b-4160-925e-3552ec478a83 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:45.476819 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-8c709ee8-7e2b-4160-925e-3552ec478a83 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 63e35bee-5659-46a2-94e7-4f1957860019] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:45.498834 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8c709ee8-7e2b-4160-925e-3552ec478a83 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:45.502783 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8c709ee8-7e2b-4160-925e-3552ec478a83 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:45.503723 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8c709ee8-7e2b-4160-925e-3552ec478a83 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:45.508058 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8c709ee8-7e2b-4160-925e-3552ec478a83 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:45.692153 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [req-344dff6f-ec04-4b3f-a913-f0861ecb0741 req-41f0c3f7-9bf0-4291-bdf7-0489dbc4959f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "184401ec-9908-42d7-a64c-ee7df46e1533", "name": "network-vif-plugged", "status": "completed", "tag": "daf1cca5-f087-4c6f-8631-fc1475413e8a"}]} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:29:45.714580 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-344dff6f-ec04-4b3f-a913-f0861ecb0741 req-41f0c3f7-9bf0-4291-bdf7-0489dbc4959f service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:45.715520 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-344dff6f-ec04-4b3f-a913-f0861ecb0741 req-41f0c3f7-9bf0-4291-bdf7-0489dbc4959f service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:45.730412 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.compute.server_external_events [req-344dff6f-ec04-4b3f-a913-f0861ecb0741 req-41f0c3f7-9bf0-4291-bdf7-0489dbc4959f service nova] Creating event network-vif-plugged:daf1cca5-f087-4c6f-8631-fc1475413e8a for instance 184401ec-9908-42d7-a64c-ee7df46e1533 on hv-cinder-84027 May 03 09:29:45.736961 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [req-344dff6f-ec04-4b3f-a913-f0861ecb0741 req-41f0c3f7-9bf0-4291-bdf7-0489dbc4959f service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052203 May 03 09:29:45.739110 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1473/2773] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:29:45.767698 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-8c709ee8-7e2b-4160-925e-3552ec478a83 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:45.776115 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-8c709ee8-7e2b-4160-925e-3552ec478a83 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/63e35bee-5659-46a2-94e7-4f1957860019" status: 200 len: 1367 microversion: 2.1 time: 0.321656 May 03 09:29:45.787355 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1301/2774] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:45 2022] GET /compute/v2.1/servers/63e35bee-5659-46a2-94e7-4f1957860019 => generated 1367 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:46.237461 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [req-6dcce06f-2f78-4da2-9064-59abb87b63a3 req-ae54863a-ad5d-45a9-8341-99bb344334ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63e35bee-5659-46a2-94e7-4f1957860019", "tag": "a1f54589-683d-42da-9055-ce72d4360b4e"}]} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:29:46.261369 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-6dcce06f-2f78-4da2-9064-59abb87b63a3 req-ae54863a-ad5d-45a9-8341-99bb344334ed service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:46.265247 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-6dcce06f-2f78-4da2-9064-59abb87b63a3 req-ae54863a-ad5d-45a9-8341-99bb344334ed service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:46.287866 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.compute.server_external_events [req-6dcce06f-2f78-4da2-9064-59abb87b63a3 req-ae54863a-ad5d-45a9-8341-99bb344334ed service nova] Creating event network-changed:a1f54589-683d-42da-9055-ce72d4360b4e for instance 63e35bee-5659-46a2-94e7-4f1957860019 on hv-cinder-84027 May 03 09:29:46.302727 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [req-6dcce06f-2f78-4da2-9064-59abb87b63a3 req-ae54863a-ad5d-45a9-8341-99bb344334ed service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069310 May 03 09:29:46.304039 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1474/2775] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:29:46.412285 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-df94ff9a-132e-49db-8b14-a18e9d032d3b tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:46.415230 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-df94ff9a-132e-49db-8b14-a18e9d032d3b tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] [instance: 184401ec-9908-42d7-a64c-ee7df46e1533] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:46.424821 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-df94ff9a-132e-49db-8b14-a18e9d032d3b tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:46.431659 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-df94ff9a-132e-49db-8b14-a18e9d032d3b tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:46.432811 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-df94ff9a-132e-49db-8b14-a18e9d032d3b tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:46.433414 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-df94ff9a-132e-49db-8b14-a18e9d032d3b tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:46.603313 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-df94ff9a-132e-49db-8b14-a18e9d032d3b tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d23edac9e224b4d9fe9e9f190628772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04759dc6f8f44a9b5e4981515bc6ba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:46.611928 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-df94ff9a-132e-49db-8b14-a18e9d032d3b tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] 10.222.0.11 "GET /compute/v2.1/servers/184401ec-9908-42d7-a64c-ee7df46e1533" status: 200 len: 1315 microversion: 2.1 time: 0.203350 May 03 09:29:46.616137 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1302/2776] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:46 2022] GET /compute/v2.1/servers/184401ec-9908-42d7-a64c-ee7df46e1533 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:46.795519 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-4ca9aa84-a606-46e9-a0ee-b0ece893cd3a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:46.796491 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-4ca9aa84-a606-46e9-a0ee-b0ece893cd3a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 63e35bee-5659-46a2-94e7-4f1957860019] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:46.804630 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4ca9aa84-a606-46e9-a0ee-b0ece893cd3a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:46.806801 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4ca9aa84-a606-46e9-a0ee-b0ece893cd3a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:46.807750 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4ca9aa84-a606-46e9-a0ee-b0ece893cd3a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:46.810296 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4ca9aa84-a606-46e9-a0ee-b0ece893cd3a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:47.025129 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-4ca9aa84-a606-46e9-a0ee-b0ece893cd3a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:47.051491 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-4ca9aa84-a606-46e9-a0ee-b0ece893cd3a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/63e35bee-5659-46a2-94e7-4f1957860019" status: 200 len: 1367 microversion: 2.1 time: 0.261512 May 03 09:29:47.054134 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1475/2777] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:46 2022] GET /compute/v2.1/servers/63e35bee-5659-46a2-94e7-4f1957860019 => generated 1367 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:47.631497 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-524e9fc5-4303-4a2b-a507-1966127f2e34 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:47.633044 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-524e9fc5-4303-4a2b-a507-1966127f2e34 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] [instance: 184401ec-9908-42d7-a64c-ee7df46e1533] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:47.645234 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-524e9fc5-4303-4a2b-a507-1966127f2e34 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:47.645902 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-524e9fc5-4303-4a2b-a507-1966127f2e34 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:47.646932 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-524e9fc5-4303-4a2b-a507-1966127f2e34 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:47.647551 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-524e9fc5-4303-4a2b-a507-1966127f2e34 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:47.817374 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-524e9fc5-4303-4a2b-a507-1966127f2e34 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d23edac9e224b4d9fe9e9f190628772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04759dc6f8f44a9b5e4981515bc6ba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:47.826866 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-524e9fc5-4303-4a2b-a507-1966127f2e34 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] 10.222.0.11 "GET /compute/v2.1/servers/184401ec-9908-42d7-a64c-ee7df46e1533" status: 200 len: 1464 microversion: 2.1 time: 0.201953 May 03 09:29:47.827693 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1303/2778] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:47 2022] GET /compute/v2.1/servers/184401ec-9908-42d7-a64c-ee7df46e1533 => generated 1464 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:29:47.875591 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-2c1b6818-3f90-457b-a4aa-f64e9236a593 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:47.876354 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-2c1b6818-3f90-457b-a4aa-f64e9236a593 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] [instance: 184401ec-9908-42d7-a64c-ee7df46e1533] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:47.884712 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2c1b6818-3f90-457b-a4aa-f64e9236a593 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:47.886324 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2c1b6818-3f90-457b-a4aa-f64e9236a593 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:47.886324 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2c1b6818-3f90-457b-a4aa-f64e9236a593 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:47.886566 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-2c1b6818-3f90-457b-a4aa-f64e9236a593 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:47.928461 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-2c1b6818-3f90-457b-a4aa-f64e9236a593 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] [instance: 184401ec-9908-42d7-a64c-ee7df46e1533] Going to try to terminate instance {{(pid=123391) delete /opt/stack/nova/nova/compute/api.py:2664}} May 03 09:29:48.023494 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-2c1b6818-3f90-457b-a4aa-f64e9236a593 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] 10.222.0.11 "DELETE /compute/v2.1/servers/184401ec-9908-42d7-a64c-ee7df46e1533" status: 204 len: 0 microversion: 2.1 time: 0.154197 May 03 09:29:48.027493 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1476/2779] 10.222.0.11 () {58 vars in 1238 bytes} [Tue May 3 09:29:47 2022] DELETE /compute/v2.1/servers/184401ec-9908-42d7-a64c-ee7df46e1533 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 03 09:29:48.034972 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-754d6460-bd24-4cf8-a961-12374912356e tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:48.036312 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-754d6460-bd24-4cf8-a961-12374912356e tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] [instance: 184401ec-9908-42d7-a64c-ee7df46e1533] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:48.048268 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-754d6460-bd24-4cf8-a961-12374912356e tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:48.048943 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-754d6460-bd24-4cf8-a961-12374912356e tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:48.049870 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-754d6460-bd24-4cf8-a961-12374912356e tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:48.050305 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-754d6460-bd24-4cf8-a961-12374912356e tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:48.073412 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-0593e799-c5b1-42ca-9922-aa066e4eaf37 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:48.074358 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-0593e799-c5b1-42ca-9922-aa066e4eaf37 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 63e35bee-5659-46a2-94e7-4f1957860019] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:48.081471 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0593e799-c5b1-42ca-9922-aa066e4eaf37 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:48.082236 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0593e799-c5b1-42ca-9922-aa066e4eaf37 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:48.083308 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0593e799-c5b1-42ca-9922-aa066e4eaf37 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:48.083862 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0593e799-c5b1-42ca-9922-aa066e4eaf37 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:48.346303 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-0593e799-c5b1-42ca-9922-aa066e4eaf37 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:48.355450 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-754d6460-bd24-4cf8-a961-12374912356e tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d23edac9e224b4d9fe9e9f190628772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04759dc6f8f44a9b5e4981515bc6ba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:48.357824 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-0593e799-c5b1-42ca-9922-aa066e4eaf37 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/63e35bee-5659-46a2-94e7-4f1957860019" status: 200 len: 1367 microversion: 2.1 time: 0.290314 May 03 09:29:48.367725 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1477/2780] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:48 2022] GET /compute/v2.1/servers/63e35bee-5659-46a2-94e7-4f1957860019 => generated 1367 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:48.368024 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-754d6460-bd24-4cf8-a961-12374912356e tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] 10.222.0.11 "GET /compute/v2.1/servers/184401ec-9908-42d7-a64c-ee7df46e1533" status: 200 len: 1470 microversion: 2.1 time: 0.336498 May 03 09:29:48.368024 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1304/2781] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:48 2022] GET /compute/v2.1/servers/184401ec-9908-42d7-a64c-ee7df46e1533 => generated 1470 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:49.375653 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-0adbb0c7-822a-4e2e-8eca-69b28786b5ef tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:49.377096 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-0adbb0c7-822a-4e2e-8eca-69b28786b5ef tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 63e35bee-5659-46a2-94e7-4f1957860019] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:49.384433 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0adbb0c7-822a-4e2e-8eca-69b28786b5ef tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:49.384896 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0adbb0c7-822a-4e2e-8eca-69b28786b5ef tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:49.385823 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0adbb0c7-822a-4e2e-8eca-69b28786b5ef tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:49.386303 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0adbb0c7-822a-4e2e-8eca-69b28786b5ef tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:49.389238 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-994ae12a-6344-4dab-9305-548191e73c0f tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:49.390962 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-994ae12a-6344-4dab-9305-548191e73c0f tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] [instance: 184401ec-9908-42d7-a64c-ee7df46e1533] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:49.399739 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-994ae12a-6344-4dab-9305-548191e73c0f tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:49.400855 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-994ae12a-6344-4dab-9305-548191e73c0f tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:49.402083 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-994ae12a-6344-4dab-9305-548191e73c0f tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:49.402817 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-994ae12a-6344-4dab-9305-548191e73c0f tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:49.601545 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-0adbb0c7-822a-4e2e-8eca-69b28786b5ef tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:49.606862 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-994ae12a-6344-4dab-9305-548191e73c0f tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d23edac9e224b4d9fe9e9f190628772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04759dc6f8f44a9b5e4981515bc6ba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:49.612034 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-0adbb0c7-822a-4e2e-8eca-69b28786b5ef tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/63e35bee-5659-46a2-94e7-4f1957860019" status: 200 len: 1367 microversion: 2.1 time: 0.240951 May 03 09:29:49.612602 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1478/2782] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:49 2022] GET /compute/v2.1/servers/63e35bee-5659-46a2-94e7-4f1957860019 => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:49.624760 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-994ae12a-6344-4dab-9305-548191e73c0f tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] 10.222.0.11 "GET /compute/v2.1/servers/184401ec-9908-42d7-a64c-ee7df46e1533" status: 200 len: 1470 microversion: 2.1 time: 0.242198 May 03 09:29:49.625773 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1305/2783] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:49 2022] GET /compute/v2.1/servers/184401ec-9908-42d7-a64c-ee7df46e1533 => generated 1470 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:50.630518 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-4df251d7-9de3-46bc-8aee-b1682ad15b06 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:50.631782 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-4df251d7-9de3-46bc-8aee-b1682ad15b06 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 63e35bee-5659-46a2-94e7-4f1957860019] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:50.641764 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4df251d7-9de3-46bc-8aee-b1682ad15b06 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:50.642595 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4df251d7-9de3-46bc-8aee-b1682ad15b06 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:50.643569 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4df251d7-9de3-46bc-8aee-b1682ad15b06 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:50.644199 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4df251d7-9de3-46bc-8aee-b1682ad15b06 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:50.645874 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-32f8fa10-2677-4ab2-afb2-c612dccc3880 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:50.647560 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-32f8fa10-2677-4ab2-afb2-c612dccc3880 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] [instance: 184401ec-9908-42d7-a64c-ee7df46e1533] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:50.658624 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-32f8fa10-2677-4ab2-afb2-c612dccc3880 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:50.662623 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-32f8fa10-2677-4ab2-afb2-c612dccc3880 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:50.663560 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-32f8fa10-2677-4ab2-afb2-c612dccc3880 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:50.664093 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-32f8fa10-2677-4ab2-afb2-c612dccc3880 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:51.035888 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-32f8fa10-2677-4ab2-afb2-c612dccc3880 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d23edac9e224b4d9fe9e9f190628772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04759dc6f8f44a9b5e4981515bc6ba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:51.043516 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-4df251d7-9de3-46bc-8aee-b1682ad15b06 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:51.052347 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-4df251d7-9de3-46bc-8aee-b1682ad15b06 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/63e35bee-5659-46a2-94e7-4f1957860019" status: 200 len: 1367 microversion: 2.1 time: 0.425586 May 03 09:29:51.052855 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1479/2784] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:50 2022] GET /compute/v2.1/servers/63e35bee-5659-46a2-94e7-4f1957860019 => generated 1367 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:51.055082 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-32f8fa10-2677-4ab2-afb2-c612dccc3880 tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] 10.222.0.11 "GET /compute/v2.1/servers/184401ec-9908-42d7-a64c-ee7df46e1533" status: 200 len: 1470 microversion: 2.1 time: 0.414277 May 03 09:29:51.058940 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [req-046efe7d-c4cd-49d8-b266-4b89bf5f9fc5 req-15a2b089-eb7a-4004-ac64-4260a5d8947e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "184401ec-9908-42d7-a64c-ee7df46e1533", "name": "network-vif-deleted", "tag": "daf1cca5-f087-4c6f-8631-fc1475413e8a"}]} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:29:51.068191 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-046efe7d-c4cd-49d8-b266-4b89bf5f9fc5 req-15a2b089-eb7a-4004-ac64-4260a5d8947e service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:51.068463 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1306/2785] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:50 2022] GET /compute/v2.1/servers/184401ec-9908-42d7-a64c-ee7df46e1533 => generated 1470 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:51.068640 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-046efe7d-c4cd-49d8-b266-4b89bf5f9fc5 req-15a2b089-eb7a-4004-ac64-4260a5d8947e service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:51.092877 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.compute.server_external_events [req-046efe7d-c4cd-49d8-b266-4b89bf5f9fc5 req-15a2b089-eb7a-4004-ac64-4260a5d8947e service nova] Creating event network-vif-deleted:daf1cca5-f087-4c6f-8631-fc1475413e8a for instance 184401ec-9908-42d7-a64c-ee7df46e1533 on hv-cinder-84027 May 03 09:29:51.134967 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [req-046efe7d-c4cd-49d8-b266-4b89bf5f9fc5 req-15a2b089-eb7a-4004-ac64-4260a5d8947e service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066182 May 03 09:29:51.134967 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1480/2786] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:29:52.074412 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e57aa61c-e9cc-4600-8a87-2f9128b5067f tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:52.075050 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e57aa61c-e9cc-4600-8a87-2f9128b5067f tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] [instance: 184401ec-9908-42d7-a64c-ee7df46e1533] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:52.085235 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9ed5da97-09e1-4bfa-b9f7-41e5ac83760a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:52.086784 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9ed5da97-09e1-4bfa-b9f7-41e5ac83760a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 63e35bee-5659-46a2-94e7-4f1957860019] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:52.096080 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e57aa61c-e9cc-4600-8a87-2f9128b5067f tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:52.096625 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e57aa61c-e9cc-4600-8a87-2f9128b5067f tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:52.097483 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e57aa61c-e9cc-4600-8a87-2f9128b5067f tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:52.099665 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9ed5da97-09e1-4bfa-b9f7-41e5ac83760a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:52.100140 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9ed5da97-09e1-4bfa-b9f7-41e5ac83760a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:52.100839 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e57aa61c-e9cc-4600-8a87-2f9128b5067f tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:52.104496 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9ed5da97-09e1-4bfa-b9f7-41e5ac83760a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:52.105336 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9ed5da97-09e1-4bfa-b9f7-41e5ac83760a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:52.130775 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-e57aa61c-e9cc-4600-8a87-2f9128b5067f tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] HTTP exception thrown: Instance 184401ec-9908-42d7-a64c-ee7df46e1533 could not be found. May 03 09:29:52.135970 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e57aa61c-e9cc-4600-8a87-2f9128b5067f tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] Returning 404 to user: Instance 184401ec-9908-42d7-a64c-ee7df46e1533 could not be found. {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 09:29:52.138593 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e57aa61c-e9cc-4600-8a87-2f9128b5067f tempest-VolumesNegativeTest-26920501 tempest-VolumesNegativeTest-26920501-project] 10.222.0.11 "GET /compute/v2.1/servers/184401ec-9908-42d7-a64c-ee7df46e1533" status: 404 len: 111 microversion: 2.1 time: 0.067577 May 03 09:29:52.140721 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1307/2787] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:52 2022] GET /compute/v2.1/servers/184401ec-9908-42d7-a64c-ee7df46e1533 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 09:29:52.319244 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9ed5da97-09e1-4bfa-b9f7-41e5ac83760a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:52.327562 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9ed5da97-09e1-4bfa-b9f7-41e5ac83760a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/63e35bee-5659-46a2-94e7-4f1957860019" status: 200 len: 1367 microversion: 2.1 time: 0.246920 May 03 09:29:52.328399 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1481/2788] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:52 2022] GET /compute/v2.1/servers/63e35bee-5659-46a2-94e7-4f1957860019 => generated 1367 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:53.346065 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7dccf7bb-2d1e-4db8-92f7-e4ef884e005a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:53.346901 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7dccf7bb-2d1e-4db8-92f7-e4ef884e005a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 63e35bee-5659-46a2-94e7-4f1957860019] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:53.354784 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7dccf7bb-2d1e-4db8-92f7-e4ef884e005a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:53.355312 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7dccf7bb-2d1e-4db8-92f7-e4ef884e005a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:53.356183 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7dccf7bb-2d1e-4db8-92f7-e4ef884e005a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:53.356680 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7dccf7bb-2d1e-4db8-92f7-e4ef884e005a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:53.367927 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-278650a3-0b6d-4f20-b708-3885f7c96079 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:29:53.369037 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-278650a3-0b6d-4f20-b708-3885f7c96079 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:53.378953 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-278650a3-0b6d-4f20-b708-3885f7c96079 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:53.381449 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-278650a3-0b6d-4f20-b708-3885f7c96079 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:53.383143 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-278650a3-0b6d-4f20-b708-3885f7c96079 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:53.384663 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-278650a3-0b6d-4f20-b708-3885f7c96079 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:53.515013 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-278650a3-0b6d-4f20-b708-3885f7c96079 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "POST /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4/action" status: 202 len: 0 microversion: 2.1 time: 0.148999 May 03 09:29:53.515878 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1482/2789] 10.222.0.11 () {60 vars in 1277 bytes} [Tue May 3 09:29:53 2022] POST /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 09:29:53.529933 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-c30dd5e4-0b0f-4c05-9e62-1ede4504de2a tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:53.534071 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-c30dd5e4-0b0f-4c05-9e62-1ede4504de2a tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:53.535029 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7dccf7bb-2d1e-4db8-92f7-e4ef884e005a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:53.545437 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7dccf7bb-2d1e-4db8-92f7-e4ef884e005a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/63e35bee-5659-46a2-94e7-4f1957860019" status: 200 len: 1367 microversion: 2.1 time: 0.202934 May 03 09:29:53.546325 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1308/2790] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:53 2022] GET /compute/v2.1/servers/63e35bee-5659-46a2-94e7-4f1957860019 => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:53.563913 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c30dd5e4-0b0f-4c05-9e62-1ede4504de2a tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:53.564223 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c30dd5e4-0b0f-4c05-9e62-1ede4504de2a tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:53.565041 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c30dd5e4-0b0f-4c05-9e62-1ede4504de2a tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:53.565721 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-c30dd5e4-0b0f-4c05-9e62-1ede4504de2a tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:53.814957 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-c30dd5e4-0b0f-4c05-9e62-1ede4504de2a tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc2d7dd95774cb2b0b9c695f222b6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee51b7929c5e4bcc845946df0d46f6c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:53.823341 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-5d10342d-16bb-470b-bd65-341d0ec2096c req-edcc7a7a-f0c6-48b6-bdf2-fe716de91167 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63e35bee-5659-46a2-94e7-4f1957860019", "name": "network-vif-plugged", "status": "completed", "tag": "a1f54589-683d-42da-9055-ce72d4360b4e"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:29:53.839938 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-c30dd5e4-0b0f-4c05-9e62-1ede4504de2a tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4" status: 200 len: 1752 microversion: 2.1 time: 0.318669 May 03 09:29:53.842920 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1483/2791] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:53 2022] GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4 => generated 1752 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:53.846581 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-5d10342d-16bb-470b-bd65-341d0ec2096c req-edcc7a7a-f0c6-48b6-bdf2-fe716de91167 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:53.847402 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-5d10342d-16bb-470b-bd65-341d0ec2096c req-edcc7a7a-f0c6-48b6-bdf2-fe716de91167 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:53.865745 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-5d10342d-16bb-470b-bd65-341d0ec2096c req-edcc7a7a-f0c6-48b6-bdf2-fe716de91167 service nova] Creating event network-vif-plugged:a1f54589-683d-42da-9055-ce72d4360b4e for instance 63e35bee-5659-46a2-94e7-4f1957860019 on hv-cinder-84027 May 03 09:29:53.870665 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-5d10342d-16bb-470b-bd65-341d0ec2096c req-edcc7a7a-f0c6-48b6-bdf2-fe716de91167 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051354 May 03 09:29:53.872046 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1309/2792] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 09:29:54.563571 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a02a1ed2-76bf-458e-b966-ba4d6ae710bc tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:54.564925 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a02a1ed2-76bf-458e-b966-ba4d6ae710bc tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 63e35bee-5659-46a2-94e7-4f1957860019] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:54.572766 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a02a1ed2-76bf-458e-b966-ba4d6ae710bc tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:54.573592 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a02a1ed2-76bf-458e-b966-ba4d6ae710bc tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:54.574862 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a02a1ed2-76bf-458e-b966-ba4d6ae710bc tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:54.580295 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a02a1ed2-76bf-458e-b966-ba4d6ae710bc tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:54.791163 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a02a1ed2-76bf-458e-b966-ba4d6ae710bc tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:54.811647 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a02a1ed2-76bf-458e-b966-ba4d6ae710bc tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/63e35bee-5659-46a2-94e7-4f1957860019" status: 200 len: 1367 microversion: 2.1 time: 0.249553 May 03 09:29:54.812887 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1484/2793] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:54 2022] GET /compute/v2.1/servers/63e35bee-5659-46a2-94e7-4f1957860019 => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:54.861370 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-41c03396-1b00-44a4-9fbb-16ef5bc873f8 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:54.862236 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-41c03396-1b00-44a4-9fbb-16ef5bc873f8 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:54.870004 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-41c03396-1b00-44a4-9fbb-16ef5bc873f8 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:54.870702 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-41c03396-1b00-44a4-9fbb-16ef5bc873f8 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:54.872052 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-41c03396-1b00-44a4-9fbb-16ef5bc873f8 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:54.872833 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-41c03396-1b00-44a4-9fbb-16ef5bc873f8 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:55.059898 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-41c03396-1b00-44a4-9fbb-16ef5bc873f8 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc2d7dd95774cb2b0b9c695f222b6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee51b7929c5e4bcc845946df0d46f6c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:55.070184 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-41c03396-1b00-44a4-9fbb-16ef5bc873f8 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4" status: 200 len: 1752 microversion: 2.1 time: 0.213862 May 03 09:29:55.071538 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1310/2794] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:54 2022] GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4 => generated 1752 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:55.829352 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9c5b97ee-7d6d-47c7-9372-faeb34071d9c tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:55.829935 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9c5b97ee-7d6d-47c7-9372-faeb34071d9c tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 63e35bee-5659-46a2-94e7-4f1957860019] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:55.836791 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9c5b97ee-7d6d-47c7-9372-faeb34071d9c tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:55.837241 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9c5b97ee-7d6d-47c7-9372-faeb34071d9c tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:55.838011 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9c5b97ee-7d6d-47c7-9372-faeb34071d9c tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:55.838439 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9c5b97ee-7d6d-47c7-9372-faeb34071d9c tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:55.971543 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9c5b97ee-7d6d-47c7-9372-faeb34071d9c tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:55.979049 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9c5b97ee-7d6d-47c7-9372-faeb34071d9c tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/63e35bee-5659-46a2-94e7-4f1957860019" status: 200 len: 1367 microversion: 2.1 time: 0.153810 May 03 09:29:55.979650 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1485/2795] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:55 2022] GET /compute/v2.1/servers/63e35bee-5659-46a2-94e7-4f1957860019 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:56.093323 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6cf61270-137e-4ef0-a2a0-d97bb1edde59 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:56.094103 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6cf61270-137e-4ef0-a2a0-d97bb1edde59 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:56.101781 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6cf61270-137e-4ef0-a2a0-d97bb1edde59 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:56.102314 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6cf61270-137e-4ef0-a2a0-d97bb1edde59 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:56.103226 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6cf61270-137e-4ef0-a2a0-d97bb1edde59 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:56.103716 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6cf61270-137e-4ef0-a2a0-d97bb1edde59 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:56.251259 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6cf61270-137e-4ef0-a2a0-d97bb1edde59 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc2d7dd95774cb2b0b9c695f222b6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee51b7929c5e4bcc845946df0d46f6c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:56.259225 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6cf61270-137e-4ef0-a2a0-d97bb1edde59 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4" status: 200 len: 1757 microversion: 2.1 time: 0.172032 May 03 09:29:56.259808 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1311/2796] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:56 2022] GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:56.997268 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-458bfafe-a6d0-47b2-b67f-9f5c63c69910 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:56.998075 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-458bfafe-a6d0-47b2-b67f-9f5c63c69910 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 63e35bee-5659-46a2-94e7-4f1957860019] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:57.004510 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-458bfafe-a6d0-47b2-b67f-9f5c63c69910 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:57.004982 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-458bfafe-a6d0-47b2-b67f-9f5c63c69910 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:57.005743 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-458bfafe-a6d0-47b2-b67f-9f5c63c69910 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:57.006176 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-458bfafe-a6d0-47b2-b67f-9f5c63c69910 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:57.150243 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-458bfafe-a6d0-47b2-b67f-9f5c63c69910 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:57.157944 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-458bfafe-a6d0-47b2-b67f-9f5c63c69910 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/63e35bee-5659-46a2-94e7-4f1957860019" status: 200 len: 1556 microversion: 2.1 time: 0.164622 May 03 09:29:57.158518 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1486/2797] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:56 2022] GET /compute/v2.1/servers/63e35bee-5659-46a2-94e7-4f1957860019 => generated 1556 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:57.174236 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-27080d0f-3ade-4e3c-ac66-9d07e78e2eda tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:57.174851 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-27080d0f-3ade-4e3c-ac66-9d07e78e2eda tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 63e35bee-5659-46a2-94e7-4f1957860019] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:57.181653 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-27080d0f-3ade-4e3c-ac66-9d07e78e2eda tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:57.182175 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-27080d0f-3ade-4e3c-ac66-9d07e78e2eda tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:57.183002 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-27080d0f-3ade-4e3c-ac66-9d07e78e2eda tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:57.183504 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-27080d0f-3ade-4e3c-ac66-9d07e78e2eda tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:57.265452 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-27080d0f-3ade-4e3c-ac66-9d07e78e2eda tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/63e35bee-5659-46a2-94e7-4f1957860019/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095051 May 03 09:29:57.266035 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1312/2798] 10.222.0.11 () {58 vars in 1274 bytes} [Tue May 3 09:29:57 2022] GET /compute/v2.1/servers/63e35bee-5659-46a2-94e7-4f1957860019/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:29:57.278182 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-870e500c-f4fc-407a-9a10-74db88792583 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:57.278996 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-870e500c-f4fc-407a-9a10-74db88792583 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:57.286009 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-870e500c-f4fc-407a-9a10-74db88792583 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:57.286756 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-870e500c-f4fc-407a-9a10-74db88792583 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:57.287522 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-870e500c-f4fc-407a-9a10-74db88792583 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:57.288002 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-870e500c-f4fc-407a-9a10-74db88792583 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:57.868194 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-870e500c-f4fc-407a-9a10-74db88792583 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc2d7dd95774cb2b0b9c695f222b6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee51b7929c5e4bcc845946df0d46f6c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:57.878076 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-870e500c-f4fc-407a-9a10-74db88792583 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4" status: 200 len: 1757 microversion: 2.1 time: 0.604357 May 03 09:29:57.887877 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1487/2799] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:57 2022] GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4 => generated 1757 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:29:58.644278 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-d209b609-6c2c-493b-af17-fca09ad9a419 req-41564300-16a6-49c7-b3b6-57bce67fbf33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63e35bee-5659-46a2-94e7-4f1957860019", "tag": "a1f54589-683d-42da-9055-ce72d4360b4e"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:29:58.653582 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-d209b609-6c2c-493b-af17-fca09ad9a419 req-41564300-16a6-49c7-b3b6-57bce67fbf33 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:58.654031 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-d209b609-6c2c-493b-af17-fca09ad9a419 req-41564300-16a6-49c7-b3b6-57bce67fbf33 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:58.665897 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-d209b609-6c2c-493b-af17-fca09ad9a419 req-41564300-16a6-49c7-b3b6-57bce67fbf33 service nova] Creating event network-changed:a1f54589-683d-42da-9055-ce72d4360b4e for instance 63e35bee-5659-46a2-94e7-4f1957860019 on hv-cinder-84027 May 03 09:29:58.671345 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-d209b609-6c2c-493b-af17-fca09ad9a419 req-41564300-16a6-49c7-b3b6-57bce67fbf33 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031509 May 03 09:29:58.671909 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1313/2800] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:29:58.897919 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9444f67f-df84-4ffc-bb37-af5ae81b03a5 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:29:58.898770 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9444f67f-df84-4ffc-bb37-af5ae81b03a5 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:29:58.906855 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9444f67f-df84-4ffc-bb37-af5ae81b03a5 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:58.907551 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9444f67f-df84-4ffc-bb37-af5ae81b03a5 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:58.908716 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9444f67f-df84-4ffc-bb37-af5ae81b03a5 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:29:58.909453 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9444f67f-df84-4ffc-bb37-af5ae81b03a5 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:29:59.159263 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9444f67f-df84-4ffc-bb37-af5ae81b03a5 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc2d7dd95774cb2b0b9c695f222b6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee51b7929c5e4bcc845946df0d46f6c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:29:59.169023 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9444f67f-df84-4ffc-bb37-af5ae81b03a5 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4" status: 200 len: 1757 microversion: 2.1 time: 0.276554 May 03 09:29:59.188696 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1488/2801] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:29:58 2022] GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4 => generated 1757 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:30:00.195225 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-3fb23626-1bb7-4eca-a1a3-eef04fd0a35f tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:30:00.195920 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-3fb23626-1bb7-4eca-a1a3-eef04fd0a35f tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:30:00.203271 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3fb23626-1bb7-4eca-a1a3-eef04fd0a35f tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:00.203799 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3fb23626-1bb7-4eca-a1a3-eef04fd0a35f tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:00.204613 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3fb23626-1bb7-4eca-a1a3-eef04fd0a35f tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:00.205070 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3fb23626-1bb7-4eca-a1a3-eef04fd0a35f tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:00.400396 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-3fb23626-1bb7-4eca-a1a3-eef04fd0a35f tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc2d7dd95774cb2b0b9c695f222b6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee51b7929c5e4bcc845946df0d46f6c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:30:00.408549 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-3fb23626-1bb7-4eca-a1a3-eef04fd0a35f tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4" status: 200 len: 1757 microversion: 2.1 time: 0.218047 May 03 09:30:00.409236 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1314/2802] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:30:00 2022] GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4 => generated 1757 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:30:01.426021 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f5899051-d489-40a1-a12d-917f7f74940d tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:30:01.426591 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f5899051-d489-40a1-a12d-917f7f74940d tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:30:01.432964 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f5899051-d489-40a1-a12d-917f7f74940d tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:01.433452 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f5899051-d489-40a1-a12d-917f7f74940d tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:01.434206 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f5899051-d489-40a1-a12d-917f7f74940d tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:01.434721 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f5899051-d489-40a1-a12d-917f7f74940d tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:01.586676 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f5899051-d489-40a1-a12d-917f7f74940d tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc2d7dd95774cb2b0b9c695f222b6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee51b7929c5e4bcc845946df0d46f6c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:30:01.596896 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f5899051-d489-40a1-a12d-917f7f74940d tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4" status: 200 len: 1757 microversion: 2.1 time: 0.174937 May 03 09:30:01.597486 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1489/2803] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:30:01 2022] GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4 => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:30:02.615199 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a005cfd2-7c69-40a9-8eea-9302111127c5 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:30:02.616413 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a005cfd2-7c69-40a9-8eea-9302111127c5 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:30:02.623414 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a005cfd2-7c69-40a9-8eea-9302111127c5 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:02.623925 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a005cfd2-7c69-40a9-8eea-9302111127c5 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:02.624693 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a005cfd2-7c69-40a9-8eea-9302111127c5 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:02.625124 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a005cfd2-7c69-40a9-8eea-9302111127c5 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:02.772156 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a005cfd2-7c69-40a9-8eea-9302111127c5 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc2d7dd95774cb2b0b9c695f222b6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee51b7929c5e4bcc845946df0d46f6c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:30:02.780068 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a005cfd2-7c69-40a9-8eea-9302111127c5 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4" status: 200 len: 1757 microversion: 2.1 time: 0.168892 May 03 09:30:02.780650 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1315/2804] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:30:02 2022] GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:30:03.797383 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3c372d43-010a-41ac-a564-3f7a65389d99 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:30:03.797995 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-3c372d43-010a-41ac-a564-3f7a65389d99 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:30:03.806340 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3c372d43-010a-41ac-a564-3f7a65389d99 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:03.806544 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3c372d43-010a-41ac-a564-3f7a65389d99 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:03.809113 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3c372d43-010a-41ac-a564-3f7a65389d99 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:03.809579 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3c372d43-010a-41ac-a564-3f7a65389d99 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:03.957070 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-3c372d43-010a-41ac-a564-3f7a65389d99 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc2d7dd95774cb2b0b9c695f222b6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee51b7929c5e4bcc845946df0d46f6c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:30:03.966250 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-3c372d43-010a-41ac-a564-3f7a65389d99 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4" status: 200 len: 1757 microversion: 2.1 time: 0.172825 May 03 09:30:03.966841 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1490/2805] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:30:03 2022] GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:30:04.986698 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7e768509-d899-4ad3-aa70-bd8f124244c4 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:30:04.987378 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7e768509-d899-4ad3-aa70-bd8f124244c4 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:30:04.995238 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7e768509-d899-4ad3-aa70-bd8f124244c4 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:04.995809 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7e768509-d899-4ad3-aa70-bd8f124244c4 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:04.996683 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7e768509-d899-4ad3-aa70-bd8f124244c4 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:04.997227 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7e768509-d899-4ad3-aa70-bd8f124244c4 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:05.155975 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7e768509-d899-4ad3-aa70-bd8f124244c4 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc2d7dd95774cb2b0b9c695f222b6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee51b7929c5e4bcc845946df0d46f6c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:30:05.164082 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7e768509-d899-4ad3-aa70-bd8f124244c4 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4" status: 200 len: 1757 microversion: 2.1 time: 0.182734 May 03 09:30:05.164533 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1316/2806] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:30:04 2022] GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4 => generated 1757 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:30:06.183438 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-8afd5e09-4591-4b2c-87b0-5941e2dd00aa tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:30:06.184243 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-8afd5e09-4591-4b2c-87b0-5941e2dd00aa tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:30:06.191946 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8afd5e09-4591-4b2c-87b0-5941e2dd00aa tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:06.192398 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8afd5e09-4591-4b2c-87b0-5941e2dd00aa tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:06.193165 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8afd5e09-4591-4b2c-87b0-5941e2dd00aa tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:06.193594 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8afd5e09-4591-4b2c-87b0-5941e2dd00aa tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:06.342042 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-8afd5e09-4591-4b2c-87b0-5941e2dd00aa tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc2d7dd95774cb2b0b9c695f222b6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee51b7929c5e4bcc845946df0d46f6c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:30:06.351898 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-8afd5e09-4591-4b2c-87b0-5941e2dd00aa tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4" status: 200 len: 1757 microversion: 2.1 time: 0.173069 May 03 09:30:06.352582 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1491/2807] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:30:06 2022] GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:30:07.373449 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2ceca011-548b-4f0b-af16-7ec20be5bb0a tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:30:07.374497 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-2ceca011-548b-4f0b-af16-7ec20be5bb0a tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:30:07.383039 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2ceca011-548b-4f0b-af16-7ec20be5bb0a tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:07.383488 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2ceca011-548b-4f0b-af16-7ec20be5bb0a tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:07.384275 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2ceca011-548b-4f0b-af16-7ec20be5bb0a tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:07.384704 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2ceca011-548b-4f0b-af16-7ec20be5bb0a tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:07.545454 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2ceca011-548b-4f0b-af16-7ec20be5bb0a tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc2d7dd95774cb2b0b9c695f222b6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee51b7929c5e4bcc845946df0d46f6c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:30:07.553353 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-2ceca011-548b-4f0b-af16-7ec20be5bb0a tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4" status: 200 len: 1760 microversion: 2.1 time: 0.186484 May 03 09:30:07.553920 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1317/2808] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:30:07 2022] GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4 => generated 1760 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:30:42.483413 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9ea366a3-cc66-4497-b666-1f6872a36339 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:30:42.484126 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9ea366a3-cc66-4497-b666-1f6872a36339 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 63e35bee-5659-46a2-94e7-4f1957860019] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:30:42.490533 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9ea366a3-cc66-4497-b666-1f6872a36339 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:42.491054 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9ea366a3-cc66-4497-b666-1f6872a36339 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:42.491942 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9ea366a3-cc66-4497-b666-1f6872a36339 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:42.492283 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9ea366a3-cc66-4497-b666-1f6872a36339 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:42.516137 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9ea366a3-cc66-4497-b666-1f6872a36339 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/63e35bee-5659-46a2-94e7-4f1957860019/ips" status: 200 len: 149 microversion: 2.1 time: 0.037002 May 03 09:30:42.516707 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1492/2809] 10.222.0.11 () {58 vars in 1247 bytes} [Tue May 3 09:30:42 2022] GET /compute/v2.1/servers/63e35bee-5659-46a2-94e7-4f1957860019/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 09:30:42.527426 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ee740f9a-4038-4c13-a3a1-e94423b6f95b tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0467e70-7420-4759-a35d-5053388ad9c2"}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:30:42.528524 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ee740f9a-4038-4c13-a3a1-e94423b6f95b tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 63e35bee-5659-46a2-94e7-4f1957860019] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:30:42.534824 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ee740f9a-4038-4c13-a3a1-e94423b6f95b tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:42.535276 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ee740f9a-4038-4c13-a3a1-e94423b6f95b tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:42.536089 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ee740f9a-4038-4c13-a3a1-e94423b6f95b tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:42.536527 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ee740f9a-4038-4c13-a3a1-e94423b6f95b tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:42.617890 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-ee740f9a-4038-4c13-a3a1-e94423b6f95b tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] HTTP exception thrown: Invalid volume: volume e0467e70-7420-4759-a35d-5053388ad9c2 is already attached to instances: 331f3231-997c-4260-8d91-d4dc89a10a36 May 03 09:30:42.618523 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ee740f9a-4038-4c13-a3a1-e94423b6f95b tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Returning 400 to user: Invalid volume: volume e0467e70-7420-4759-a35d-5053388ad9c2 is already attached to instances: 331f3231-997c-4260-8d91-d4dc89a10a36 {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 09:30:42.619361 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ee740f9a-4038-4c13-a3a1-e94423b6f95b tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "POST /compute/v2.1/servers/63e35bee-5659-46a2-94e7-4f1957860019/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096047 May 03 09:30:42.619958 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1318/2810] 10.222.0.11 () {60 vars in 1322 bytes} [Tue May 3 09:30:42 2022] POST /compute/v2.1/servers/63e35bee-5659-46a2-94e7-4f1957860019/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 03 09:30:42.628740 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-5369b94a-597f-4259-b67f-86adbff57796 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:30:42.629216 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5369b94a-597f-4259-b67f-86adbff57796 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 63e35bee-5659-46a2-94e7-4f1957860019] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:30:42.635590 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5369b94a-597f-4259-b67f-86adbff57796 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:42.636074 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5369b94a-597f-4259-b67f-86adbff57796 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:42.636846 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5369b94a-597f-4259-b67f-86adbff57796 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:42.637278 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-5369b94a-597f-4259-b67f-86adbff57796 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:42.663158 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-5369b94a-597f-4259-b67f-86adbff57796 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 63e35bee-5659-46a2-94e7-4f1957860019] Going to try to terminate instance {{(pid=123391) delete /opt/stack/nova/nova/compute/api.py:2664}} May 03 09:30:42.739496 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-5369b94a-597f-4259-b67f-86adbff57796 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "DELETE /compute/v2.1/servers/63e35bee-5659-46a2-94e7-4f1957860019" status: 204 len: 0 microversion: 2.1 time: 0.114460 May 03 09:30:42.740387 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1493/2811] 10.222.0.11 () {58 vars in 1238 bytes} [Tue May 3 09:30:42 2022] DELETE /compute/v2.1/servers/63e35bee-5659-46a2-94e7-4f1957860019 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 03 09:30:42.751022 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b050b7ae-0e88-49ac-bea7-0c71fa36fd5a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:30:42.751649 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b050b7ae-0e88-49ac-bea7-0c71fa36fd5a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 63e35bee-5659-46a2-94e7-4f1957860019] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:30:42.757839 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b050b7ae-0e88-49ac-bea7-0c71fa36fd5a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:42.758294 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b050b7ae-0e88-49ac-bea7-0c71fa36fd5a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:42.759069 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b050b7ae-0e88-49ac-bea7-0c71fa36fd5a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:42.759507 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b050b7ae-0e88-49ac-bea7-0c71fa36fd5a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:42.890903 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b050b7ae-0e88-49ac-bea7-0c71fa36fd5a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:30:42.898231 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b050b7ae-0e88-49ac-bea7-0c71fa36fd5a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/63e35bee-5659-46a2-94e7-4f1957860019" status: 200 len: 1681 microversion: 2.1 time: 0.152631 May 03 09:30:42.898786 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1319/2812] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:30:42 2022] GET /compute/v2.1/servers/63e35bee-5659-46a2-94e7-4f1957860019 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:30:43.916716 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-cbb87cff-6056-459b-ae0b-0061eb98d0ca tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:30:43.917530 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-cbb87cff-6056-459b-ae0b-0061eb98d0ca tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 63e35bee-5659-46a2-94e7-4f1957860019] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:30:43.924384 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cbb87cff-6056-459b-ae0b-0061eb98d0ca tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:43.924842 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cbb87cff-6056-459b-ae0b-0061eb98d0ca tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:43.925614 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cbb87cff-6056-459b-ae0b-0061eb98d0ca tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:43.926049 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cbb87cff-6056-459b-ae0b-0061eb98d0ca tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:44.061884 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-cbb87cff-6056-459b-ae0b-0061eb98d0ca tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:30:44.069810 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-cbb87cff-6056-459b-ae0b-0061eb98d0ca tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/63e35bee-5659-46a2-94e7-4f1957860019" status: 200 len: 1681 microversion: 2.1 time: 0.157475 May 03 09:30:44.070359 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1494/2813] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:30:43 2022] GET /compute/v2.1/servers/63e35bee-5659-46a2-94e7-4f1957860019 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:30:45.088149 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2806feba-9e13-4ce9-a2d4-beb20811aac9 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:30:45.088765 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-2806feba-9e13-4ce9-a2d4-beb20811aac9 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 63e35bee-5659-46a2-94e7-4f1957860019] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:30:45.095575 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2806feba-9e13-4ce9-a2d4-beb20811aac9 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:45.096063 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2806feba-9e13-4ce9-a2d4-beb20811aac9 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:45.096824 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2806feba-9e13-4ce9-a2d4-beb20811aac9 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:45.097261 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2806feba-9e13-4ce9-a2d4-beb20811aac9 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:45.232760 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2806feba-9e13-4ce9-a2d4-beb20811aac9 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:30:45.240484 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-2806feba-9e13-4ce9-a2d4-beb20811aac9 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/63e35bee-5659-46a2-94e7-4f1957860019" status: 200 len: 1681 microversion: 2.1 time: 0.156452 May 03 09:30:45.241058 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1320/2814] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:30:45 2022] GET /compute/v2.1/servers/63e35bee-5659-46a2-94e7-4f1957860019 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:30:46.258250 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d464808a-1f82-478b-a094-2f722271709b tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:30:46.258856 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-d464808a-1f82-478b-a094-2f722271709b tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 63e35bee-5659-46a2-94e7-4f1957860019] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:30:46.265628 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d464808a-1f82-478b-a094-2f722271709b tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:46.266072 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d464808a-1f82-478b-a094-2f722271709b tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:46.266829 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d464808a-1f82-478b-a094-2f722271709b tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:46.267265 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-d464808a-1f82-478b-a094-2f722271709b tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:46.421211 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-3e7d01f8-5f5f-4456-97c7-6de6914d4144 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1900297798"}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:30:46.421861 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-3e7d01f8-5f5f-4456-97c7-6de6914d4144 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:30:46.429517 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3e7d01f8-5f5f-4456-97c7-6de6914d4144 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:46.430141 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3e7d01f8-5f5f-4456-97c7-6de6914d4144 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:46.431130 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3e7d01f8-5f5f-4456-97c7-6de6914d4144 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:46.431761 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3e7d01f8-5f5f-4456-97c7-6de6914d4144 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:46.468301 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-d464808a-1f82-478b-a094-2f722271709b tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:30:46.479023 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d464808a-1f82-478b-a094-2f722271709b tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/63e35bee-5659-46a2-94e7-4f1957860019" status: 200 len: 1681 microversion: 2.1 time: 0.224821 May 03 09:30:46.480175 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1495/2815] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:30:46 2022] GET /compute/v2.1/servers/63e35bee-5659-46a2-94e7-4f1957860019 => generated 1681 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:30:46.670591 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.network.security_group_api [None req-3e7d01f8-5f5f-4456-97c7-6de6914d4144 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Removing security group 289614e2-6802-463b-89f8-f9caf87a4df7 from port b896e9bb-b27d-45be-9b1c-47d98fd08dd5 May 03 09:30:47.259714 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-3e7d01f8-5f5f-4456-97c7-6de6914d4144 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "POST /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4/action" status: 202 len: 0 microversion: 2.1 time: 0.841928 May 03 09:30:47.261897 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1321/2816] 10.222.0.11 () {60 vars in 1277 bytes} [Tue May 3 09:30:46 2022] POST /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4/action => generated 0 bytes in 845 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 09:30:47.275198 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [req-c8363feb-cc7f-4a1c-874c-dafaa2bfc8c7 req-cdadf095-d4e5-4d46-beb3-a1484a7d41e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55e6edb6-95bf-495b-8b94-b39ddffeadc4", "tag": "b896e9bb-b27d-45be-9b1c-47d98fd08dd5"}]} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:30:47.292228 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-c8363feb-cc7f-4a1c-874c-dafaa2bfc8c7 req-cdadf095-d4e5-4d46-beb3-a1484a7d41e2 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:47.293009 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-c8363feb-cc7f-4a1c-874c-dafaa2bfc8c7 req-cdadf095-d4e5-4d46-beb3-a1484a7d41e2 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:47.323381 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.compute.server_external_events [req-c8363feb-cc7f-4a1c-874c-dafaa2bfc8c7 req-cdadf095-d4e5-4d46-beb3-a1484a7d41e2 service nova] Creating event network-changed:b896e9bb-b27d-45be-9b1c-47d98fd08dd5 for instance 55e6edb6-95bf-495b-8b94-b39ddffeadc4 on hv-cinder-84027 May 03 09:30:47.334440 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [req-c8363feb-cc7f-4a1c-874c-dafaa2bfc8c7 req-cdadf095-d4e5-4d46-beb3-a1484a7d41e2 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069240 May 03 09:30:47.338432 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1496/2817] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:30:47.504761 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4171783f-3f9c-4e18-8804-673447a7bf23 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:30:47.507290 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4171783f-3f9c-4e18-8804-673447a7bf23 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 63e35bee-5659-46a2-94e7-4f1957860019] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:30:47.520676 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4171783f-3f9c-4e18-8804-673447a7bf23 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:47.521570 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4171783f-3f9c-4e18-8804-673447a7bf23 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:47.523529 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4171783f-3f9c-4e18-8804-673447a7bf23 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:47.524444 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4171783f-3f9c-4e18-8804-673447a7bf23 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:47.699485 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-4171783f-3f9c-4e18-8804-673447a7bf23 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:30:47.708285 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-4171783f-3f9c-4e18-8804-673447a7bf23 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/63e35bee-5659-46a2-94e7-4f1957860019" status: 200 len: 1613 microversion: 2.1 time: 0.213753 May 03 09:30:47.708973 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1322/2818] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:30:47 2022] GET /compute/v2.1/servers/63e35bee-5659-46a2-94e7-4f1957860019 => generated 1613 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:30:48.731961 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a74f61a8-0ded-4ee1-b10e-29a749fe08e8 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:30:48.732823 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a74f61a8-0ded-4ee1-b10e-29a749fe08e8 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 63e35bee-5659-46a2-94e7-4f1957860019] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:30:48.740920 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a74f61a8-0ded-4ee1-b10e-29a749fe08e8 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:48.741590 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a74f61a8-0ded-4ee1-b10e-29a749fe08e8 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:48.742802 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a74f61a8-0ded-4ee1-b10e-29a749fe08e8 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:48.743451 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a74f61a8-0ded-4ee1-b10e-29a749fe08e8 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:48.853249 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a74f61a8-0ded-4ee1-b10e-29a749fe08e8 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:30:48.864553 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a74f61a8-0ded-4ee1-b10e-29a749fe08e8 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/63e35bee-5659-46a2-94e7-4f1957860019" status: 200 len: 1613 microversion: 2.1 time: 0.137051 May 03 09:30:48.866050 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1497/2819] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:30:48 2022] GET /compute/v2.1/servers/63e35bee-5659-46a2-94e7-4f1957860019 => generated 1613 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:30:48.980738 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-29f369b9-77e4-4913-a3ed-09b1c26f99cf tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:30:48.981440 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-29f369b9-77e4-4913-a3ed-09b1c26f99cf tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:30:48.991021 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-29f369b9-77e4-4913-a3ed-09b1c26f99cf tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:48.991905 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-29f369b9-77e4-4913-a3ed-09b1c26f99cf tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:48.993117 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-29f369b9-77e4-4913-a3ed-09b1c26f99cf tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:48.993854 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-29f369b9-77e4-4913-a3ed-09b1c26f99cf tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:49.189507 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.objects.instance [None req-29f369b9-77e4-4913-a3ed-09b1c26f99cf tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lazy-loading 'services' on Instance uuid 55e6edb6-95bf-495b-8b94-b39ddffeadc4 {{(pid=123392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 03 09:30:49.382860 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [req-9bd9a725-38b5-428b-80fd-303c4f0d1837 req-61ce1bc3-c986-4a12-b801-f34f485cf465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63e35bee-5659-46a2-94e7-4f1957860019", "name": "network-vif-deleted", "tag": "a1f54589-683d-42da-9055-ce72d4360b4e"}, {"name": "network-changed", "server_uuid": "55e6edb6-95bf-495b-8b94-b39ddffeadc4", "tag": "b896e9bb-b27d-45be-9b1c-47d98fd08dd5"}]} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:30:49.400941 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-9bd9a725-38b5-428b-80fd-303c4f0d1837 req-61ce1bc3-c986-4a12-b801-f34f485cf465 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:49.402122 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-9bd9a725-38b5-428b-80fd-303c4f0d1837 req-61ce1bc3-c986-4a12-b801-f34f485cf465 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:49.436293 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.compute.server_external_events [req-9bd9a725-38b5-428b-80fd-303c4f0d1837 req-61ce1bc3-c986-4a12-b801-f34f485cf465 service nova] Creating event network-vif-deleted:a1f54589-683d-42da-9055-ce72d4360b4e for instance 63e35bee-5659-46a2-94e7-4f1957860019 on hv-cinder-84027 May 03 09:30:49.437510 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.compute.server_external_events [req-9bd9a725-38b5-428b-80fd-303c4f0d1837 req-61ce1bc3-c986-4a12-b801-f34f485cf465 service nova] Creating event network-changed:b896e9bb-b27d-45be-9b1c-47d98fd08dd5 for instance 55e6edb6-95bf-495b-8b94-b39ddffeadc4 on hv-cinder-84027 May 03 09:30:49.449853 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [req-9bd9a725-38b5-428b-80fd-303c4f0d1837 req-61ce1bc3-c986-4a12-b801-f34f485cf465 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.073645 May 03 09:30:49.452412 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1498/2820] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 09:30:49.457974 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-29f369b9-77e4-4913-a3ed-09b1c26f99cf tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "DELETE /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4/os-volume_attachments/1814ded1-e16e-4470-814c-5da825f9b099" status: 202 len: 0 microversion: 2.1 time: 0.481313 May 03 09:30:49.463510 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1323/2821] 10.222.0.11 () {58 vars in 1415 bytes} [Tue May 3 09:30:48 2022] DELETE /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4/os-volume_attachments/1814ded1-e16e-4470-814c-5da825f9b099 => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 09:30:49.472130 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-84b85927-717c-4905-bb77-cb73c063b9de tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:30:49.478769 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-84b85927-717c-4905-bb77-cb73c063b9de tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:30:49.510610 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-84b85927-717c-4905-bb77-cb73c063b9de tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:49.512454 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-84b85927-717c-4905-bb77-cb73c063b9de tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:49.515179 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-84b85927-717c-4905-bb77-cb73c063b9de tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:49.519292 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-84b85927-717c-4905-bb77-cb73c063b9de tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:49.602701 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-84b85927-717c-4905-bb77-cb73c063b9de tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137743 May 03 09:30:49.611619 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1499/2822] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:30:49 2022] GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 09:30:49.884310 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-80271ccb-cde3-432a-9f4a-dcc242b598b5 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:30:49.885196 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-80271ccb-cde3-432a-9f4a-dcc242b598b5 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 63e35bee-5659-46a2-94e7-4f1957860019] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:30:49.891991 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-80271ccb-cde3-432a-9f4a-dcc242b598b5 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:49.892450 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-80271ccb-cde3-432a-9f4a-dcc242b598b5 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:49.893307 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-80271ccb-cde3-432a-9f4a-dcc242b598b5 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:49.893752 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-80271ccb-cde3-432a-9f4a-dcc242b598b5 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:49.908524 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-80271ccb-cde3-432a-9f4a-dcc242b598b5 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] HTTP exception thrown: Instance 63e35bee-5659-46a2-94e7-4f1957860019 could not be found. May 03 09:30:49.909127 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-80271ccb-cde3-432a-9f4a-dcc242b598b5 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Returning 404 to user: Instance 63e35bee-5659-46a2-94e7-4f1957860019 could not be found. {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 09:30:49.909969 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-80271ccb-cde3-432a-9f4a-dcc242b598b5 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/63e35bee-5659-46a2-94e7-4f1957860019" status: 404 len: 111 microversion: 2.1 time: 0.030177 May 03 09:30:49.910643 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1324/2823] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:30:49 2022] GET /compute/v2.1/servers/63e35bee-5659-46a2-94e7-4f1957860019 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 09:30:49.919931 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b406ef1c-215a-44ad-b6e0-062d5c13555e tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '.version_select at 0x7f09d34bb5e0>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:30:49.941541 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b406ef1c-215a-44ad-b6e0-062d5c13555e tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-133452775" status: 202 len: 0 microversion: 2.1 time: 0.025742 May 03 09:30:49.942277 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1500/2824] 10.222.0.11 () {58 vars in 1217 bytes} [Tue May 3 09:30:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-133452775 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 09:30:50.617676 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-eced1335-ee06-4abc-989e-ee0762a2fe17 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:30:50.618702 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-eced1335-ee06-4abc-989e-ee0762a2fe17 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:30:50.625270 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-eced1335-ee06-4abc-989e-ee0762a2fe17 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:50.625731 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-eced1335-ee06-4abc-989e-ee0762a2fe17 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:50.626498 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-eced1335-ee06-4abc-989e-ee0762a2fe17 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:50.626922 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-eced1335-ee06-4abc-989e-ee0762a2fe17 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:50.656393 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-eced1335-ee06-4abc-989e-ee0762a2fe17 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042522 May 03 09:30:50.657028 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1325/2825] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:30:50 2022] GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:30:50.663507 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-706e05dd-d768-44b0-ad24-f40a60e09999 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:30:50.664055 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-706e05dd-d768-44b0-ad24-f40a60e09999 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 331f3231-997c-4260-8d91-d4dc89a10a36] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:30:50.670878 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-706e05dd-d768-44b0-ad24-f40a60e09999 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:50.671315 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-706e05dd-d768-44b0-ad24-f40a60e09999 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:50.672119 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-706e05dd-d768-44b0-ad24-f40a60e09999 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:50.672555 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-706e05dd-d768-44b0-ad24-f40a60e09999 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:50.754473 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.objects.instance [None req-706e05dd-d768-44b0-ad24-f40a60e09999 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lazy-loading 'services' on Instance uuid 331f3231-997c-4260-8d91-d4dc89a10a36 {{(pid=123391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 03 09:30:50.828557 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-706e05dd-d768-44b0-ad24-f40a60e09999 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "DELETE /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36/os-volume_attachments/e0467e70-7420-4759-a35d-5053388ad9c2" status: 202 len: 0 microversion: 2.1 time: 0.168926 May 03 09:30:50.829186 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1501/2826] 10.222.0.11 () {58 vars in 1415 bytes} [Tue May 3 09:30:50 2022] DELETE /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36/os-volume_attachments/e0467e70-7420-4759-a35d-5053388ad9c2 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 09:30:50.837820 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4502326f-8b77-4eb5-9b09-e1d7e282f5f0 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:30:50.838753 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4502326f-8b77-4eb5-9b09-e1d7e282f5f0 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 331f3231-997c-4260-8d91-d4dc89a10a36] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:30:50.845406 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4502326f-8b77-4eb5-9b09-e1d7e282f5f0 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:50.845854 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4502326f-8b77-4eb5-9b09-e1d7e282f5f0 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:50.846613 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4502326f-8b77-4eb5-9b09-e1d7e282f5f0 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:50.847039 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4502326f-8b77-4eb5-9b09-e1d7e282f5f0 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:50.876411 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-4502326f-8b77-4eb5-9b09-e1d7e282f5f0 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042595 May 03 09:30:50.877015 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1326/2827] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:30:50 2022] GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 09:30:51.670107 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f2a631b8-7dd2-42a4-a5a9-a1b68f0826f9 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:30:51.671201 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f2a631b8-7dd2-42a4-a5a9-a1b68f0826f9 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:30:51.678985 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f2a631b8-7dd2-42a4-a5a9-a1b68f0826f9 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:51.679473 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f2a631b8-7dd2-42a4-a5a9-a1b68f0826f9 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:51.680351 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f2a631b8-7dd2-42a4-a5a9-a1b68f0826f9 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:51.680813 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f2a631b8-7dd2-42a4-a5a9-a1b68f0826f9 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:51.711541 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f2a631b8-7dd2-42a4-a5a9-a1b68f0826f9 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046094 May 03 09:30:51.712403 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1502/2828] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:30:51 2022] GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:30:51.889167 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4b4b6545-6482-4435-a1fa-4fb76c972b2a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:30:51.890025 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4b4b6545-6482-4435-a1fa-4fb76c972b2a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 331f3231-997c-4260-8d91-d4dc89a10a36] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:30:51.897059 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4b4b6545-6482-4435-a1fa-4fb76c972b2a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:51.897499 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4b4b6545-6482-4435-a1fa-4fb76c972b2a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:51.898260 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4b4b6545-6482-4435-a1fa-4fb76c972b2a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:51.898692 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4b4b6545-6482-4435-a1fa-4fb76c972b2a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:51.928049 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-4b4b6545-6482-4435-a1fa-4fb76c972b2a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043014 May 03 09:30:51.928587 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1327/2829] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:30:51 2022] GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:30:52.724996 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e48f383d-39a2-4b7f-9aa2-03972638e48d tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:30:52.726361 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e48f383d-39a2-4b7f-9aa2-03972638e48d tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:30:52.734064 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e48f383d-39a2-4b7f-9aa2-03972638e48d tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:52.734556 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e48f383d-39a2-4b7f-9aa2-03972638e48d tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:52.735404 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e48f383d-39a2-4b7f-9aa2-03972638e48d tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:52.735876 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e48f383d-39a2-4b7f-9aa2-03972638e48d tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:52.778572 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e48f383d-39a2-4b7f-9aa2-03972638e48d tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057966 May 03 09:30:52.779994 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1503/2830] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:30:52 2022] GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:30:52.939801 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d125d55e-2d74-4d48-af46-c32ba851462b tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:30:52.940832 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d125d55e-2d74-4d48-af46-c32ba851462b tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 331f3231-997c-4260-8d91-d4dc89a10a36] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:30:52.947834 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d125d55e-2d74-4d48-af46-c32ba851462b tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:52.948300 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d125d55e-2d74-4d48-af46-c32ba851462b tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:52.949062 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d125d55e-2d74-4d48-af46-c32ba851462b tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:52.949490 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d125d55e-2d74-4d48-af46-c32ba851462b tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:52.983352 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d125d55e-2d74-4d48-af46-c32ba851462b tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047569 May 03 09:30:52.984346 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1328/2831] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:30:52 2022] GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:30:53.792804 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e3ef8e69-ce38-4345-809d-62fd5d10e53b tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:30:53.793753 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e3ef8e69-ce38-4345-809d-62fd5d10e53b tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:30:53.800285 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e3ef8e69-ce38-4345-809d-62fd5d10e53b tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:53.800820 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e3ef8e69-ce38-4345-809d-62fd5d10e53b tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:53.801640 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e3ef8e69-ce38-4345-809d-62fd5d10e53b tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:53.802080 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e3ef8e69-ce38-4345-809d-62fd5d10e53b tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:53.831321 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e3ef8e69-ce38-4345-809d-62fd5d10e53b tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042633 May 03 09:30:53.832059 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1504/2832] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:30:53 2022] GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 03 09:30:53.843124 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ebfda6ac-d05e-413b-9330-d57e3c571f31 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:30:53.843565 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ebfda6ac-d05e-413b-9330-d57e3c571f31 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:30:53.850666 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ebfda6ac-d05e-413b-9330-d57e3c571f31 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:53.851114 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ebfda6ac-d05e-413b-9330-d57e3c571f31 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:53.851925 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ebfda6ac-d05e-413b-9330-d57e3c571f31 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:53.852351 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ebfda6ac-d05e-413b-9330-d57e3c571f31 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:53.927170 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-ebfda6ac-d05e-413b-9330-d57e3c571f31 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] HTTP exception thrown: Instance 55e6edb6-95bf-495b-8b94-b39ddffeadc4 is not attached to volume 1814ded1-e16e-4470-814c-5da825f9b099 May 03 09:30:53.927793 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ebfda6ac-d05e-413b-9330-d57e3c571f31 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Returning 404 to user: Instance 55e6edb6-95bf-495b-8b94-b39ddffeadc4 is not attached to volume 1814ded1-e16e-4470-814c-5da825f9b099 {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 09:30:53.928662 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ebfda6ac-d05e-413b-9330-d57e3c571f31 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "DELETE /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4/os-volume_attachments/1814ded1-e16e-4470-814c-5da825f9b099" status: 404 len: 154 microversion: 2.1 time: 0.090038 May 03 09:30:53.929214 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1329/2833] 10.222.0.11 () {58 vars in 1415 bytes} [Tue May 3 09:30:53 2022] DELETE /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4/os-volume_attachments/1814ded1-e16e-4470-814c-5da825f9b099 => generated 154 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 09:30:53.996070 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-bbbf020f-9e92-4064-8a9c-110375cef718 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:30:53.997148 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-bbbf020f-9e92-4064-8a9c-110375cef718 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 331f3231-997c-4260-8d91-d4dc89a10a36] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:30:54.004122 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bbbf020f-9e92-4064-8a9c-110375cef718 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:54.004729 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bbbf020f-9e92-4064-8a9c-110375cef718 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:54.005908 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bbbf020f-9e92-4064-8a9c-110375cef718 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:54.006459 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bbbf020f-9e92-4064-8a9c-110375cef718 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:54.036413 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-bbbf020f-9e92-4064-8a9c-110375cef718 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045673 May 03 09:30:54.036944 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1505/2834] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:30:53 2022] GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 03 09:30:54.094489 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ebaf7770-26ff-4b1e-a75c-fa3bc2fe115a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:30:54.095017 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ebaf7770-26ff-4b1e-a75c-fa3bc2fe115a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 331f3231-997c-4260-8d91-d4dc89a10a36] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:30:54.101589 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ebaf7770-26ff-4b1e-a75c-fa3bc2fe115a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:54.102045 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ebaf7770-26ff-4b1e-a75c-fa3bc2fe115a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:54.102823 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ebaf7770-26ff-4b1e-a75c-fa3bc2fe115a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:54.103260 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ebaf7770-26ff-4b1e-a75c-fa3bc2fe115a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:54.128887 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ebaf7770-26ff-4b1e-a75c-fa3bc2fe115a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 331f3231-997c-4260-8d91-d4dc89a10a36] Going to try to terminate instance {{(pid=123392) delete /opt/stack/nova/nova/compute/api.py:2664}} May 03 09:30:54.207444 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ebaf7770-26ff-4b1e-a75c-fa3bc2fe115a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "DELETE /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36" status: 204 len: 0 microversion: 2.1 time: 0.115733 May 03 09:30:54.208180 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1330/2835] 10.222.0.11 () {58 vars in 1238 bytes} [Tue May 3 09:30:54 2022] DELETE /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 03 09:30:54.220142 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f1ccfe83-b749-473b-afe0-b4df24b1371a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:30:54.221412 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f1ccfe83-b749-473b-afe0-b4df24b1371a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 331f3231-997c-4260-8d91-d4dc89a10a36] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:30:54.228801 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f1ccfe83-b749-473b-afe0-b4df24b1371a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:54.229182 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f1ccfe83-b749-473b-afe0-b4df24b1371a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:54.230218 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f1ccfe83-b749-473b-afe0-b4df24b1371a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:54.230720 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f1ccfe83-b749-473b-afe0-b4df24b1371a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:54.363056 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f1ccfe83-b749-473b-afe0-b4df24b1371a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:30:54.371052 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f1ccfe83-b749-473b-afe0-b4df24b1371a tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36" status: 200 len: 1681 microversion: 2.1 time: 0.158005 May 03 09:30:54.371605 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1506/2836] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:30:54 2022] GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:30:55.066695 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-3ae192ce-96e4-431d-8c4c-bc832e40f1af tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:30:55.067292 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-3ae192ce-96e4-431d-8c4c-bc832e40f1af tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:30:55.074365 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3ae192ce-96e4-431d-8c4c-bc832e40f1af tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:55.074819 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3ae192ce-96e4-431d-8c4c-bc832e40f1af tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:55.075623 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3ae192ce-96e4-431d-8c4c-bc832e40f1af tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:55.076102 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3ae192ce-96e4-431d-8c4c-bc832e40f1af tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:55.101403 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-3ae192ce-96e4-431d-8c4c-bc832e40f1af tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Going to try to terminate instance {{(pid=123392) delete /opt/stack/nova/nova/compute/api.py:2664}} May 03 09:30:55.183284 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-3ae192ce-96e4-431d-8c4c-bc832e40f1af tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "DELETE /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4" status: 204 len: 0 microversion: 2.1 time: 0.120582 May 03 09:30:55.183993 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1331/2837] 10.222.0.11 () {58 vars in 1238 bytes} [Tue May 3 09:30:55 2022] DELETE /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 03 09:30:55.192675 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ebf9d6cd-be66-41d8-a5eb-e13da020f201 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:30:55.193285 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ebf9d6cd-be66-41d8-a5eb-e13da020f201 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:30:55.200352 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ebf9d6cd-be66-41d8-a5eb-e13da020f201 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:55.200807 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ebf9d6cd-be66-41d8-a5eb-e13da020f201 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:55.201594 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ebf9d6cd-be66-41d8-a5eb-e13da020f201 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:55.202029 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ebf9d6cd-be66-41d8-a5eb-e13da020f201 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:55.334285 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ebf9d6cd-be66-41d8-a5eb-e13da020f201 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc2d7dd95774cb2b0b9c695f222b6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee51b7929c5e4bcc845946df0d46f6c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:30:55.342325 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ebf9d6cd-be66-41d8-a5eb-e13da020f201 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4" status: 200 len: 1555 microversion: 2.1 time: 0.153705 May 03 09:30:55.342940 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1507/2838] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:30:55 2022] GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4 => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:30:55.390083 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-64c44840-8955-483a-b73c-edc226d58bb6 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:30:55.391092 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-64c44840-8955-483a-b73c-edc226d58bb6 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 331f3231-997c-4260-8d91-d4dc89a10a36] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:30:55.398490 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-64c44840-8955-483a-b73c-edc226d58bb6 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:55.398935 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-64c44840-8955-483a-b73c-edc226d58bb6 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:55.399697 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-64c44840-8955-483a-b73c-edc226d58bb6 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:55.400156 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-64c44840-8955-483a-b73c-edc226d58bb6 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:55.531226 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-64c44840-8955-483a-b73c-edc226d58bb6 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:30:55.538869 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-64c44840-8955-483a-b73c-edc226d58bb6 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36" status: 200 len: 1681 microversion: 2.1 time: 0.153906 May 03 09:30:55.539435 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1332/2839] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:30:55 2022] GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:30:56.363186 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-8e9f3f29-f882-4903-94f6-2109eb061350 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:30:56.363902 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-8e9f3f29-f882-4903-94f6-2109eb061350 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:30:56.372290 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8e9f3f29-f882-4903-94f6-2109eb061350 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:56.372858 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8e9f3f29-f882-4903-94f6-2109eb061350 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:56.373828 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8e9f3f29-f882-4903-94f6-2109eb061350 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:56.374382 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8e9f3f29-f882-4903-94f6-2109eb061350 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:56.517728 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-8e9f3f29-f882-4903-94f6-2109eb061350 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc2d7dd95774cb2b0b9c695f222b6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee51b7929c5e4bcc845946df0d46f6c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:30:56.525477 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-8e9f3f29-f882-4903-94f6-2109eb061350 tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4" status: 200 len: 1555 microversion: 2.1 time: 0.168725 May 03 09:30:56.526032 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1508/2840] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:30:56 2022] GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4 => generated 1555 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:30:56.558632 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d3441933-0006-4d65-9339-d7b0db1acfb2 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:30:56.559248 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d3441933-0006-4d65-9339-d7b0db1acfb2 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 331f3231-997c-4260-8d91-d4dc89a10a36] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:30:56.568075 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d3441933-0006-4d65-9339-d7b0db1acfb2 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:56.568528 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d3441933-0006-4d65-9339-d7b0db1acfb2 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:56.569316 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d3441933-0006-4d65-9339-d7b0db1acfb2 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:56.569749 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d3441933-0006-4d65-9339-d7b0db1acfb2 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:56.705914 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d3441933-0006-4d65-9339-d7b0db1acfb2 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:30:56.717290 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d3441933-0006-4d65-9339-d7b0db1acfb2 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36" status: 200 len: 1681 microversion: 2.1 time: 0.164169 May 03 09:30:56.718091 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1333/2841] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:30:56 2022] GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:30:57.543582 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-85bdf580-0c68-4e00-b058-0af80ba9529d tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:30:57.544232 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-85bdf580-0c68-4e00-b058-0af80ba9529d tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:30:57.551060 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-85bdf580-0c68-4e00-b058-0af80ba9529d tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:57.551519 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-85bdf580-0c68-4e00-b058-0af80ba9529d tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:57.552314 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-85bdf580-0c68-4e00-b058-0af80ba9529d tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:57.552750 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-85bdf580-0c68-4e00-b058-0af80ba9529d tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:57.736251 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-806b3841-fddf-4c1c-8e24-82aab0618da0 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:30:57.736939 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-806b3841-fddf-4c1c-8e24-82aab0618da0 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 331f3231-997c-4260-8d91-d4dc89a10a36] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:30:57.743669 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-806b3841-fddf-4c1c-8e24-82aab0618da0 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:57.744148 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-806b3841-fddf-4c1c-8e24-82aab0618da0 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:57.744926 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-806b3841-fddf-4c1c-8e24-82aab0618da0 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:57.745575 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-806b3841-fddf-4c1c-8e24-82aab0618da0 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:57.939464 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-85bdf580-0c68-4e00-b058-0af80ba9529d tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc2d7dd95774cb2b0b9c695f222b6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee51b7929c5e4bcc845946df0d46f6c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:30:57.948008 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-85bdf580-0c68-4e00-b058-0af80ba9529d tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4" status: 200 len: 1555 microversion: 2.1 time: 0.408467 May 03 09:30:57.948568 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1509/2842] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:30:57 2022] GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4 => generated 1555 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:30:58.050683 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-806b3841-fddf-4c1c-8e24-82aab0618da0 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:30:58.058711 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-806b3841-fddf-4c1c-8e24-82aab0618da0 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36" status: 200 len: 1681 microversion: 2.1 time: 0.326353 May 03 09:30:58.071932 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1334/2843] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:30:57 2022] GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36 => generated 1681 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:30:58.218013 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [req-8ba2d55a-6171-47bc-b1ff-f41835bf80f1 req-93ff9a08-1187-44c4-a786-3f536666dc9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55e6edb6-95bf-495b-8b94-b39ddffeadc4", "name": "network-vif-deleted", "tag": "b896e9bb-b27d-45be-9b1c-47d98fd08dd5"}]} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:30:58.230255 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-8ba2d55a-6171-47bc-b1ff-f41835bf80f1 req-93ff9a08-1187-44c4-a786-3f536666dc9d service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:58.230936 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-8ba2d55a-6171-47bc-b1ff-f41835bf80f1 req-93ff9a08-1187-44c4-a786-3f536666dc9d service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:58.243984 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.compute.server_external_events [req-8ba2d55a-6171-47bc-b1ff-f41835bf80f1 req-93ff9a08-1187-44c4-a786-3f536666dc9d service nova] Creating event network-vif-deleted:b896e9bb-b27d-45be-9b1c-47d98fd08dd5 for instance 55e6edb6-95bf-495b-8b94-b39ddffeadc4 on hv-cinder-84027 May 03 09:30:58.262339 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [req-8ba2d55a-6171-47bc-b1ff-f41835bf80f1 req-93ff9a08-1187-44c4-a786-3f536666dc9d service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049123 May 03 09:30:58.264204 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1510/2844] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:30:58.968038 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-450bc701-c794-4641-a6fa-711e7bba7e9a tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:30:58.969254 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-450bc701-c794-4641-a6fa-711e7bba7e9a tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] [instance: 55e6edb6-95bf-495b-8b94-b39ddffeadc4] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:30:58.976507 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-450bc701-c794-4641-a6fa-711e7bba7e9a tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:58.977222 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-450bc701-c794-4641-a6fa-711e7bba7e9a tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:58.978183 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-450bc701-c794-4641-a6fa-711e7bba7e9a tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:58.979101 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-450bc701-c794-4641-a6fa-711e7bba7e9a tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:59.000571 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-450bc701-c794-4641-a6fa-711e7bba7e9a tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] HTTP exception thrown: Instance 55e6edb6-95bf-495b-8b94-b39ddffeadc4 could not be found. May 03 09:30:59.001929 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-450bc701-c794-4641-a6fa-711e7bba7e9a tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Returning 404 to user: Instance 55e6edb6-95bf-495b-8b94-b39ddffeadc4 could not be found. {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 09:30:59.003531 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-450bc701-c794-4641-a6fa-711e7bba7e9a tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4" status: 404 len: 111 microversion: 2.1 time: 0.041310 May 03 09:30:59.004649 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1335/2845] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:30:58 2022] GET /compute/v2.1/servers/55e6edb6-95bf-495b-8b94-b39ddffeadc4 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 09:30:59.014496 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-d4ddcaf9-4628-487e-b232-ce138e4fbd4d tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] Calling method '.version_select at 0x7f09d35699d0>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:30:59.052773 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-d4ddcaf9-4628-487e-b232-ce138e4fbd4d tempest-TestMinimumBasicScenario-595032433 tempest-TestMinimumBasicScenario-595032433-project] 10.222.0.11 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1110234858" status: 202 len: 0 microversion: 2.1 time: 0.042825 May 03 09:30:59.054526 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1511/2846] 10.222.0.11 () {58 vars in 1271 bytes} [Tue May 3 09:30:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1110234858 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 09:30:59.083350 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d95b3a22-fbbb-4162-9f9d-f1d78a1a0694 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:30:59.084085 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d95b3a22-fbbb-4162-9f9d-f1d78a1a0694 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 331f3231-997c-4260-8d91-d4dc89a10a36] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:30:59.099152 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d95b3a22-fbbb-4162-9f9d-f1d78a1a0694 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:59.100487 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d95b3a22-fbbb-4162-9f9d-f1d78a1a0694 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:59.101650 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d95b3a22-fbbb-4162-9f9d-f1d78a1a0694 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:59.102352 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d95b3a22-fbbb-4162-9f9d-f1d78a1a0694 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:59.143027 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d95b3a22-fbbb-4162-9f9d-f1d78a1a0694 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:30:59.159700 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d95b3a22-fbbb-4162-9f9d-f1d78a1a0694 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:30:59.159700 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.objects.instance [None req-d95b3a22-fbbb-4162-9f9d-f1d78a1a0694 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lazy-loading 'fault' on Instance uuid 331f3231-997c-4260-8d91-d4dc89a10a36 {{(pid=123392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 03 09:30:59.212559 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d95b3a22-fbbb-4162-9f9d-f1d78a1a0694 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:30:59.230790 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d95b3a22-fbbb-4162-9f9d-f1d78a1a0694 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36" status: 200 len: 1331 microversion: 2.1 time: 0.151609 May 03 09:30:59.241798 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1336/2847] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:30:59 2022] GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36 => generated 1331 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:31:00.249974 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e1f320e2-0afe-4594-8bee-8852573f94f4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:31:00.250732 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e1f320e2-0afe-4594-8bee-8852573f94f4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 331f3231-997c-4260-8d91-d4dc89a10a36] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:31:00.258150 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e1f320e2-0afe-4594-8bee-8852573f94f4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:31:00.258598 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e1f320e2-0afe-4594-8bee-8852573f94f4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:31:00.259392 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e1f320e2-0afe-4594-8bee-8852573f94f4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:31:00.259837 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e1f320e2-0afe-4594-8bee-8852573f94f4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:31:00.273268 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.wsgi [None req-e1f320e2-0afe-4594-8bee-8852573f94f4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] HTTP exception thrown: Instance 331f3231-997c-4260-8d91-d4dc89a10a36 could not be found. May 03 09:31:00.273859 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e1f320e2-0afe-4594-8bee-8852573f94f4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Returning 404 to user: Instance 331f3231-997c-4260-8d91-d4dc89a10a36 could not be found. {{(pid=123391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 09:31:00.274681 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e1f320e2-0afe-4594-8bee-8852573f94f4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36" status: 404 len: 111 microversion: 2.1 time: 0.029442 May 03 09:31:00.275226 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1512/2848] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:31:00 2022] GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 09:31:00.283793 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d694e444-46df-47fe-92d5-04df5ae22697 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '.version_select at 0x7f09cdd378b0>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:31:00.305217 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d694e444-46df-47fe-92d5-04df5ae22697 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-877196112" status: 202 len: 0 microversion: 2.1 time: 0.025232 May 03 09:31:00.306248 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1337/2849] 10.222.0.11 () {58 vars in 1217 bytes} [Tue May 3 09:31:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-877196112 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 09:31:00.311610 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [req-973baeaf-f8df-4e57-86c4-8ae1945ae00b req-855788df-ee3c-4c7a-bcc8-3dbab7996537 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "331f3231-997c-4260-8d91-d4dc89a10a36", "name": "network-vif-deleted", "tag": "32d02ec6-75b8-4708-8af1-006306964125"}]} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:31:00.320706 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-973baeaf-f8df-4e57-86c4-8ae1945ae00b req-855788df-ee3c-4c7a-bcc8-3dbab7996537 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:31:00.321133 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-973baeaf-f8df-4e57-86c4-8ae1945ae00b req-855788df-ee3c-4c7a-bcc8-3dbab7996537 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:31:00.332123 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.compute.server_external_events [req-973baeaf-f8df-4e57-86c4-8ae1945ae00b req-855788df-ee3c-4c7a-bcc8-3dbab7996537 service nova] Creating event network-vif-deleted:32d02ec6-75b8-4708-8af1-006306964125 for instance 331f3231-997c-4260-8d91-d4dc89a10a36 on hv-cinder-84027 May 03 09:31:00.337015 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [req-973baeaf-f8df-4e57-86c4-8ae1945ae00b req-855788df-ee3c-4c7a-bcc8-3dbab7996537 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029356 May 03 09:31:00.337765 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1513/2850] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:31:00.934100 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-faf313fb-d4c4-4a56-ab59-221692f3dc15 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Action: 'create', calling method: .version_select at 0x7f09d35b7b80>, body: {"keypair": {"name": "tempest-keypair-966790810"}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:31:00.948345 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-faf313fb-d4c4-4a56-ab59-221692f3dc15 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Getting quotas for project 273a7688b38c4558b4c223ba1d9ecdf2. Resources: {'key_pairs'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 03 09:31:00.953221 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-faf313fb-d4c4-4a56-ab59-221692f3dc15 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Getting quotas for user 0f544c320b724a1fbd779f8ab51a7911 and project 273a7688b38c4558b4c223ba1d9ecdf2. Resources: {'key_pairs'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 03 09:31:01.189387 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-faf313fb-d4c4-4a56-ab59-221692f3dc15 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Getting quotas for project 273a7688b38c4558b4c223ba1d9ecdf2. Resources: {'key_pairs'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 03 09:31:01.193287 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-faf313fb-d4c4-4a56-ab59-221692f3dc15 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Getting quotas for user 0f544c320b724a1fbd779f8ab51a7911 and project 273a7688b38c4558b4c223ba1d9ecdf2. Resources: {'key_pairs'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 03 09:31:01.211426 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-faf313fb-d4c4-4a56-ab59-221692f3dc15 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.282034 May 03 09:31:01.218172 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1338/2851] 10.222.0.11 () {60 vars in 1157 bytes} [Tue May 3 09:31:00 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:31:02.728505 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-63228072-d352-40be-bb93-72f0234f0f50 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1572586374", "imageRef": "bd46d67a-108d-4c0c-9f0b-cb6d41c82a32", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2256faa9-18d6-4935-a666-8ff2d1a854c4"}], "security_groups": [{"name": "tempest-securitygroup--569706453"}], "key_name": "tempest-keypair-966790810", "user_data": "}} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:31:02.869398 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.network.neutron [None req-63228072-d352-40be-bb93-72f0234f0f50 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] validate_networks() for [('2256faa9-18d6-4935-a666-8ff2d1a854c4', None, None, None, None, None)] {{(pid=123391) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 03 09:31:03.629259 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-63228072-d352-40be-bb93-72f0234f0f50 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Flavor limits 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 03 09:31:03.629687 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-63228072-d352-40be-bb93-72f0234f0f50 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Image limits 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 03 09:31:03.630168 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-63228072-d352-40be-bb93-72f0234f0f50 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Flavor pref 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 03 09:31:03.630581 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-63228072-d352-40be-bb93-72f0234f0f50 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Image pref 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 03 09:31:03.630993 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-63228072-d352-40be-bb93-72f0234f0f50 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 03 09:31:03.641179 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-63228072-d352-40be-bb93-72f0234f0f50 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:31:03.641628 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-63228072-d352-40be-bb93-72f0234f0f50 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:31:03.642437 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-63228072-d352-40be-bb93-72f0234f0f50 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:31:03.642875 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-63228072-d352-40be-bb93-72f0234f0f50 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:31:03.660128 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.quota [None req-63228072-d352-40be-bb93-72f0234f0f50 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Getting quotas for project 273a7688b38c4558b4c223ba1d9ecdf2. Resources: {'cores', 'ram', 'instances'} {{(pid=123391) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 03 09:31:03.664248 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.quota [None req-63228072-d352-40be-bb93-72f0234f0f50 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Getting quotas for user 0f544c320b724a1fbd779f8ab51a7911 and project 273a7688b38c4558b4c223ba1d9ecdf2. Resources: {'cores', 'ram', 'instances'} {{(pid=123391) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 03 09:31:03.676210 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-63228072-d352-40be-bb93-72f0234f0f50 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Going to run 1 instances... {{(pid=123391) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 03 09:31:03.678658 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-63228072-d352-40be-bb93-72f0234f0f50 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 3731e84f-e1a1-4675-8a8f-ca828dd4ba2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd46d67a-108d-4c0c-9f0b-cb6d41c82a32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123391) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 03 09:31:03.726226 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-63228072-d352-40be-bb93-72f0234f0f50 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.003273 May 03 09:31:03.726790 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1514/2852] 10.222.0.11 () {60 vars in 1146 bytes} [Tue May 3 09:31:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 1005 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 03 09:31:03.737385 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a39e32bd-6329-4b08-a19f-d5ac13efc233 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:31:03.738048 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a39e32bd-6329-4b08-a19f-d5ac13efc233 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 3731e84f-e1a1-4675-8a8f-ca828dd4ba2a] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:31:03.809628 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a39e32bd-6329-4b08-a19f-d5ac13efc233 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:31:03.819267 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a39e32bd-6329-4b08-a19f-d5ac13efc233 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/3731e84f-e1a1-4675-8a8f-ca828dd4ba2a" status: 200 len: 1241 microversion: 2.1 time: 0.086188 May 03 09:31:03.820176 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1339/2853] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:31:03 2022] GET /compute/v2.1/servers/3731e84f-e1a1-4675-8a8f-ca828dd4ba2a => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:31:04.837099 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-bbd275aa-8be6-4feb-9001-5d04b7863f77 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:31:04.837812 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-bbd275aa-8be6-4feb-9001-5d04b7863f77 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 3731e84f-e1a1-4675-8a8f-ca828dd4ba2a] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:31:04.845122 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bbd275aa-8be6-4feb-9001-5d04b7863f77 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:31:04.845577 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bbd275aa-8be6-4feb-9001-5d04b7863f77 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:31:04.846317 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bbd275aa-8be6-4feb-9001-5d04b7863f77 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:31:04.847081 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-bbd275aa-8be6-4feb-9001-5d04b7863f77 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:31:04.935306 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-bbd275aa-8be6-4feb-9001-5d04b7863f77 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:31:04.943455 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-bbd275aa-8be6-4feb-9001-5d04b7863f77 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/3731e84f-e1a1-4675-8a8f-ca828dd4ba2a" status: 200 len: 1299 microversion: 2.1 time: 0.110738 May 03 09:31:04.944268 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1515/2854] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:31:04 2022] GET /compute/v2.1/servers/3731e84f-e1a1-4675-8a8f-ca828dd4ba2a => generated 1299 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:31:05.961189 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-8dee3478-af74-47a5-8bda-49447a84120d tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:31:05.961794 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-8dee3478-af74-47a5-8bda-49447a84120d tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 3731e84f-e1a1-4675-8a8f-ca828dd4ba2a] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:31:05.968780 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8dee3478-af74-47a5-8bda-49447a84120d tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:31:05.969231 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8dee3478-af74-47a5-8bda-49447a84120d tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:31:05.970030 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8dee3478-af74-47a5-8bda-49447a84120d tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:31:05.970463 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8dee3478-af74-47a5-8bda-49447a84120d tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:31:06.169363 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-8dee3478-af74-47a5-8bda-49447a84120d tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:31:06.181055 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-8dee3478-af74-47a5-8bda-49447a84120d tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/3731e84f-e1a1-4675-8a8f-ca828dd4ba2a" status: 200 len: 1366 microversion: 2.1 time: 0.223516 May 03 09:31:06.182637 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1340/2855] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:31:05 2022] GET /compute/v2.1/servers/3731e84f-e1a1-4675-8a8f-ca828dd4ba2a => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:31:06.602616 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [req-601d3fff-71bf-491f-93bd-1f0385dc3a84 req-0f410d82-5ae2-4aa0-965b-71b993f3d2c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3731e84f-e1a1-4675-8a8f-ca828dd4ba2a", "tag": "e4c40b87-ee50-403f-a0fb-d0f71d4cc1b1"}]} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:31:06.614836 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-601d3fff-71bf-491f-93bd-1f0385dc3a84 req-0f410d82-5ae2-4aa0-965b-71b993f3d2c3 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:31:06.615500 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-601d3fff-71bf-491f-93bd-1f0385dc3a84 req-0f410d82-5ae2-4aa0-965b-71b993f3d2c3 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:31:06.638207 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.compute.server_external_events [req-601d3fff-71bf-491f-93bd-1f0385dc3a84 req-0f410d82-5ae2-4aa0-965b-71b993f3d2c3 service nova] Creating event network-changed:e4c40b87-ee50-403f-a0fb-d0f71d4cc1b1 for instance 3731e84f-e1a1-4675-8a8f-ca828dd4ba2a on hv-cinder-84027 May 03 09:31:06.645545 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [req-601d3fff-71bf-491f-93bd-1f0385dc3a84 req-0f410d82-5ae2-4aa0-965b-71b993f3d2c3 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046472 May 03 09:31:06.646344 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1516/2856] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:31:07.198770 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6ed08882-1913-4926-8ada-37760a260db3 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:31:07.210110 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6ed08882-1913-4926-8ada-37760a260db3 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 3731e84f-e1a1-4675-8a8f-ca828dd4ba2a] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:31:07.216865 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6ed08882-1913-4926-8ada-37760a260db3 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:31:07.217307 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6ed08882-1913-4926-8ada-37760a260db3 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:31:07.218067 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6ed08882-1913-4926-8ada-37760a260db3 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:31:07.218672 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6ed08882-1913-4926-8ada-37760a260db3 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:31:07.450930 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6ed08882-1913-4926-8ada-37760a260db3 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:31:07.461004 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6ed08882-1913-4926-8ada-37760a260db3 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/3731e84f-e1a1-4675-8a8f-ca828dd4ba2a" status: 200 len: 1366 microversion: 2.1 time: 0.264289 May 03 09:31:07.462288 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1341/2857] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:31:07 2022] GET /compute/v2.1/servers/3731e84f-e1a1-4675-8a8f-ca828dd4ba2a => generated 1366 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:31:08.481994 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-89b379cd-395b-457b-9044-0a38c6f5acbd tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:31:08.483348 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-89b379cd-395b-457b-9044-0a38c6f5acbd tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 3731e84f-e1a1-4675-8a8f-ca828dd4ba2a] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:31:08.490429 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-89b379cd-395b-457b-9044-0a38c6f5acbd tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:31:08.491001 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-89b379cd-395b-457b-9044-0a38c6f5acbd tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:31:08.491644 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-89b379cd-395b-457b-9044-0a38c6f5acbd tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:31:08.492181 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-89b379cd-395b-457b-9044-0a38c6f5acbd tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:31:08.631988 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-89b379cd-395b-457b-9044-0a38c6f5acbd tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:31:08.640128 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-89b379cd-395b-457b-9044-0a38c6f5acbd tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/3731e84f-e1a1-4675-8a8f-ca828dd4ba2a" status: 200 len: 1366 microversion: 2.1 time: 0.164941 May 03 09:31:08.640834 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1517/2858] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:31:08 2022] GET /compute/v2.1/servers/3731e84f-e1a1-4675-8a8f-ca828dd4ba2a => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:31:09.657712 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-42b42429-daeb-4c92-97b0-bf0d3a866bfc tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:31:09.658342 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-42b42429-daeb-4c92-97b0-bf0d3a866bfc tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 3731e84f-e1a1-4675-8a8f-ca828dd4ba2a] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:31:09.665054 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-42b42429-daeb-4c92-97b0-bf0d3a866bfc tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:31:09.665496 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-42b42429-daeb-4c92-97b0-bf0d3a866bfc tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:31:09.666267 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-42b42429-daeb-4c92-97b0-bf0d3a866bfc tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:31:09.666698 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-42b42429-daeb-4c92-97b0-bf0d3a866bfc tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:31:09.803724 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-42b42429-daeb-4c92-97b0-bf0d3a866bfc tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:31:09.811050 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-42b42429-daeb-4c92-97b0-bf0d3a866bfc tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/3731e84f-e1a1-4675-8a8f-ca828dd4ba2a" status: 200 len: 1366 microversion: 2.1 time: 0.157239 May 03 09:31:09.811617 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1342/2859] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:31:09 2022] GET /compute/v2.1/servers/3731e84f-e1a1-4675-8a8f-ca828dd4ba2a => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:31:10.832525 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b48b5f10-bb6b-4b94-bc36-c1a33fc1e579 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:31:10.833497 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b48b5f10-bb6b-4b94-bc36-c1a33fc1e579 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 3731e84f-e1a1-4675-8a8f-ca828dd4ba2a] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:31:10.844352 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b48b5f10-bb6b-4b94-bc36-c1a33fc1e579 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:31:10.845120 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b48b5f10-bb6b-4b94-bc36-c1a33fc1e579 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:31:10.846385 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b48b5f10-bb6b-4b94-bc36-c1a33fc1e579 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:31:10.847173 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b48b5f10-bb6b-4b94-bc36-c1a33fc1e579 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:31:10.986547 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b48b5f10-bb6b-4b94-bc36-c1a33fc1e579 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:31:10.994956 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b48b5f10-bb6b-4b94-bc36-c1a33fc1e579 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/3731e84f-e1a1-4675-8a8f-ca828dd4ba2a" status: 200 len: 1366 microversion: 2.1 time: 0.169049 May 03 09:31:10.995528 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1518/2860] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:31:10 2022] GET /compute/v2.1/servers/3731e84f-e1a1-4675-8a8f-ca828dd4ba2a => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:31:11.326740 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-c751ae75-a84e-4fd8-bec4-3e4d5ac86ddb req-13dce7eb-5b6b-4a6a-b5b2-68a4d442c042 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3731e84f-e1a1-4675-8a8f-ca828dd4ba2a", "name": "network-vif-plugged", "status": "completed", "tag": "e4c40b87-ee50-403f-a0fb-d0f71d4cc1b1"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:31:11.337009 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-c751ae75-a84e-4fd8-bec4-3e4d5ac86ddb req-13dce7eb-5b6b-4a6a-b5b2-68a4d442c042 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:31:11.337508 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-c751ae75-a84e-4fd8-bec4-3e4d5ac86ddb req-13dce7eb-5b6b-4a6a-b5b2-68a4d442c042 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:31:11.348667 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-c751ae75-a84e-4fd8-bec4-3e4d5ac86ddb req-13dce7eb-5b6b-4a6a-b5b2-68a4d442c042 service nova] Creating event network-vif-plugged:e4c40b87-ee50-403f-a0fb-d0f71d4cc1b1 for instance 3731e84f-e1a1-4675-8a8f-ca828dd4ba2a on hv-cinder-84027 May 03 09:31:11.353616 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-c751ae75-a84e-4fd8-bec4-3e4d5ac86ddb req-13dce7eb-5b6b-4a6a-b5b2-68a4d442c042 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030688 May 03 09:31:11.354207 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1343/2861] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:31:12.011883 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-51d8608b-72ac-4dda-922d-74ef0df907f6 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:31:12.012509 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-51d8608b-72ac-4dda-922d-74ef0df907f6 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 3731e84f-e1a1-4675-8a8f-ca828dd4ba2a] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:31:12.019139 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-51d8608b-72ac-4dda-922d-74ef0df907f6 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:31:12.019595 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-51d8608b-72ac-4dda-922d-74ef0df907f6 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:31:12.020529 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-51d8608b-72ac-4dda-922d-74ef0df907f6 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:31:12.020973 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-51d8608b-72ac-4dda-922d-74ef0df907f6 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:31:12.159792 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-51d8608b-72ac-4dda-922d-74ef0df907f6 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:31:12.167281 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-51d8608b-72ac-4dda-922d-74ef0df907f6 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/3731e84f-e1a1-4675-8a8f-ca828dd4ba2a" status: 200 len: 1366 microversion: 2.1 time: 0.159425 May 03 09:31:12.167843 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1519/2862] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:31:12 2022] GET /compute/v2.1/servers/3731e84f-e1a1-4675-8a8f-ca828dd4ba2a => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:31:13.193063 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-654d2d5b-5f41-4952-abed-b8ec0b898d13 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:31:13.193887 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-654d2d5b-5f41-4952-abed-b8ec0b898d13 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 3731e84f-e1a1-4675-8a8f-ca828dd4ba2a] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:31:13.202919 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-654d2d5b-5f41-4952-abed-b8ec0b898d13 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:31:13.203446 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-654d2d5b-5f41-4952-abed-b8ec0b898d13 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:31:13.204409 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-654d2d5b-5f41-4952-abed-b8ec0b898d13 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:31:13.204984 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-654d2d5b-5f41-4952-abed-b8ec0b898d13 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:31:13.351400 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-654d2d5b-5f41-4952-abed-b8ec0b898d13 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:31:13.363164 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-654d2d5b-5f41-4952-abed-b8ec0b898d13 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/3731e84f-e1a1-4675-8a8f-ca828dd4ba2a" status: 200 len: 1556 microversion: 2.1 time: 0.180281 May 03 09:31:13.364084 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1344/2863] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:31:13 2022] GET /compute/v2.1/servers/3731e84f-e1a1-4675-8a8f-ca828dd4ba2a => generated 1556 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:31:13.382031 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-6d6db058-f92c-4970-b3f7-63544699ce99 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:31:13.382646 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-6d6db058-f92c-4970-b3f7-63544699ce99 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 3731e84f-e1a1-4675-8a8f-ca828dd4ba2a] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:31:13.390241 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6d6db058-f92c-4970-b3f7-63544699ce99 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:31:13.390767 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6d6db058-f92c-4970-b3f7-63544699ce99 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:31:13.391707 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6d6db058-f92c-4970-b3f7-63544699ce99 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:31:13.392267 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6d6db058-f92c-4970-b3f7-63544699ce99 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:31:13.482966 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-6d6db058-f92c-4970-b3f7-63544699ce99 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/3731e84f-e1a1-4675-8a8f-ca828dd4ba2a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.105203 May 03 09:31:13.483787 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1520/2864] 10.222.0.11 () {58 vars in 1274 bytes} [Tue May 3 09:31:13 2022] GET /compute/v2.1/servers/3731e84f-e1a1-4675-8a8f-ca828dd4ba2a/os-interface => generated 285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:31:14.787900 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-32538c7f-3023-43cc-bdbb-c3defd4146b4 req-a5bdb040-9509-4dd8-aaca-f74641e7f5c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3731e84f-e1a1-4675-8a8f-ca828dd4ba2a", "tag": "e4c40b87-ee50-403f-a0fb-d0f71d4cc1b1"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:31:14.797011 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-32538c7f-3023-43cc-bdbb-c3defd4146b4 req-a5bdb040-9509-4dd8-aaca-f74641e7f5c1 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:31:14.797445 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-32538c7f-3023-43cc-bdbb-c3defd4146b4 req-a5bdb040-9509-4dd8-aaca-f74641e7f5c1 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:31:14.808575 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-32538c7f-3023-43cc-bdbb-c3defd4146b4 req-a5bdb040-9509-4dd8-aaca-f74641e7f5c1 service nova] Creating event network-changed:e4c40b87-ee50-403f-a0fb-d0f71d4cc1b1 for instance 3731e84f-e1a1-4675-8a8f-ca828dd4ba2a on hv-cinder-84027 May 03 09:31:14.813495 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-32538c7f-3023-43cc-bdbb-c3defd4146b4 req-a5bdb040-9509-4dd8-aaca-f74641e7f5c1 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029302 May 03 09:31:14.814039 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1345/2865] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:31:50.872303 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-8f090b81-ea9d-4dfb-8984-60df341a01cb tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:31:50.872971 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-8f090b81-ea9d-4dfb-8984-60df341a01cb tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 3731e84f-e1a1-4675-8a8f-ca828dd4ba2a] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:31:50.879347 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8f090b81-ea9d-4dfb-8984-60df341a01cb tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:31:50.879796 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8f090b81-ea9d-4dfb-8984-60df341a01cb tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:31:50.880584 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8f090b81-ea9d-4dfb-8984-60df341a01cb tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:31:50.881017 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-8f090b81-ea9d-4dfb-8984-60df341a01cb tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:31:50.905130 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-8f090b81-ea9d-4dfb-8984-60df341a01cb tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/3731e84f-e1a1-4675-8a8f-ca828dd4ba2a/ips" status: 200 len: 148 microversion: 2.1 time: 0.037441 May 03 09:31:50.907105 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1521/2866] 10.222.0.11 () {58 vars in 1247 bytes} [Tue May 3 09:31:50 2022] GET /compute/v2.1/servers/3731e84f-e1a1-4675-8a8f-ca828dd4ba2a/ips => generated 148 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:31:52.266488 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f1e0529c-49f8-451e-a678-418f9b6a63c4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1efcae9a-a4ef-4c2f-9a7f-c78d439da1b8"}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:31:52.267613 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f1e0529c-49f8-451e-a678-418f9b6a63c4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 3731e84f-e1a1-4675-8a8f-ca828dd4ba2a] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:31:52.274568 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f1e0529c-49f8-451e-a678-418f9b6a63c4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:31:52.275010 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f1e0529c-49f8-451e-a678-418f9b6a63c4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:31:52.275797 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f1e0529c-49f8-451e-a678-418f9b6a63c4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:31:52.276227 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f1e0529c-49f8-451e-a678-418f9b6a63c4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:31:52.530698 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f1e0529c-49f8-451e-a678-418f9b6a63c4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "POST /compute/v2.1/servers/3731e84f-e1a1-4675-8a8f-ca828dd4ba2a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269244 May 03 09:31:52.531317 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1346/2867] 10.222.0.11 () {60 vars in 1322 bytes} [Tue May 3 09:31:52 2022] POST /compute/v2.1/servers/3731e84f-e1a1-4675-8a8f-ca828dd4ba2a/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:31:58.998894 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-35c549a2-3854-42d9-9bc0-9221453075c4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1efcae9a-a4ef-4c2f-9a7f-c78d439da1b8"}} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:31:59.000158 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-35c549a2-3854-42d9-9bc0-9221453075c4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 3731e84f-e1a1-4675-8a8f-ca828dd4ba2a] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:31:59.006811 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-35c549a2-3854-42d9-9bc0-9221453075c4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:31:59.007264 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-35c549a2-3854-42d9-9bc0-9221453075c4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:31:59.008061 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-35c549a2-3854-42d9-9bc0-9221453075c4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:31:59.008494 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-35c549a2-3854-42d9-9bc0-9221453075c4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:31:59.089677 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.wsgi [None req-35c549a2-3854-42d9-9bc0-9221453075c4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] HTTP exception thrown: Invalid volume: volume 1efcae9a-a4ef-4c2f-9a7f-c78d439da1b8 is already attached to instances: 3731e84f-e1a1-4675-8a8f-ca828dd4ba2a May 03 09:31:59.090481 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-35c549a2-3854-42d9-9bc0-9221453075c4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Returning 400 to user: Invalid volume: volume 1efcae9a-a4ef-4c2f-9a7f-c78d439da1b8 is already attached to instances: 3731e84f-e1a1-4675-8a8f-ca828dd4ba2a {{(pid=123391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 09:31:59.091592 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-35c549a2-3854-42d9-9bc0-9221453075c4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "POST /compute/v2.1/servers/3731e84f-e1a1-4675-8a8f-ca828dd4ba2a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099333 May 03 09:31:59.092405 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1522/2868] 10.222.0.11 () {60 vars in 1322 bytes} [Tue May 3 09:31:58 2022] POST /compute/v2.1/servers/3731e84f-e1a1-4675-8a8f-ca828dd4ba2a/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 03 09:31:59.157243 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5e43cb8f-4023-450c-892a-c48e350223f9 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:31:59.157771 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5e43cb8f-4023-450c-892a-c48e350223f9 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 3731e84f-e1a1-4675-8a8f-ca828dd4ba2a] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:31:59.164168 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5e43cb8f-4023-450c-892a-c48e350223f9 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:31:59.164611 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5e43cb8f-4023-450c-892a-c48e350223f9 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:31:59.165352 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5e43cb8f-4023-450c-892a-c48e350223f9 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:31:59.165795 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5e43cb8f-4023-450c-892a-c48e350223f9 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:31:59.248217 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.objects.instance [None req-5e43cb8f-4023-450c-892a-c48e350223f9 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lazy-loading 'services' on Instance uuid 3731e84f-e1a1-4675-8a8f-ca828dd4ba2a {{(pid=123392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 03 09:31:59.332218 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5e43cb8f-4023-450c-892a-c48e350223f9 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "DELETE /compute/v2.1/servers/3731e84f-e1a1-4675-8a8f-ca828dd4ba2a/os-volume_attachments/1efcae9a-a4ef-4c2f-9a7f-c78d439da1b8" status: 202 len: 0 microversion: 2.1 time: 0.179608 May 03 09:31:59.332826 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1347/2869] 10.222.0.11 () {58 vars in 1415 bytes} [Tue May 3 09:31:59 2022] DELETE /compute/v2.1/servers/3731e84f-e1a1-4675-8a8f-ca828dd4ba2a/os-volume_attachments/1efcae9a-a4ef-4c2f-9a7f-c78d439da1b8 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 09:31:59.341253 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-94f3f238-8892-40e3-a5f9-b2ee9e979e5b tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:31:59.342199 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-94f3f238-8892-40e3-a5f9-b2ee9e979e5b tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 3731e84f-e1a1-4675-8a8f-ca828dd4ba2a] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:31:59.348041 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-94f3f238-8892-40e3-a5f9-b2ee9e979e5b tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:31:59.348491 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-94f3f238-8892-40e3-a5f9-b2ee9e979e5b tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:31:59.349261 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-94f3f238-8892-40e3-a5f9-b2ee9e979e5b tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:31:59.349688 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-94f3f238-8892-40e3-a5f9-b2ee9e979e5b tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:31:59.382226 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-94f3f238-8892-40e3-a5f9-b2ee9e979e5b tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/3731e84f-e1a1-4675-8a8f-ca828dd4ba2a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044913 May 03 09:31:59.382786 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1523/2870] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:31:59 2022] GET /compute/v2.1/servers/3731e84f-e1a1-4675-8a8f-ca828dd4ba2a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:32:00.395177 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ce81071d-f07f-4525-8500-10f0a98b38c3 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:32:00.396295 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ce81071d-f07f-4525-8500-10f0a98b38c3 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 3731e84f-e1a1-4675-8a8f-ca828dd4ba2a] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:32:00.403056 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ce81071d-f07f-4525-8500-10f0a98b38c3 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:32:00.403530 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ce81071d-f07f-4525-8500-10f0a98b38c3 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:32:00.404334 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ce81071d-f07f-4525-8500-10f0a98b38c3 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:32:00.404771 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ce81071d-f07f-4525-8500-10f0a98b38c3 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:32:00.434849 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ce81071d-f07f-4525-8500-10f0a98b38c3 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/3731e84f-e1a1-4675-8a8f-ca828dd4ba2a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044608 May 03 09:32:00.435435 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1348/2871] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:32:00 2022] GET /compute/v2.1/servers/3731e84f-e1a1-4675-8a8f-ca828dd4ba2a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 03 09:32:00.495197 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-48ab4a92-c158-4d4f-93a5-cddf8506ed76 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:32:00.495799 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-48ab4a92-c158-4d4f-93a5-cddf8506ed76 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 3731e84f-e1a1-4675-8a8f-ca828dd4ba2a] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:32:00.502487 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-48ab4a92-c158-4d4f-93a5-cddf8506ed76 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:32:00.502938 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-48ab4a92-c158-4d4f-93a5-cddf8506ed76 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:32:00.503710 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-48ab4a92-c158-4d4f-93a5-cddf8506ed76 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:32:00.504200 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-48ab4a92-c158-4d4f-93a5-cddf8506ed76 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:32:00.531536 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-48ab4a92-c158-4d4f-93a5-cddf8506ed76 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 3731e84f-e1a1-4675-8a8f-ca828dd4ba2a] Going to try to terminate instance {{(pid=123391) delete /opt/stack/nova/nova/compute/api.py:2664}} May 03 09:32:00.606219 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-48ab4a92-c158-4d4f-93a5-cddf8506ed76 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "DELETE /compute/v2.1/servers/3731e84f-e1a1-4675-8a8f-ca828dd4ba2a" status: 204 len: 0 microversion: 2.1 time: 0.114677 May 03 09:32:00.606944 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1524/2872] 10.222.0.11 () {58 vars in 1238 bytes} [Tue May 3 09:32:00 2022] DELETE /compute/v2.1/servers/3731e84f-e1a1-4675-8a8f-ca828dd4ba2a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 03 09:32:00.615502 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d57056d8-e099-4cdb-9a1c-ab796f57e5fc tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:32:00.616136 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d57056d8-e099-4cdb-9a1c-ab796f57e5fc tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 3731e84f-e1a1-4675-8a8f-ca828dd4ba2a] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:32:00.622235 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d57056d8-e099-4cdb-9a1c-ab796f57e5fc tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:32:00.622681 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d57056d8-e099-4cdb-9a1c-ab796f57e5fc tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:32:00.623432 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d57056d8-e099-4cdb-9a1c-ab796f57e5fc tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:32:00.623895 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d57056d8-e099-4cdb-9a1c-ab796f57e5fc tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:32:00.758100 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d57056d8-e099-4cdb-9a1c-ab796f57e5fc tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:32:00.766142 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d57056d8-e099-4cdb-9a1c-ab796f57e5fc tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/3731e84f-e1a1-4675-8a8f-ca828dd4ba2a" status: 200 len: 1679 microversion: 2.1 time: 0.154569 May 03 09:32:00.766713 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1349/2873] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:32:00 2022] GET /compute/v2.1/servers/3731e84f-e1a1-4675-8a8f-ca828dd4ba2a => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:32:01.784416 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-4269cf3c-120e-45b5-ac52-3a798a8c87f0 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:32:01.785135 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-4269cf3c-120e-45b5-ac52-3a798a8c87f0 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 3731e84f-e1a1-4675-8a8f-ca828dd4ba2a] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:32:01.792040 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4269cf3c-120e-45b5-ac52-3a798a8c87f0 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:32:01.792495 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4269cf3c-120e-45b5-ac52-3a798a8c87f0 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:32:01.793265 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4269cf3c-120e-45b5-ac52-3a798a8c87f0 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:32:01.793699 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4269cf3c-120e-45b5-ac52-3a798a8c87f0 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:32:01.927125 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-4269cf3c-120e-45b5-ac52-3a798a8c87f0 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:32:01.934826 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-4269cf3c-120e-45b5-ac52-3a798a8c87f0 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/3731e84f-e1a1-4675-8a8f-ca828dd4ba2a" status: 200 len: 1679 microversion: 2.1 time: 0.154894 May 03 09:32:01.935388 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1525/2874] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:32:01 2022] GET /compute/v2.1/servers/3731e84f-e1a1-4675-8a8f-ca828dd4ba2a => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:32:02.953365 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-cba02e3d-37ac-463c-88be-1f63f7e52724 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:32:02.954177 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-cba02e3d-37ac-463c-88be-1f63f7e52724 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 3731e84f-e1a1-4675-8a8f-ca828dd4ba2a] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:32:02.967415 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [req-f07f2f41-ccd1-454a-a8d5-f4b770b5a81f req-0183fc7f-2d59-4265-a33b-ba4ec5f65f36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3731e84f-e1a1-4675-8a8f-ca828dd4ba2a", "name": "network-vif-deleted", "tag": "e4c40b87-ee50-403f-a0fb-d0f71d4cc1b1"}]} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:32:02.969459 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cba02e3d-37ac-463c-88be-1f63f7e52724 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:32:02.970052 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cba02e3d-37ac-463c-88be-1f63f7e52724 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:32:02.974074 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cba02e3d-37ac-463c-88be-1f63f7e52724 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:32:02.974744 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cba02e3d-37ac-463c-88be-1f63f7e52724 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:32:02.976025 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-f07f2f41-ccd1-454a-a8d5-f4b770b5a81f req-0183fc7f-2d59-4265-a33b-ba4ec5f65f36 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:32:02.976556 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-f07f2f41-ccd1-454a-a8d5-f4b770b5a81f req-0183fc7f-2d59-4265-a33b-ba4ec5f65f36 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:32:02.989846 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.compute.server_external_events [req-f07f2f41-ccd1-454a-a8d5-f4b770b5a81f req-0183fc7f-2d59-4265-a33b-ba4ec5f65f36 service nova] Creating event network-vif-deleted:e4c40b87-ee50-403f-a0fb-d0f71d4cc1b1 for instance 3731e84f-e1a1-4675-8a8f-ca828dd4ba2a on hv-cinder-84027 May 03 09:32:03.005672 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [req-f07f2f41-ccd1-454a-a8d5-f4b770b5a81f req-0183fc7f-2d59-4265-a33b-ba4ec5f65f36 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042027 May 03 09:32:03.006296 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1526/2875] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:32:03.065693 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-cba02e3d-37ac-463c-88be-1f63f7e52724 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:32:03.075548 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-cba02e3d-37ac-463c-88be-1f63f7e52724 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/3731e84f-e1a1-4675-8a8f-ca828dd4ba2a" status: 200 len: 1612 microversion: 2.1 time: 0.125986 May 03 09:32:03.076814 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1350/2876] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:32:02 2022] GET /compute/v2.1/servers/3731e84f-e1a1-4675-8a8f-ca828dd4ba2a => generated 1612 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:32:04.094590 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9e4496e8-222d-4b84-82dc-9a34dffc3e55 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:32:04.095310 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9e4496e8-222d-4b84-82dc-9a34dffc3e55 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 3731e84f-e1a1-4675-8a8f-ca828dd4ba2a] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:32:04.101819 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9e4496e8-222d-4b84-82dc-9a34dffc3e55 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:32:04.102264 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9e4496e8-222d-4b84-82dc-9a34dffc3e55 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:32:04.103035 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9e4496e8-222d-4b84-82dc-9a34dffc3e55 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:32:04.103460 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9e4496e8-222d-4b84-82dc-9a34dffc3e55 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:32:04.117266 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.wsgi [None req-9e4496e8-222d-4b84-82dc-9a34dffc3e55 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] HTTP exception thrown: Instance 3731e84f-e1a1-4675-8a8f-ca828dd4ba2a could not be found. May 03 09:32:04.117856 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9e4496e8-222d-4b84-82dc-9a34dffc3e55 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Returning 404 to user: Instance 3731e84f-e1a1-4675-8a8f-ca828dd4ba2a could not be found. {{(pid=123391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 09:32:04.118686 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9e4496e8-222d-4b84-82dc-9a34dffc3e55 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/3731e84f-e1a1-4675-8a8f-ca828dd4ba2a" status: 404 len: 111 microversion: 2.1 time: 0.028879 May 03 09:32:04.119236 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1527/2877] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:32:04 2022] GET /compute/v2.1/servers/3731e84f-e1a1-4675-8a8f-ca828dd4ba2a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 09:32:04.128091 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-897fd688-8c5f-4637-b937-7a79335a2049 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '.version_select at 0x7f09d35b78b0>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:32:04.147731 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-897fd688-8c5f-4637-b937-7a79335a2049 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-966790810" status: 202 len: 0 microversion: 2.1 time: 0.023514 May 03 09:32:04.148616 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1351/2878] 10.222.0.11 () {58 vars in 1217 bytes} [Tue May 3 09:32:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-966790810 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 09:32:04.775673 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-0649e761-ffb9-4139-a94f-6afde4aec5f1 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Action: 'create', calling method: .version_select at 0x7f09ce56a790>, body: {"keypair": {"name": "tempest-keypair-1688599197"}} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:32:04.791754 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.quota [None req-0649e761-ffb9-4139-a94f-6afde4aec5f1 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Getting quotas for project 273a7688b38c4558b4c223ba1d9ecdf2. Resources: {'key_pairs'} {{(pid=123391) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 03 09:32:04.796087 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.quota [None req-0649e761-ffb9-4139-a94f-6afde4aec5f1 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Getting quotas for user 0f544c320b724a1fbd779f8ab51a7911 and project 273a7688b38c4558b4c223ba1d9ecdf2. Resources: {'key_pairs'} {{(pid=123391) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 03 09:32:04.959867 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.quota [None req-0649e761-ffb9-4139-a94f-6afde4aec5f1 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Getting quotas for project 273a7688b38c4558b4c223ba1d9ecdf2. Resources: {'key_pairs'} {{(pid=123391) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 03 09:32:04.963443 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.quota [None req-0649e761-ffb9-4139-a94f-6afde4aec5f1 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Getting quotas for user 0f544c320b724a1fbd779f8ab51a7911 and project 273a7688b38c4558b4c223ba1d9ecdf2. Resources: {'key_pairs'} {{(pid=123391) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 03 09:32:04.976007 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-0649e761-ffb9-4139-a94f-6afde4aec5f1 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.206443 May 03 09:32:04.976593 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1528/2879] 10.222.0.11 () {60 vars in 1157 bytes} [Tue May 3 09:32:04 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:32:06.274321 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e576f6b2-fe2d-4684-a00e-5769c3bb27b4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1732044979", "imageRef": "bd46d67a-108d-4c0c-9f0b-cb6d41c82a32", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2256faa9-18d6-4935-a666-8ff2d1a854c4"}], "security_groups": [{"name": "tempest-securitygroup--2025281763"}], "key_name": "tempest-keypair-1688599197", "user_data": "}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:32:06.378585 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.network.neutron [None req-e576f6b2-fe2d-4684-a00e-5769c3bb27b4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] validate_networks() for [('2256faa9-18d6-4935-a666-8ff2d1a854c4', None, None, None, None, None)] {{(pid=123392) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 03 09:32:06.751261 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-e576f6b2-fe2d-4684-a00e-5769c3bb27b4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Flavor limits 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 03 09:32:06.751958 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-e576f6b2-fe2d-4684-a00e-5769c3bb27b4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Image limits 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 03 09:32:06.752733 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-e576f6b2-fe2d-4684-a00e-5769c3bb27b4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Flavor pref 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 03 09:32:06.753398 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-e576f6b2-fe2d-4684-a00e-5769c3bb27b4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Image pref 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 03 09:32:06.754056 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-e576f6b2-fe2d-4684-a00e-5769c3bb27b4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 03 09:32:06.766902 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e576f6b2-fe2d-4684-a00e-5769c3bb27b4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:32:06.767374 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e576f6b2-fe2d-4684-a00e-5769c3bb27b4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:32:06.768208 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e576f6b2-fe2d-4684-a00e-5769c3bb27b4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:32:06.768638 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e576f6b2-fe2d-4684-a00e-5769c3bb27b4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:32:06.784568 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-e576f6b2-fe2d-4684-a00e-5769c3bb27b4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Getting quotas for project 273a7688b38c4558b4c223ba1d9ecdf2. Resources: {'cores', 'ram', 'instances'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 03 09:32:06.788736 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-e576f6b2-fe2d-4684-a00e-5769c3bb27b4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Getting quotas for user 0f544c320b724a1fbd779f8ab51a7911 and project 273a7688b38c4558b4c223ba1d9ecdf2. Resources: {'cores', 'ram', 'instances'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 03 09:32:06.799748 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e576f6b2-fe2d-4684-a00e-5769c3bb27b4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Going to run 1 instances... {{(pid=123392) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 03 09:32:06.802071 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e576f6b2-fe2d-4684-a00e-5769c3bb27b4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: b68e0219-8b53-43db-ab5a-dfe9cb4ad021] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd46d67a-108d-4c0c-9f0b-cb6d41c82a32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 03 09:32:06.857806 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e576f6b2-fe2d-4684-a00e-5769c3bb27b4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.588240 May 03 09:32:06.858539 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1352/2880] 10.222.0.11 () {60 vars in 1146 bytes} [Tue May 3 09:32:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 03 09:32:06.869661 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-28b168e8-dd1b-4499-aec5-3322b9c4fcc6 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:32:06.871025 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-28b168e8-dd1b-4499-aec5-3322b9c4fcc6 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: b68e0219-8b53-43db-ab5a-dfe9cb4ad021] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:32:06.927200 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-28b168e8-dd1b-4499-aec5-3322b9c4fcc6 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:32:06.934908 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-28b168e8-dd1b-4499-aec5-3322b9c4fcc6 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/b68e0219-8b53-43db-ab5a-dfe9cb4ad021" status: 200 len: 1242 microversion: 2.1 time: 0.069699 May 03 09:32:06.935489 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1529/2881] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:32:06 2022] GET /compute/v2.1/servers/b68e0219-8b53-43db-ab5a-dfe9cb4ad021 => generated 1242 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:32:07.952354 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-89e7bacb-c907-4cee-a2e7-eb1927b8857d tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:32:07.952970 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-89e7bacb-c907-4cee-a2e7-eb1927b8857d tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: b68e0219-8b53-43db-ab5a-dfe9cb4ad021] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:32:08.004766 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-89e7bacb-c907-4cee-a2e7-eb1927b8857d tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:32:08.011432 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-89e7bacb-c907-4cee-a2e7-eb1927b8857d tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/b68e0219-8b53-43db-ab5a-dfe9cb4ad021" status: 200 len: 1242 microversion: 2.1 time: 0.062910 May 03 09:32:08.012023 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1353/2882] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:32:07 2022] GET /compute/v2.1/servers/b68e0219-8b53-43db-ab5a-dfe9cb4ad021 => generated 1242 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:32:09.028327 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-44daa308-edbe-442b-b513-6d2c351253d2 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:32:09.028941 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-44daa308-edbe-442b-b513-6d2c351253d2 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: b68e0219-8b53-43db-ab5a-dfe9cb4ad021] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:32:09.088699 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-44daa308-edbe-442b-b513-6d2c351253d2 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:32:09.095723 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-44daa308-edbe-442b-b513-6d2c351253d2 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/b68e0219-8b53-43db-ab5a-dfe9cb4ad021" status: 200 len: 1242 microversion: 2.1 time: 0.071284 May 03 09:32:09.096320 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1530/2883] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:32:09 2022] GET /compute/v2.1/servers/b68e0219-8b53-43db-ab5a-dfe9cb4ad021 => generated 1242 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:32:10.116832 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-54ccf453-67d9-4b95-9b70-acb63209f23c tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:32:10.118463 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-54ccf453-67d9-4b95-9b70-acb63209f23c tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: b68e0219-8b53-43db-ab5a-dfe9cb4ad021] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:32:10.175696 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-54ccf453-67d9-4b95-9b70-acb63209f23c tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:32:10.182559 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-54ccf453-67d9-4b95-9b70-acb63209f23c tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/b68e0219-8b53-43db-ab5a-dfe9cb4ad021" status: 200 len: 1242 microversion: 2.1 time: 0.072259 May 03 09:32:10.183186 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1354/2884] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:32:10 2022] GET /compute/v2.1/servers/b68e0219-8b53-43db-ab5a-dfe9cb4ad021 => generated 1242 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:32:11.203532 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-afb70f6f-4c2e-457d-9910-09366349c85c tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:32:11.204504 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-afb70f6f-4c2e-457d-9910-09366349c85c tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: b68e0219-8b53-43db-ab5a-dfe9cb4ad021] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:32:11.212893 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-afb70f6f-4c2e-457d-9910-09366349c85c tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:32:11.213345 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-afb70f6f-4c2e-457d-9910-09366349c85c tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:32:11.214123 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-afb70f6f-4c2e-457d-9910-09366349c85c tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:32:11.214551 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-afb70f6f-4c2e-457d-9910-09366349c85c tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:32:11.273798 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-afb70f6f-4c2e-457d-9910-09366349c85c tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:32:11.281443 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-afb70f6f-4c2e-457d-9910-09366349c85c tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/b68e0219-8b53-43db-ab5a-dfe9cb4ad021" status: 200 len: 1246 microversion: 2.1 time: 0.084517 May 03 09:32:11.282424 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1531/2885] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:32:11 2022] GET /compute/v2.1/servers/b68e0219-8b53-43db-ab5a-dfe9cb4ad021 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:32:12.299092 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ab22d6d8-8bbf-4c8f-a40e-87bf1e893240 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:32:12.299863 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ab22d6d8-8bbf-4c8f-a40e-87bf1e893240 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: b68e0219-8b53-43db-ab5a-dfe9cb4ad021] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:32:12.306616 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ab22d6d8-8bbf-4c8f-a40e-87bf1e893240 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:32:12.307068 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ab22d6d8-8bbf-4c8f-a40e-87bf1e893240 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:32:12.308019 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ab22d6d8-8bbf-4c8f-a40e-87bf1e893240 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:32:12.308458 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ab22d6d8-8bbf-4c8f-a40e-87bf1e893240 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:32:12.383736 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ab22d6d8-8bbf-4c8f-a40e-87bf1e893240 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:32:12.391595 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ab22d6d8-8bbf-4c8f-a40e-87bf1e893240 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/b68e0219-8b53-43db-ab5a-dfe9cb4ad021" status: 200 len: 1300 microversion: 2.1 time: 0.097058 May 03 09:32:12.392351 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1355/2886] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:32:12 2022] GET /compute/v2.1/servers/b68e0219-8b53-43db-ab5a-dfe9cb4ad021 => generated 1300 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:32:13.409199 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-462766a6-33d5-4a70-b59e-5b3ba6a9ae18 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:32:13.409816 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-462766a6-33d5-4a70-b59e-5b3ba6a9ae18 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: b68e0219-8b53-43db-ab5a-dfe9cb4ad021] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:32:13.416091 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-462766a6-33d5-4a70-b59e-5b3ba6a9ae18 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:32:13.416539 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-462766a6-33d5-4a70-b59e-5b3ba6a9ae18 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:32:13.417317 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-462766a6-33d5-4a70-b59e-5b3ba6a9ae18 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:32:13.417751 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-462766a6-33d5-4a70-b59e-5b3ba6a9ae18 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:32:13.601403 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-69b0c50b-9a20-4861-bd0c-acbc04212773 req-eb6c86dc-82ab-4cd2-9940-6e3dda3ae3dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b68e0219-8b53-43db-ab5a-dfe9cb4ad021", "tag": "da7b9acf-596f-4a66-890e-bcabbe815a93"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:32:13.611004 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-69b0c50b-9a20-4861-bd0c-acbc04212773 req-eb6c86dc-82ab-4cd2-9940-6e3dda3ae3dc service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:32:13.611595 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-69b0c50b-9a20-4861-bd0c-acbc04212773 req-eb6c86dc-82ab-4cd2-9940-6e3dda3ae3dc service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:32:13.627369 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-69b0c50b-9a20-4861-bd0c-acbc04212773 req-eb6c86dc-82ab-4cd2-9940-6e3dda3ae3dc service nova] Creating event network-changed:da7b9acf-596f-4a66-890e-bcabbe815a93 for instance b68e0219-8b53-43db-ab5a-dfe9cb4ad021 on hv-cinder-84027 May 03 09:32:13.632792 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-69b0c50b-9a20-4861-bd0c-acbc04212773 req-eb6c86dc-82ab-4cd2-9940-6e3dda3ae3dc service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036181 May 03 09:32:13.633783 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1356/2887] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:32:13.655165 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-462766a6-33d5-4a70-b59e-5b3ba6a9ae18 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:32:13.665837 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-462766a6-33d5-4a70-b59e-5b3ba6a9ae18 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/b68e0219-8b53-43db-ab5a-dfe9cb4ad021" status: 200 len: 1368 microversion: 2.1 time: 0.260477 May 03 09:32:13.676380 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1532/2888] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:32:13 2022] GET /compute/v2.1/servers/b68e0219-8b53-43db-ab5a-dfe9cb4ad021 => generated 1368 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:32:14.688925 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-65156fff-e74a-4d20-b43f-933c0744dbb0 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:32:14.690052 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-65156fff-e74a-4d20-b43f-933c0744dbb0 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: b68e0219-8b53-43db-ab5a-dfe9cb4ad021] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:32:14.701019 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-65156fff-e74a-4d20-b43f-933c0744dbb0 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:32:14.701750 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-65156fff-e74a-4d20-b43f-933c0744dbb0 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:32:14.702997 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-65156fff-e74a-4d20-b43f-933c0744dbb0 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:32:14.703705 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-65156fff-e74a-4d20-b43f-933c0744dbb0 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:32:14.915653 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-65156fff-e74a-4d20-b43f-933c0744dbb0 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:32:14.923379 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-65156fff-e74a-4d20-b43f-933c0744dbb0 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/b68e0219-8b53-43db-ab5a-dfe9cb4ad021" status: 200 len: 1368 microversion: 2.1 time: 0.242137 May 03 09:32:14.923962 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1357/2889] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:32:14 2022] GET /compute/v2.1/servers/b68e0219-8b53-43db-ab5a-dfe9cb4ad021 => generated 1368 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:32:15.941128 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3ba131c5-8317-4228-b75a-af54833435f8 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:32:15.941765 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-3ba131c5-8317-4228-b75a-af54833435f8 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: b68e0219-8b53-43db-ab5a-dfe9cb4ad021] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:32:15.948761 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3ba131c5-8317-4228-b75a-af54833435f8 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:32:15.949210 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3ba131c5-8317-4228-b75a-af54833435f8 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:32:15.949978 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3ba131c5-8317-4228-b75a-af54833435f8 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:32:15.950417 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3ba131c5-8317-4228-b75a-af54833435f8 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:32:16.098172 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-3ba131c5-8317-4228-b75a-af54833435f8 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:32:16.109030 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-3ba131c5-8317-4228-b75a-af54833435f8 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/b68e0219-8b53-43db-ab5a-dfe9cb4ad021" status: 200 len: 1368 microversion: 2.1 time: 0.171521 May 03 09:32:16.109956 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1533/2890] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:32:15 2022] GET /compute/v2.1/servers/b68e0219-8b53-43db-ab5a-dfe9cb4ad021 => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:32:17.132140 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a21239d9-4a73-4ff1-a1a5-153c69afec93 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:32:17.132803 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a21239d9-4a73-4ff1-a1a5-153c69afec93 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: b68e0219-8b53-43db-ab5a-dfe9cb4ad021] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:32:17.142530 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a21239d9-4a73-4ff1-a1a5-153c69afec93 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:32:17.143226 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a21239d9-4a73-4ff1-a1a5-153c69afec93 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:32:17.144641 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a21239d9-4a73-4ff1-a1a5-153c69afec93 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:32:17.145417 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a21239d9-4a73-4ff1-a1a5-153c69afec93 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:32:17.278400 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a21239d9-4a73-4ff1-a1a5-153c69afec93 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:32:17.286121 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a21239d9-4a73-4ff1-a1a5-153c69afec93 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/b68e0219-8b53-43db-ab5a-dfe9cb4ad021" status: 200 len: 1368 microversion: 2.1 time: 0.158033 May 03 09:32:17.286694 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1358/2891] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:32:17 2022] GET /compute/v2.1/servers/b68e0219-8b53-43db-ab5a-dfe9cb4ad021 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:32:17.565591 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [req-4af791b4-7201-41bd-9dc6-6b98e9194fe3 req-4e6324a5-c160-467f-9d73-e347a94389d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b68e0219-8b53-43db-ab5a-dfe9cb4ad021", "name": "network-vif-plugged", "status": "completed", "tag": "da7b9acf-596f-4a66-890e-bcabbe815a93"}]} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:32:17.574734 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-4af791b4-7201-41bd-9dc6-6b98e9194fe3 req-4e6324a5-c160-467f-9d73-e347a94389d5 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:32:17.575234 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-4af791b4-7201-41bd-9dc6-6b98e9194fe3 req-4e6324a5-c160-467f-9d73-e347a94389d5 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:32:17.586479 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.compute.server_external_events [req-4af791b4-7201-41bd-9dc6-6b98e9194fe3 req-4e6324a5-c160-467f-9d73-e347a94389d5 service nova] Creating event network-vif-plugged:da7b9acf-596f-4a66-890e-bcabbe815a93 for instance b68e0219-8b53-43db-ab5a-dfe9cb4ad021 on hv-cinder-84027 May 03 09:32:17.591491 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [req-4af791b4-7201-41bd-9dc6-6b98e9194fe3 req-4e6324a5-c160-467f-9d73-e347a94389d5 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029703 May 03 09:32:17.592137 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1534/2892] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:32:18.307711 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-23373ff3-2e45-4f3c-b52a-688a87ec121c tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:32:18.308780 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-23373ff3-2e45-4f3c-b52a-688a87ec121c tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: b68e0219-8b53-43db-ab5a-dfe9cb4ad021] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:32:18.319947 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-23373ff3-2e45-4f3c-b52a-688a87ec121c tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:32:18.320689 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-23373ff3-2e45-4f3c-b52a-688a87ec121c tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:32:18.321899 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-23373ff3-2e45-4f3c-b52a-688a87ec121c tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:32:18.322657 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-23373ff3-2e45-4f3c-b52a-688a87ec121c tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:32:18.468810 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-23373ff3-2e45-4f3c-b52a-688a87ec121c tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:32:18.476486 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-23373ff3-2e45-4f3c-b52a-688a87ec121c tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/b68e0219-8b53-43db-ab5a-dfe9cb4ad021" status: 200 len: 1368 microversion: 2.1 time: 0.176159 May 03 09:32:18.477266 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1359/2893] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:32:18 2022] GET /compute/v2.1/servers/b68e0219-8b53-43db-ab5a-dfe9cb4ad021 => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:32:19.495751 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-03d7da38-9671-4ce4-9b24-60b96bb18612 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:32:19.496385 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-03d7da38-9671-4ce4-9b24-60b96bb18612 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: b68e0219-8b53-43db-ab5a-dfe9cb4ad021] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:32:19.503445 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-03d7da38-9671-4ce4-9b24-60b96bb18612 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:32:19.503920 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-03d7da38-9671-4ce4-9b24-60b96bb18612 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:32:19.504673 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-03d7da38-9671-4ce4-9b24-60b96bb18612 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:32:19.505099 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-03d7da38-9671-4ce4-9b24-60b96bb18612 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:32:19.641942 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-03d7da38-9671-4ce4-9b24-60b96bb18612 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:32:19.649814 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-03d7da38-9671-4ce4-9b24-60b96bb18612 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/b68e0219-8b53-43db-ab5a-dfe9cb4ad021" status: 200 len: 1557 microversion: 2.1 time: 0.158974 May 03 09:32:19.650378 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1535/2894] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:32:19 2022] GET /compute/v2.1/servers/b68e0219-8b53-43db-ab5a-dfe9cb4ad021 => generated 1557 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:32:19.666245 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b5a05d9d-39d0-44ae-873d-8b8936df87e4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:32:19.666794 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b5a05d9d-39d0-44ae-873d-8b8936df87e4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: b68e0219-8b53-43db-ab5a-dfe9cb4ad021] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:32:19.673278 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b5a05d9d-39d0-44ae-873d-8b8936df87e4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:32:19.673765 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b5a05d9d-39d0-44ae-873d-8b8936df87e4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:32:19.674529 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b5a05d9d-39d0-44ae-873d-8b8936df87e4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:32:19.674968 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b5a05d9d-39d0-44ae-873d-8b8936df87e4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:32:19.753866 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b5a05d9d-39d0-44ae-873d-8b8936df87e4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/b68e0219-8b53-43db-ab5a-dfe9cb4ad021/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091535 May 03 09:32:19.754640 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1360/2895] 10.222.0.11 () {58 vars in 1274 bytes} [Tue May 3 09:32:19 2022] GET /compute/v2.1/servers/b68e0219-8b53-43db-ab5a-dfe9cb4ad021/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:32:20.754121 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [req-89407afe-0307-444c-b38b-bd969e82b5fe req-7c822c4b-3405-43d4-923a-c82130a2db23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b68e0219-8b53-43db-ab5a-dfe9cb4ad021", "tag": "da7b9acf-596f-4a66-890e-bcabbe815a93"}]} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:32:20.762550 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-89407afe-0307-444c-b38b-bd969e82b5fe req-7c822c4b-3405-43d4-923a-c82130a2db23 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:32:20.763005 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-89407afe-0307-444c-b38b-bd969e82b5fe req-7c822c4b-3405-43d4-923a-c82130a2db23 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:32:20.774033 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.compute.server_external_events [req-89407afe-0307-444c-b38b-bd969e82b5fe req-7c822c4b-3405-43d4-923a-c82130a2db23 service nova] Creating event network-changed:da7b9acf-596f-4a66-890e-bcabbe815a93 for instance b68e0219-8b53-43db-ab5a-dfe9cb4ad021 on hv-cinder-84027 May 03 09:32:20.779259 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [req-89407afe-0307-444c-b38b-bd969e82b5fe req-7c822c4b-3405-43d4-923a-c82130a2db23 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028941 May 03 09:32:20.779869 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1536/2896] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:32:55.683881 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e42a0965-e1b2-4cea-a79c-f96702fb8619 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:32:55.684589 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e42a0965-e1b2-4cea-a79c-f96702fb8619 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: b68e0219-8b53-43db-ab5a-dfe9cb4ad021] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:32:55.690938 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e42a0965-e1b2-4cea-a79c-f96702fb8619 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:32:55.691731 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e42a0965-e1b2-4cea-a79c-f96702fb8619 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:32:55.692567 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e42a0965-e1b2-4cea-a79c-f96702fb8619 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:32:55.693001 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e42a0965-e1b2-4cea-a79c-f96702fb8619 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:32:55.716070 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e42a0965-e1b2-4cea-a79c-f96702fb8619 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/b68e0219-8b53-43db-ab5a-dfe9cb4ad021/ips" status: 200 len: 147 microversion: 2.1 time: 0.036974 May 03 09:32:55.716621 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1361/2897] 10.222.0.11 () {58 vars in 1247 bytes} [Tue May 3 09:32:55 2022] GET /compute/v2.1/servers/b68e0219-8b53-43db-ab5a-dfe9cb4ad021/ips => generated 147 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:32:57.048955 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b7e8267e-8ea5-4372-b2eb-6bcae9c34a0f tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "21d24f1d-df3e-412c-b09c-9eef0ebccf89"}} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:32:57.050133 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b7e8267e-8ea5-4372-b2eb-6bcae9c34a0f tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: b68e0219-8b53-43db-ab5a-dfe9cb4ad021] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:32:57.057358 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b7e8267e-8ea5-4372-b2eb-6bcae9c34a0f tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:32:57.057808 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b7e8267e-8ea5-4372-b2eb-6bcae9c34a0f tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:32:57.058623 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b7e8267e-8ea5-4372-b2eb-6bcae9c34a0f tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:32:57.059190 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b7e8267e-8ea5-4372-b2eb-6bcae9c34a0f tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:32:57.316144 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b7e8267e-8ea5-4372-b2eb-6bcae9c34a0f tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "POST /compute/v2.1/servers/b68e0219-8b53-43db-ab5a-dfe9cb4ad021/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274115 May 03 09:32:57.317069 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1537/2898] 10.222.0.11 () {60 vars in 1322 bytes} [Tue May 3 09:32:57 2022] POST /compute/v2.1/servers/b68e0219-8b53-43db-ab5a-dfe9cb4ad021/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:33:03.886920 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e523c8f6-f4f2-47d1-8eb2-ea19d020accf tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:33:03.887473 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e523c8f6-f4f2-47d1-8eb2-ea19d020accf tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: b68e0219-8b53-43db-ab5a-dfe9cb4ad021] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:33:03.894018 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e523c8f6-f4f2-47d1-8eb2-ea19d020accf tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:33:03.894462 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e523c8f6-f4f2-47d1-8eb2-ea19d020accf tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:33:03.895221 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e523c8f6-f4f2-47d1-8eb2-ea19d020accf tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:33:03.895649 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e523c8f6-f4f2-47d1-8eb2-ea19d020accf tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:33:03.976253 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.objects.instance [None req-e523c8f6-f4f2-47d1-8eb2-ea19d020accf tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lazy-loading 'services' on Instance uuid b68e0219-8b53-43db-ab5a-dfe9cb4ad021 {{(pid=123392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 03 09:33:04.047397 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e523c8f6-f4f2-47d1-8eb2-ea19d020accf tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "DELETE /compute/v2.1/servers/b68e0219-8b53-43db-ab5a-dfe9cb4ad021/os-volume_attachments/21d24f1d-df3e-412c-b09c-9eef0ebccf89" status: 202 len: 0 microversion: 2.1 time: 0.164493 May 03 09:33:04.048036 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1362/2899] 10.222.0.11 () {58 vars in 1415 bytes} [Tue May 3 09:33:03 2022] DELETE /compute/v2.1/servers/b68e0219-8b53-43db-ab5a-dfe9cb4ad021/os-volume_attachments/21d24f1d-df3e-412c-b09c-9eef0ebccf89 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 09:33:04.057122 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-18168251-9873-43a2-bc1e-eafd7c8e7817 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:33:04.058280 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-18168251-9873-43a2-bc1e-eafd7c8e7817 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: b68e0219-8b53-43db-ab5a-dfe9cb4ad021] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:33:04.067087 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-18168251-9873-43a2-bc1e-eafd7c8e7817 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:33:04.067539 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-18168251-9873-43a2-bc1e-eafd7c8e7817 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:33:04.068359 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-18168251-9873-43a2-bc1e-eafd7c8e7817 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:33:04.068792 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-18168251-9873-43a2-bc1e-eafd7c8e7817 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:33:04.103530 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-18168251-9873-43a2-bc1e-eafd7c8e7817 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/b68e0219-8b53-43db-ab5a-dfe9cb4ad021/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050662 May 03 09:33:04.104488 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1538/2900] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:33:04 2022] GET /compute/v2.1/servers/b68e0219-8b53-43db-ab5a-dfe9cb4ad021/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:33:05.120406 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-08e47422-1250-433b-8c01-3503c9407a8c tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:33:05.121418 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-08e47422-1250-433b-8c01-3503c9407a8c tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: b68e0219-8b53-43db-ab5a-dfe9cb4ad021] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:33:05.128118 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-08e47422-1250-433b-8c01-3503c9407a8c tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:33:05.128559 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-08e47422-1250-433b-8c01-3503c9407a8c tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:33:05.129328 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-08e47422-1250-433b-8c01-3503c9407a8c tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:33:05.129762 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-08e47422-1250-433b-8c01-3503c9407a8c tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:33:05.159675 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-08e47422-1250-433b-8c01-3503c9407a8c tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/b68e0219-8b53-43db-ab5a-dfe9cb4ad021/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046896 May 03 09:33:05.160273 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1363/2901] 10.222.0.11 () {58 vars in 1301 bytes} [Tue May 3 09:33:05 2022] GET /compute/v2.1/servers/b68e0219-8b53-43db-ab5a-dfe9cb4ad021/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 03 09:33:05.220426 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-58fb33e0-1241-4d8c-a523-b0b075a90b21 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:33:05.220930 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-58fb33e0-1241-4d8c-a523-b0b075a90b21 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: b68e0219-8b53-43db-ab5a-dfe9cb4ad021] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:33:05.227690 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-58fb33e0-1241-4d8c-a523-b0b075a90b21 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:33:05.228164 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-58fb33e0-1241-4d8c-a523-b0b075a90b21 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:33:05.228966 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-58fb33e0-1241-4d8c-a523-b0b075a90b21 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:33:05.229393 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-58fb33e0-1241-4d8c-a523-b0b075a90b21 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:33:05.253934 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-58fb33e0-1241-4d8c-a523-b0b075a90b21 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: b68e0219-8b53-43db-ab5a-dfe9cb4ad021] Going to try to terminate instance {{(pid=123391) delete /opt/stack/nova/nova/compute/api.py:2664}} May 03 09:33:05.331368 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-58fb33e0-1241-4d8c-a523-b0b075a90b21 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "DELETE /compute/v2.1/servers/b68e0219-8b53-43db-ab5a-dfe9cb4ad021" status: 204 len: 0 microversion: 2.1 time: 0.114701 May 03 09:33:05.331981 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1539/2902] 10.222.0.11 () {58 vars in 1238 bytes} [Tue May 3 09:33:05 2022] DELETE /compute/v2.1/servers/b68e0219-8b53-43db-ab5a-dfe9cb4ad021 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 03 09:33:05.340188 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9a57a561-b76d-4f12-ac34-65efa7088bb8 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:33:05.340806 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9a57a561-b76d-4f12-ac34-65efa7088bb8 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: b68e0219-8b53-43db-ab5a-dfe9cb4ad021] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:33:05.346709 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9a57a561-b76d-4f12-ac34-65efa7088bb8 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:33:05.347155 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9a57a561-b76d-4f12-ac34-65efa7088bb8 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:33:05.347949 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9a57a561-b76d-4f12-ac34-65efa7088bb8 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:33:05.348409 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9a57a561-b76d-4f12-ac34-65efa7088bb8 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:33:05.477330 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9a57a561-b76d-4f12-ac34-65efa7088bb8 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:33:05.485305 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9a57a561-b76d-4f12-ac34-65efa7088bb8 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/b68e0219-8b53-43db-ab5a-dfe9cb4ad021" status: 200 len: 1680 microversion: 2.1 time: 0.149087 May 03 09:33:05.485908 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1364/2903] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:33:05 2022] GET /compute/v2.1/servers/b68e0219-8b53-43db-ab5a-dfe9cb4ad021 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:33:06.503069 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-9676f069-4922-49f0-9097-8bda4a3833b1 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:33:06.503644 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-9676f069-4922-49f0-9097-8bda4a3833b1 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: b68e0219-8b53-43db-ab5a-dfe9cb4ad021] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:33:06.510382 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9676f069-4922-49f0-9097-8bda4a3833b1 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:33:06.510830 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9676f069-4922-49f0-9097-8bda4a3833b1 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:33:06.511583 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9676f069-4922-49f0-9097-8bda4a3833b1 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:33:06.512046 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-9676f069-4922-49f0-9097-8bda4a3833b1 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:33:06.900930 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-9676f069-4922-49f0-9097-8bda4a3833b1 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:33:06.908531 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-9676f069-4922-49f0-9097-8bda4a3833b1 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/b68e0219-8b53-43db-ab5a-dfe9cb4ad021" status: 200 len: 1680 microversion: 2.1 time: 0.409911 May 03 09:33:06.909105 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1540/2904] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:33:06 2022] GET /compute/v2.1/servers/b68e0219-8b53-43db-ab5a-dfe9cb4ad021 => generated 1680 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:33:07.750421 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-7d4fe249-dfdd-402e-9c11-86bf91c2e92d req-8a3aa038-ed57-4302-b7ef-37127e76ded8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b68e0219-8b53-43db-ab5a-dfe9cb4ad021", "name": "network-vif-deleted", "tag": "da7b9acf-596f-4a66-890e-bcabbe815a93"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:33:07.765627 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-7d4fe249-dfdd-402e-9c11-86bf91c2e92d req-8a3aa038-ed57-4302-b7ef-37127e76ded8 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:33:07.766396 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-7d4fe249-dfdd-402e-9c11-86bf91c2e92d req-8a3aa038-ed57-4302-b7ef-37127e76ded8 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:33:07.780245 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-7d4fe249-dfdd-402e-9c11-86bf91c2e92d req-8a3aa038-ed57-4302-b7ef-37127e76ded8 service nova] Creating event network-vif-deleted:da7b9acf-596f-4a66-890e-bcabbe815a93 for instance b68e0219-8b53-43db-ab5a-dfe9cb4ad021 on hv-cinder-84027 May 03 09:33:07.786752 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-7d4fe249-dfdd-402e-9c11-86bf91c2e92d req-8a3aa038-ed57-4302-b7ef-37127e76ded8 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125471 May 03 09:33:07.787658 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1365/2905] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:33:07.925937 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a6f608c7-d791-45d1-8777-e5d02daa847d tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:33:07.926893 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a6f608c7-d791-45d1-8777-e5d02daa847d tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: b68e0219-8b53-43db-ab5a-dfe9cb4ad021] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:33:07.933519 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a6f608c7-d791-45d1-8777-e5d02daa847d tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:33:07.933982 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a6f608c7-d791-45d1-8777-e5d02daa847d tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:33:07.934744 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a6f608c7-d791-45d1-8777-e5d02daa847d tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:33:07.935185 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a6f608c7-d791-45d1-8777-e5d02daa847d tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:33:07.967258 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a6f608c7-d791-45d1-8777-e5d02daa847d tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:33:07.967594 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a6f608c7-d791-45d1-8777-e5d02daa847d tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:33:07.968120 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.objects.instance [None req-a6f608c7-d791-45d1-8777-e5d02daa847d tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lazy-loading 'fault' on Instance uuid b68e0219-8b53-43db-ab5a-dfe9cb4ad021 {{(pid=123391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 03 09:33:08.012856 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a6f608c7-d791-45d1-8777-e5d02daa847d tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f544c320b724a1fbd779f8ab51a7911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273a7688b38c4558b4c223ba1d9ecdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:33:08.021444 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a6f608c7-d791-45d1-8777-e5d02daa847d tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/b68e0219-8b53-43db-ab5a-dfe9cb4ad021" status: 200 len: 1332 microversion: 2.1 time: 0.099398 May 03 09:33:08.022013 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1541/2906] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:33:07 2022] GET /compute/v2.1/servers/b68e0219-8b53-43db-ab5a-dfe9cb4ad021 => generated 1332 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:33:09.040134 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0255bf1a-42f6-412a-814c-383de366a7da tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:33:09.040839 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0255bf1a-42f6-412a-814c-383de366a7da tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: b68e0219-8b53-43db-ab5a-dfe9cb4ad021] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:33:09.047707 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0255bf1a-42f6-412a-814c-383de366a7da tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:33:09.048188 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0255bf1a-42f6-412a-814c-383de366a7da tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:33:09.048949 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0255bf1a-42f6-412a-814c-383de366a7da tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:33:09.049387 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0255bf1a-42f6-412a-814c-383de366a7da tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:33:09.064581 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-0255bf1a-42f6-412a-814c-383de366a7da tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] HTTP exception thrown: Instance b68e0219-8b53-43db-ab5a-dfe9cb4ad021 could not be found. May 03 09:33:09.065361 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0255bf1a-42f6-412a-814c-383de366a7da tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Returning 404 to user: Instance b68e0219-8b53-43db-ab5a-dfe9cb4ad021 could not be found. {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 09:33:09.067043 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0255bf1a-42f6-412a-814c-383de366a7da tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/b68e0219-8b53-43db-ab5a-dfe9cb4ad021" status: 404 len: 111 microversion: 2.1 time: 0.031512 May 03 09:33:09.068054 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1366/2907] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:33:09 2022] GET /compute/v2.1/servers/b68e0219-8b53-43db-ab5a-dfe9cb4ad021 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 09:33:09.076846 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-eb26f9fa-3816-4b40-9b1c-5e218fbc888e tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '.version_select at 0x7f09ce674dc0>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:33:09.097947 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-eb26f9fa-3816-4b40-9b1c-5e218fbc888e tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1688599197" status: 202 len: 0 microversion: 2.1 time: 0.024913 May 03 09:33:09.098483 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1542/2908] 10.222.0.11 () {58 vars in 1220 bytes} [Tue May 3 09:33:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1688599197 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 09:33:10.885665 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-665efc4b-5229-42bb-80a2-0d16df8bdaa8 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:33:10.886333 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-665efc4b-5229-42bb-80a2-0d16df8bdaa8 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: b68e0219-8b53-43db-ab5a-dfe9cb4ad021] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:33:10.893310 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-665efc4b-5229-42bb-80a2-0d16df8bdaa8 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:33:10.893814 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-665efc4b-5229-42bb-80a2-0d16df8bdaa8 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:33:10.894601 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-665efc4b-5229-42bb-80a2-0d16df8bdaa8 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:33:10.895029 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-665efc4b-5229-42bb-80a2-0d16df8bdaa8 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:33:11.074834 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-665efc4b-5229-42bb-80a2-0d16df8bdaa8 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] HTTP exception thrown: Instance b68e0219-8b53-43db-ab5a-dfe9cb4ad021 could not be found. May 03 09:33:11.075453 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-665efc4b-5229-42bb-80a2-0d16df8bdaa8 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Returning 404 to user: Instance b68e0219-8b53-43db-ab5a-dfe9cb4ad021 could not be found. {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 09:33:11.076329 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-665efc4b-5229-42bb-80a2-0d16df8bdaa8 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "DELETE /compute/v2.1/servers/b68e0219-8b53-43db-ab5a-dfe9cb4ad021" status: 404 len: 111 microversion: 2.1 time: 0.195575 May 03 09:33:11.076868 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1367/2909] 10.222.0.11 () {58 vars in 1238 bytes} [Tue May 3 09:33:10 2022] DELETE /compute/v2.1/servers/b68e0219-8b53-43db-ab5a-dfe9cb4ad021 => generated 111 bytes in 197 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 09:33:11.085409 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-85ebf01b-6d40-47c8-9920-70529e497e5b tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:33:11.086015 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-85ebf01b-6d40-47c8-9920-70529e497e5b tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: b68e0219-8b53-43db-ab5a-dfe9cb4ad021] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:33:11.092808 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-85ebf01b-6d40-47c8-9920-70529e497e5b tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:33:11.093254 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-85ebf01b-6d40-47c8-9920-70529e497e5b tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:33:11.094008 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-85ebf01b-6d40-47c8-9920-70529e497e5b tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:33:11.094436 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-85ebf01b-6d40-47c8-9920-70529e497e5b tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:33:11.107524 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.wsgi [None req-85ebf01b-6d40-47c8-9920-70529e497e5b tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] HTTP exception thrown: Instance b68e0219-8b53-43db-ab5a-dfe9cb4ad021 could not be found. May 03 09:33:11.108064 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-85ebf01b-6d40-47c8-9920-70529e497e5b tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Returning 404 to user: Instance b68e0219-8b53-43db-ab5a-dfe9cb4ad021 could not be found. {{(pid=123391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 09:33:11.108871 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-85ebf01b-6d40-47c8-9920-70529e497e5b tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/b68e0219-8b53-43db-ab5a-dfe9cb4ad021" status: 404 len: 111 microversion: 2.1 time: 0.027815 May 03 09:33:11.109396 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1543/2910] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:33:11 2022] GET /compute/v2.1/servers/b68e0219-8b53-43db-ab5a-dfe9cb4ad021 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 09:33:12.249144 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-3dc8d59d-a4c1-4e54-a1ba-3651d00ac485 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:33:12.249676 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-3dc8d59d-a4c1-4e54-a1ba-3651d00ac485 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 3731e84f-e1a1-4675-8a8f-ca828dd4ba2a] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:33:12.256848 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3dc8d59d-a4c1-4e54-a1ba-3651d00ac485 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:33:12.257294 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3dc8d59d-a4c1-4e54-a1ba-3651d00ac485 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:33:12.258056 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3dc8d59d-a4c1-4e54-a1ba-3651d00ac485 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:33:12.258490 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3dc8d59d-a4c1-4e54-a1ba-3651d00ac485 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:33:12.271815 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-3dc8d59d-a4c1-4e54-a1ba-3651d00ac485 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] HTTP exception thrown: Instance 3731e84f-e1a1-4675-8a8f-ca828dd4ba2a could not be found. May 03 09:33:12.272484 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-3dc8d59d-a4c1-4e54-a1ba-3651d00ac485 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Returning 404 to user: Instance 3731e84f-e1a1-4675-8a8f-ca828dd4ba2a could not be found. {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 09:33:12.273287 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-3dc8d59d-a4c1-4e54-a1ba-3651d00ac485 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "DELETE /compute/v2.1/servers/3731e84f-e1a1-4675-8a8f-ca828dd4ba2a" status: 404 len: 111 microversion: 2.1 time: 0.028165 May 03 09:33:12.273824 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1368/2911] 10.222.0.11 () {58 vars in 1238 bytes} [Tue May 3 09:33:12 2022] DELETE /compute/v2.1/servers/3731e84f-e1a1-4675-8a8f-ca828dd4ba2a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 09:33:12.281829 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-4e2743b9-b96d-4d2e-83ac-b075429e57a4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:33:12.282445 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-4e2743b9-b96d-4d2e-83ac-b075429e57a4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 3731e84f-e1a1-4675-8a8f-ca828dd4ba2a] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:33:12.289079 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4e2743b9-b96d-4d2e-83ac-b075429e57a4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:33:12.289529 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4e2743b9-b96d-4d2e-83ac-b075429e57a4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:33:12.290292 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4e2743b9-b96d-4d2e-83ac-b075429e57a4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:33:12.290738 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4e2743b9-b96d-4d2e-83ac-b075429e57a4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:33:12.304515 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.wsgi [None req-4e2743b9-b96d-4d2e-83ac-b075429e57a4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] HTTP exception thrown: Instance 3731e84f-e1a1-4675-8a8f-ca828dd4ba2a could not be found. May 03 09:33:12.305098 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-4e2743b9-b96d-4d2e-83ac-b075429e57a4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Returning 404 to user: Instance 3731e84f-e1a1-4675-8a8f-ca828dd4ba2a could not be found. {{(pid=123391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 09:33:12.305889 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-4e2743b9-b96d-4d2e-83ac-b075429e57a4 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/3731e84f-e1a1-4675-8a8f-ca828dd4ba2a" status: 404 len: 111 microversion: 2.1 time: 0.028025 May 03 09:33:12.306449 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1544/2912] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:33:12 2022] GET /compute/v2.1/servers/3731e84f-e1a1-4675-8a8f-ca828dd4ba2a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 09:33:12.314541 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6619ff9a-3c4b-436a-960b-4b1376de6f24 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:33:12.315059 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6619ff9a-3c4b-436a-960b-4b1376de6f24 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 63e35bee-5659-46a2-94e7-4f1957860019] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:33:12.322036 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6619ff9a-3c4b-436a-960b-4b1376de6f24 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:33:12.322487 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6619ff9a-3c4b-436a-960b-4b1376de6f24 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:33:12.323249 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6619ff9a-3c4b-436a-960b-4b1376de6f24 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:33:12.323685 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6619ff9a-3c4b-436a-960b-4b1376de6f24 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:33:12.343375 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-6619ff9a-3c4b-436a-960b-4b1376de6f24 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] HTTP exception thrown: Instance 63e35bee-5659-46a2-94e7-4f1957860019 could not be found. May 03 09:33:12.344054 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6619ff9a-3c4b-436a-960b-4b1376de6f24 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Returning 404 to user: Instance 63e35bee-5659-46a2-94e7-4f1957860019 could not be found. {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 09:33:12.344827 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6619ff9a-3c4b-436a-960b-4b1376de6f24 tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "DELETE /compute/v2.1/servers/63e35bee-5659-46a2-94e7-4f1957860019" status: 404 len: 111 microversion: 2.1 time: 0.034198 May 03 09:33:12.345363 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1369/2913] 10.222.0.11 () {58 vars in 1238 bytes} [Tue May 3 09:33:12 2022] DELETE /compute/v2.1/servers/63e35bee-5659-46a2-94e7-4f1957860019 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 09:33:12.353468 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3df48754-748c-40dd-bdd2-da33ebddd6bb tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:33:12.354085 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-3df48754-748c-40dd-bdd2-da33ebddd6bb tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 63e35bee-5659-46a2-94e7-4f1957860019] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:33:12.360489 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3df48754-748c-40dd-bdd2-da33ebddd6bb tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:33:12.360935 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3df48754-748c-40dd-bdd2-da33ebddd6bb tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:33:12.361687 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3df48754-748c-40dd-bdd2-da33ebddd6bb tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:33:12.362120 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3df48754-748c-40dd-bdd2-da33ebddd6bb tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:33:12.375516 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.wsgi [None req-3df48754-748c-40dd-bdd2-da33ebddd6bb tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] HTTP exception thrown: Instance 63e35bee-5659-46a2-94e7-4f1957860019 could not be found. May 03 09:33:12.376129 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3df48754-748c-40dd-bdd2-da33ebddd6bb tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Returning 404 to user: Instance 63e35bee-5659-46a2-94e7-4f1957860019 could not be found. {{(pid=123391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 09:33:12.376946 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-3df48754-748c-40dd-bdd2-da33ebddd6bb tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/63e35bee-5659-46a2-94e7-4f1957860019" status: 404 len: 111 microversion: 2.1 time: 0.027386 May 03 09:33:12.377469 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1545/2914] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:33:12 2022] GET /compute/v2.1/servers/63e35bee-5659-46a2-94e7-4f1957860019 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 09:33:13.527191 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0ac42872-49ec-4722-8ce2-20851ee9f4bd tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:33:13.527726 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0ac42872-49ec-4722-8ce2-20851ee9f4bd tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 331f3231-997c-4260-8d91-d4dc89a10a36] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:33:13.534542 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0ac42872-49ec-4722-8ce2-20851ee9f4bd tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:33:13.535013 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0ac42872-49ec-4722-8ce2-20851ee9f4bd tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:33:13.535760 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0ac42872-49ec-4722-8ce2-20851ee9f4bd tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:33:13.536226 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0ac42872-49ec-4722-8ce2-20851ee9f4bd tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:33:13.550207 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-0ac42872-49ec-4722-8ce2-20851ee9f4bd tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] HTTP exception thrown: Instance 331f3231-997c-4260-8d91-d4dc89a10a36 could not be found. May 03 09:33:13.550800 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0ac42872-49ec-4722-8ce2-20851ee9f4bd tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Returning 404 to user: Instance 331f3231-997c-4260-8d91-d4dc89a10a36 could not be found. {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 09:33:13.551623 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0ac42872-49ec-4722-8ce2-20851ee9f4bd tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "DELETE /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36" status: 404 len: 111 microversion: 2.1 time: 0.028362 May 03 09:33:13.552193 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1370/2915] 10.222.0.11 () {58 vars in 1238 bytes} [Tue May 3 09:33:13 2022] DELETE /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 09:33:13.560569 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-cb4f63ff-7d25-4cee-b309-362ba1e19b9f tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:33:13.562728 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-cb4f63ff-7d25-4cee-b309-362ba1e19b9f tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] [instance: 331f3231-997c-4260-8d91-d4dc89a10a36] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:33:13.569992 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cb4f63ff-7d25-4cee-b309-362ba1e19b9f tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:33:13.570449 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cb4f63ff-7d25-4cee-b309-362ba1e19b9f tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:33:13.571242 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cb4f63ff-7d25-4cee-b309-362ba1e19b9f tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:33:13.571706 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-cb4f63ff-7d25-4cee-b309-362ba1e19b9f tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:33:13.585327 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.wsgi [None req-cb4f63ff-7d25-4cee-b309-362ba1e19b9f tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] HTTP exception thrown: Instance 331f3231-997c-4260-8d91-d4dc89a10a36 could not be found. May 03 09:33:13.585909 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-cb4f63ff-7d25-4cee-b309-362ba1e19b9f tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] Returning 404 to user: Instance 331f3231-997c-4260-8d91-d4dc89a10a36 could not be found. {{(pid=123391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 09:33:13.586736 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-cb4f63ff-7d25-4cee-b309-362ba1e19b9f tempest-AttachVolumeNegativeTest-480270008 tempest-AttachVolumeNegativeTest-480270008-project] 10.222.0.11 "GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36" status: 404 len: 111 microversion: 2.1 time: 0.030189 May 03 09:33:13.587266 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1546/2916] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:33:13 2022] GET /compute/v2.1/servers/331f3231-997c-4260-8d91-d4dc89a10a36 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 09:33:38.461322 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 09:33:38.462406 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: Tue May 3 09:33:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 03 09:34:34.852585 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0ee8d2c8-075b-4508-b7fe-e11bc9ecf922 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Action: 'create', calling method: .version_select at 0x7f09d35eaa60>, body: {"keypair": {"name": "tempest-TestShelveInstance-678972420"}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:34:34.867032 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-0ee8d2c8-075b-4508-b7fe-e11bc9ecf922 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Getting quotas for project 653db297f7174d809801b3687717832b. Resources: {'key_pairs'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 03 09:34:34.871272 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-0ee8d2c8-075b-4508-b7fe-e11bc9ecf922 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Getting quotas for user 9f78486cf7a74b068d83bf755edee919 and project 653db297f7174d809801b3687717832b. Resources: {'key_pairs'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 03 09:34:35.051632 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-0ee8d2c8-075b-4508-b7fe-e11bc9ecf922 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Getting quotas for project 653db297f7174d809801b3687717832b. Resources: {'key_pairs'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 03 09:34:35.055565 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-0ee8d2c8-075b-4508-b7fe-e11bc9ecf922 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Getting quotas for user 9f78486cf7a74b068d83bf755edee919 and project 653db297f7174d809801b3687717832b. Resources: {'key_pairs'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 03 09:34:35.071830 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0ee8d2c8-075b-4508-b7fe-e11bc9ecf922 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] 10.222.0.11 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 0.399403 May 03 09:34:35.072480 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1371/2917] 10.222.0.11 () {60 vars in 1157 bytes} [Tue May 3 09:34:34 2022] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:34:51.346664 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-66bbcd5c-b32f-4663-861a-524f625616e0 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1159296736", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-678972420", "security_groups": [{"name": "tempest-secgroup-smoke-1814035569"}], "networks": [{"uuid": "d12289ff-f77c-4658-80e7-df2473f2037b"}], "block_device_mapping_v2": [{"uuid": "0920866f-a020-49ce-89a2-68306533db7b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:34:51.470404 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.network.neutron [None req-66bbcd5c-b32f-4663-861a-524f625616e0 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] validate_networks() for [('d12289ff-f77c-4658-80e7-df2473f2037b', None, None, None, None, None)] {{(pid=123391) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 03 09:34:51.963385 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-66bbcd5c-b32f-4663-861a-524f625616e0 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Flavor limits 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 03 09:34:51.964090 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-66bbcd5c-b32f-4663-861a-524f625616e0 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Image limits 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 03 09:34:51.964875 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-66bbcd5c-b32f-4663-861a-524f625616e0 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Flavor pref 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 03 09:34:51.965469 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-66bbcd5c-b32f-4663-861a-524f625616e0 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Image pref 0:0:0 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 03 09:34:51.966170 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.virt.hardware [None req-66bbcd5c-b32f-4663-861a-524f625616e0 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 03 09:34:51.977186 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-66bbcd5c-b32f-4663-861a-524f625616e0 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:34:51.977640 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-66bbcd5c-b32f-4663-861a-524f625616e0 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:34:51.978480 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-66bbcd5c-b32f-4663-861a-524f625616e0 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:34:51.978906 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-66bbcd5c-b32f-4663-861a-524f625616e0 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:34:51.996217 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.quota [None req-66bbcd5c-b32f-4663-861a-524f625616e0 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Getting quotas for project 653db297f7174d809801b3687717832b. Resources: {'cores', 'ram', 'instances'} {{(pid=123391) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 03 09:34:52.000607 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.quota [None req-66bbcd5c-b32f-4663-861a-524f625616e0 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Getting quotas for user 9f78486cf7a74b068d83bf755edee919 and project 653db297f7174d809801b3687717832b. Resources: {'cores', 'ram', 'instances'} {{(pid=123391) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 03 09:34:52.060724 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-66bbcd5c-b32f-4663-861a-524f625616e0 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Going to run 1 instances... {{(pid=123391) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 03 09:34:52.063229 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-66bbcd5c-b32f-4663-861a-524f625616e0 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] [instance: edefc60b-ae3d-40e2-9166-4435f10562b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0920866f-a020-49ce-89a2-68306533db7b',volume_size=None,volume_type=None)] {{(pid=123391) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 03 09:34:52.213311 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-66bbcd5c-b32f-4663-861a-524f625616e0 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.873947 May 03 09:34:52.214055 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1547/2918] 10.222.0.11 () {60 vars in 1146 bytes} [Tue May 3 09:34:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 03 09:34:52.225227 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-50db71f5-8e73-421c-a23e-8eda075eff08 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:34:52.225796 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-50db71f5-8e73-421c-a23e-8eda075eff08 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] [instance: edefc60b-ae3d-40e2-9166-4435f10562b9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:34:52.333345 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-50db71f5-8e73-421c-a23e-8eda075eff08 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f78486cf7a74b068d83bf755edee919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653db297f7174d809801b3687717832b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:34:52.340506 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-50db71f5-8e73-421c-a23e-8eda075eff08 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] 10.222.0.11 "GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9" status: 200 len: 1088 microversion: 2.1 time: 0.119684 May 03 09:34:52.341082 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1372/2919] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:34:52 2022] GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9 => generated 1088 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:34:53.360960 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-40519180-c2e9-43b3-8461-ad11779c5f8d tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:34:53.361614 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-40519180-c2e9-43b3-8461-ad11779c5f8d tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] [instance: edefc60b-ae3d-40e2-9166-4435f10562b9] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:34:53.368758 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-40519180-c2e9-43b3-8461-ad11779c5f8d tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:34:53.369221 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-40519180-c2e9-43b3-8461-ad11779c5f8d tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:34:53.370020 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-40519180-c2e9-43b3-8461-ad11779c5f8d tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:34:53.370455 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-40519180-c2e9-43b3-8461-ad11779c5f8d tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:34:53.446774 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-40519180-c2e9-43b3-8461-ad11779c5f8d tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f78486cf7a74b068d83bf755edee919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653db297f7174d809801b3687717832b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:34:53.455709 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-40519180-c2e9-43b3-8461-ad11779c5f8d tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] 10.222.0.11 "GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9" status: 200 len: 1194 microversion: 2.1 time: 0.099618 May 03 09:34:53.456440 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1548/2920] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:34:53 2022] GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9 => generated 1194 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:34:54.473862 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-1157c885-8ee3-4697-aa08-765fd870648f tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:34:54.474510 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-1157c885-8ee3-4697-aa08-765fd870648f tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] [instance: edefc60b-ae3d-40e2-9166-4435f10562b9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:34:54.481718 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1157c885-8ee3-4697-aa08-765fd870648f tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:34:54.482330 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1157c885-8ee3-4697-aa08-765fd870648f tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:34:54.483189 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1157c885-8ee3-4697-aa08-765fd870648f tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:34:54.483664 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1157c885-8ee3-4697-aa08-765fd870648f tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:34:54.724700 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-1157c885-8ee3-4697-aa08-765fd870648f tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f78486cf7a74b068d83bf755edee919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653db297f7174d809801b3687717832b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:34:54.732651 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-1157c885-8ee3-4697-aa08-765fd870648f tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] 10.222.0.11 "GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9" status: 200 len: 1260 microversion: 2.1 time: 0.262970 May 03 09:34:54.733237 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1373/2921] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:34:54 2022] GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9 => generated 1260 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:34:55.174059 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [req-83eb9202-bd4e-4524-8698-9e018f41b344 req-16b59953-861a-4aba-88ce-d8976282254e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edefc60b-ae3d-40e2-9166-4435f10562b9", "tag": "1f01b223-8985-4f4c-8e77-fd8545751d34"}]} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:34:55.183625 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-83eb9202-bd4e-4524-8698-9e018f41b344 req-16b59953-861a-4aba-88ce-d8976282254e service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:34:55.184115 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-83eb9202-bd4e-4524-8698-9e018f41b344 req-16b59953-861a-4aba-88ce-d8976282254e service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:34:55.203737 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.compute.server_external_events [req-83eb9202-bd4e-4524-8698-9e018f41b344 req-16b59953-861a-4aba-88ce-d8976282254e service nova] Creating event network-changed:1f01b223-8985-4f4c-8e77-fd8545751d34 for instance edefc60b-ae3d-40e2-9166-4435f10562b9 on hv-cinder-84027 May 03 09:34:55.214195 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [req-83eb9202-bd4e-4524-8698-9e018f41b344 req-16b59953-861a-4aba-88ce-d8976282254e service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043876 May 03 09:34:55.215128 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1549/2922] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:34:55.751130 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ca4cecca-eb82-4f5b-88a9-c916a257d78a tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:34:55.752006 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ca4cecca-eb82-4f5b-88a9-c916a257d78a tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] [instance: edefc60b-ae3d-40e2-9166-4435f10562b9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:34:55.759909 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ca4cecca-eb82-4f5b-88a9-c916a257d78a tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:34:55.760372 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ca4cecca-eb82-4f5b-88a9-c916a257d78a tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:34:55.761201 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ca4cecca-eb82-4f5b-88a9-c916a257d78a tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:34:55.761638 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ca4cecca-eb82-4f5b-88a9-c916a257d78a tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:34:55.939906 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ca4cecca-eb82-4f5b-88a9-c916a257d78a tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f78486cf7a74b068d83bf755edee919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653db297f7174d809801b3687717832b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:34:55.948422 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ca4cecca-eb82-4f5b-88a9-c916a257d78a tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] 10.222.0.11 "GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9" status: 200 len: 1260 microversion: 2.1 time: 0.201582 May 03 09:34:55.949025 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1374/2923] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:34:55 2022] GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9 => generated 1260 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:34:56.966854 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-f2b75910-bc7e-4cd3-9e0e-a8ea0169dce3 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:34:56.967600 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-f2b75910-bc7e-4cd3-9e0e-a8ea0169dce3 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] [instance: edefc60b-ae3d-40e2-9166-4435f10562b9] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:34:56.974595 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f2b75910-bc7e-4cd3-9e0e-a8ea0169dce3 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:34:56.975174 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f2b75910-bc7e-4cd3-9e0e-a8ea0169dce3 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:34:56.976020 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f2b75910-bc7e-4cd3-9e0e-a8ea0169dce3 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:34:56.976453 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-f2b75910-bc7e-4cd3-9e0e-a8ea0169dce3 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:34:57.124434 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-f2b75910-bc7e-4cd3-9e0e-a8ea0169dce3 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f78486cf7a74b068d83bf755edee919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653db297f7174d809801b3687717832b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:34:57.132731 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-f2b75910-bc7e-4cd3-9e0e-a8ea0169dce3 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] 10.222.0.11 "GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9" status: 200 len: 1260 microversion: 2.1 time: 0.170852 May 03 09:34:57.133329 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1550/2924] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:34:56 2022] GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:34:58.158317 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5dde4dd7-395f-4b7c-9c90-547673477cb5 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:34:58.159177 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5dde4dd7-395f-4b7c-9c90-547673477cb5 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] [instance: edefc60b-ae3d-40e2-9166-4435f10562b9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:34:58.168180 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5dde4dd7-395f-4b7c-9c90-547673477cb5 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:34:58.168729 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5dde4dd7-395f-4b7c-9c90-547673477cb5 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:34:58.169741 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5dde4dd7-395f-4b7c-9c90-547673477cb5 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:34:58.170288 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5dde4dd7-395f-4b7c-9c90-547673477cb5 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:34:58.322455 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5dde4dd7-395f-4b7c-9c90-547673477cb5 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f78486cf7a74b068d83bf755edee919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653db297f7174d809801b3687717832b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:34:58.330209 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5dde4dd7-395f-4b7c-9c90-547673477cb5 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] 10.222.0.11 "GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9" status: 200 len: 1260 microversion: 2.1 time: 0.177655 May 03 09:34:58.330852 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1375/2925] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:34:58 2022] GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9 => generated 1260 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:34:59.351236 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-586f3799-d16b-4063-9625-dec5a258d32d tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:34:59.352246 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-586f3799-d16b-4063-9625-dec5a258d32d tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] [instance: edefc60b-ae3d-40e2-9166-4435f10562b9] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:34:59.360735 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-586f3799-d16b-4063-9625-dec5a258d32d tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:34:59.361183 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-586f3799-d16b-4063-9625-dec5a258d32d tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:34:59.361975 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-586f3799-d16b-4063-9625-dec5a258d32d tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:34:59.362399 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-586f3799-d16b-4063-9625-dec5a258d32d tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:34:59.515209 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-586f3799-d16b-4063-9625-dec5a258d32d tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f78486cf7a74b068d83bf755edee919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653db297f7174d809801b3687717832b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:34:59.523531 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-586f3799-d16b-4063-9625-dec5a258d32d tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] 10.222.0.11 "GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9" status: 200 len: 1260 microversion: 2.1 time: 0.179072 May 03 09:34:59.524161 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1551/2926] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:34:59 2022] GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9 => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:35:00.545492 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c4d98954-f7ce-4940-963b-31cfb84420a1 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:35:00.546334 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c4d98954-f7ce-4940-963b-31cfb84420a1 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] [instance: edefc60b-ae3d-40e2-9166-4435f10562b9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:35:00.553753 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c4d98954-f7ce-4940-963b-31cfb84420a1 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:35:00.554205 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c4d98954-f7ce-4940-963b-31cfb84420a1 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:35:00.554982 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c4d98954-f7ce-4940-963b-31cfb84420a1 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:35:00.555429 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c4d98954-f7ce-4940-963b-31cfb84420a1 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:35:00.700336 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c4d98954-f7ce-4940-963b-31cfb84420a1 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f78486cf7a74b068d83bf755edee919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653db297f7174d809801b3687717832b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:35:00.709475 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c4d98954-f7ce-4940-963b-31cfb84420a1 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] 10.222.0.11 "GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9" status: 200 len: 1260 microversion: 2.1 time: 0.170948 May 03 09:35:00.710071 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1376/2927] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:35:00 2022] GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:35:01.732611 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b2b33e16-435b-4bbd-923d-9ce932904162 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:35:01.733285 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b2b33e16-435b-4bbd-923d-9ce932904162 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] [instance: edefc60b-ae3d-40e2-9166-4435f10562b9] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:35:01.740428 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b2b33e16-435b-4bbd-923d-9ce932904162 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:35:01.740882 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b2b33e16-435b-4bbd-923d-9ce932904162 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:35:01.741674 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b2b33e16-435b-4bbd-923d-9ce932904162 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:35:01.742105 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b2b33e16-435b-4bbd-923d-9ce932904162 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:35:01.876231 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b2b33e16-435b-4bbd-923d-9ce932904162 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f78486cf7a74b068d83bf755edee919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653db297f7174d809801b3687717832b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:35:01.888196 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b2b33e16-435b-4bbd-923d-9ce932904162 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] 10.222.0.11 "GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9" status: 200 len: 1260 microversion: 2.1 time: 0.159543 May 03 09:35:01.889041 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1552/2928] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:35:01 2022] GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:35:02.910864 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-20272932-48fd-40a5-9e08-1d8431071008 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:35:02.911867 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-20272932-48fd-40a5-9e08-1d8431071008 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] [instance: edefc60b-ae3d-40e2-9166-4435f10562b9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:35:02.920568 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-20272932-48fd-40a5-9e08-1d8431071008 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:35:02.921019 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-20272932-48fd-40a5-9e08-1d8431071008 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:35:02.921803 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-20272932-48fd-40a5-9e08-1d8431071008 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:35:02.922246 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-20272932-48fd-40a5-9e08-1d8431071008 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:35:03.072138 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-20272932-48fd-40a5-9e08-1d8431071008 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f78486cf7a74b068d83bf755edee919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653db297f7174d809801b3687717832b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:35:03.080723 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-20272932-48fd-40a5-9e08-1d8431071008 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] 10.222.0.11 "GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9" status: 200 len: 1260 microversion: 2.1 time: 0.176637 May 03 09:35:03.081337 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1377/2929] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:35:02 2022] GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9 => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:35:04.098707 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-0c0ee5e8-17a3-4cda-8ff0-295812f2f0f7 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:35:04.100021 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-0c0ee5e8-17a3-4cda-8ff0-295812f2f0f7 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] [instance: edefc60b-ae3d-40e2-9166-4435f10562b9] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:35:04.108499 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0c0ee5e8-17a3-4cda-8ff0-295812f2f0f7 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:35:04.109167 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0c0ee5e8-17a3-4cda-8ff0-295812f2f0f7 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:35:04.110146 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0c0ee5e8-17a3-4cda-8ff0-295812f2f0f7 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:35:04.110647 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-0c0ee5e8-17a3-4cda-8ff0-295812f2f0f7 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:35:04.268722 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-0c0ee5e8-17a3-4cda-8ff0-295812f2f0f7 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f78486cf7a74b068d83bf755edee919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653db297f7174d809801b3687717832b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:35:04.276193 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-0c0ee5e8-17a3-4cda-8ff0-295812f2f0f7 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] 10.222.0.11 "GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9" status: 200 len: 1260 microversion: 2.1 time: 0.182212 May 03 09:35:04.276753 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1553/2930] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:35:04 2022] GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9 => generated 1260 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:35:05.299345 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4b55fa25-2db7-4d3d-bd6b-2750db915484 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:35:05.299969 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4b55fa25-2db7-4d3d-bd6b-2750db915484 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] [instance: edefc60b-ae3d-40e2-9166-4435f10562b9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:35:05.307202 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4b55fa25-2db7-4d3d-bd6b-2750db915484 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:35:05.307682 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4b55fa25-2db7-4d3d-bd6b-2750db915484 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:35:05.308526 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4b55fa25-2db7-4d3d-bd6b-2750db915484 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:35:05.308979 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4b55fa25-2db7-4d3d-bd6b-2750db915484 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:35:05.449364 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-4b55fa25-2db7-4d3d-bd6b-2750db915484 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f78486cf7a74b068d83bf755edee919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653db297f7174d809801b3687717832b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:35:05.457371 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-4b55fa25-2db7-4d3d-bd6b-2750db915484 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] 10.222.0.11 "GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9" status: 200 len: 1260 microversion: 2.1 time: 0.162380 May 03 09:35:05.457980 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1378/2931] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:35:05 2022] GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:35:06.205571 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [req-885064bc-172f-417b-beab-aef64b1ac728 req-96a69c91-4cd1-4ca4-aa6e-820a0929d392 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edefc60b-ae3d-40e2-9166-4435f10562b9", "name": "network-vif-plugged", "status": "completed", "tag": "1f01b223-8985-4f4c-8e77-fd8545751d34"}]} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:35:06.214711 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-885064bc-172f-417b-beab-aef64b1ac728 req-96a69c91-4cd1-4ca4-aa6e-820a0929d392 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:35:06.215161 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-885064bc-172f-417b-beab-aef64b1ac728 req-96a69c91-4cd1-4ca4-aa6e-820a0929d392 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:35:06.226533 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.compute.server_external_events [req-885064bc-172f-417b-beab-aef64b1ac728 req-96a69c91-4cd1-4ca4-aa6e-820a0929d392 service nova] Creating event network-vif-plugged:1f01b223-8985-4f4c-8e77-fd8545751d34 for instance edefc60b-ae3d-40e2-9166-4435f10562b9 on hv-cinder-84027 May 03 09:35:06.231877 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [req-885064bc-172f-417b-beab-aef64b1ac728 req-96a69c91-4cd1-4ca4-aa6e-820a0929d392 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091562 May 03 09:35:06.232512 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1554/2932] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:35:06.478909 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ddd0df28-e395-4f7c-839d-1eebd39c7818 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:35:06.479573 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ddd0df28-e395-4f7c-839d-1eebd39c7818 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] [instance: edefc60b-ae3d-40e2-9166-4435f10562b9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:35:06.489464 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ddd0df28-e395-4f7c-839d-1eebd39c7818 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:35:06.489894 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ddd0df28-e395-4f7c-839d-1eebd39c7818 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:35:06.490720 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ddd0df28-e395-4f7c-839d-1eebd39c7818 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:35:06.491151 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ddd0df28-e395-4f7c-839d-1eebd39c7818 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:35:06.651447 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ddd0df28-e395-4f7c-839d-1eebd39c7818 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f78486cf7a74b068d83bf755edee919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653db297f7174d809801b3687717832b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:35:06.662338 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ddd0df28-e395-4f7c-839d-1eebd39c7818 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] 10.222.0.11 "GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9" status: 200 len: 1260 microversion: 2.1 time: 0.187328 May 03 09:35:06.663097 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1379/2933] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:35:06 2022] GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9 => generated 1260 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:35:07.685682 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-23b0c1c1-5bce-4b92-9e96-3f0decc2ded3 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:35:07.686838 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-23b0c1c1-5bce-4b92-9e96-3f0decc2ded3 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] [instance: edefc60b-ae3d-40e2-9166-4435f10562b9] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:35:07.693907 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-23b0c1c1-5bce-4b92-9e96-3f0decc2ded3 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:35:07.694366 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-23b0c1c1-5bce-4b92-9e96-3f0decc2ded3 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:35:07.695132 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-23b0c1c1-5bce-4b92-9e96-3f0decc2ded3 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:35:07.695559 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-23b0c1c1-5bce-4b92-9e96-3f0decc2ded3 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:35:07.829874 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-23b0c1c1-5bce-4b92-9e96-3f0decc2ded3 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f78486cf7a74b068d83bf755edee919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653db297f7174d809801b3687717832b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:35:07.837607 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-23b0c1c1-5bce-4b92-9e96-3f0decc2ded3 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] 10.222.0.11 "GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9" status: 200 len: 1444 microversion: 2.1 time: 0.160216 May 03 09:35:07.838174 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1555/2934] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:35:07 2022] GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9 => generated 1444 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:35:07.854456 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-274c74b9-9663-4681-b9c5-22af628d041a tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:35:07.855625 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-274c74b9-9663-4681-b9c5-22af628d041a tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] [instance: edefc60b-ae3d-40e2-9166-4435f10562b9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:35:07.862590 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-274c74b9-9663-4681-b9c5-22af628d041a tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:35:07.863053 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-274c74b9-9663-4681-b9c5-22af628d041a tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:35:07.863819 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-274c74b9-9663-4681-b9c5-22af628d041a tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:35:07.864299 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-274c74b9-9663-4681-b9c5-22af628d041a tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:35:08.001554 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-274c74b9-9663-4681-b9c5-22af628d041a tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f78486cf7a74b068d83bf755edee919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653db297f7174d809801b3687717832b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:35:08.009390 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-274c74b9-9663-4681-b9c5-22af628d041a tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] 10.222.0.11 "GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9" status: 200 len: 1444 microversion: 2.1 time: 0.159023 May 03 09:35:08.009945 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1380/2935] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:35:07 2022] GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9 => generated 1444 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:35:10.084106 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [req-b154686a-258b-4386-8854-9c7e5a87ca3a req-c10839ac-e846-4f21-a792-065a75f5704b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edefc60b-ae3d-40e2-9166-4435f10562b9", "tag": "1f01b223-8985-4f4c-8e77-fd8545751d34"}]} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:35:10.091927 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-b154686a-258b-4386-8854-9c7e5a87ca3a req-c10839ac-e846-4f21-a792-065a75f5704b service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:35:10.092373 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [req-b154686a-258b-4386-8854-9c7e5a87ca3a req-c10839ac-e846-4f21-a792-065a75f5704b service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:35:10.103414 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.compute.server_external_events [req-b154686a-258b-4386-8854-9c7e5a87ca3a req-c10839ac-e846-4f21-a792-065a75f5704b service nova] Creating event network-changed:1f01b223-8985-4f4c-8e77-fd8545751d34 for instance edefc60b-ae3d-40e2-9166-4435f10562b9 on hv-cinder-84027 May 03 09:35:10.108542 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [req-b154686a-258b-4386-8854-9c7e5a87ca3a req-c10839ac-e846-4f21-a792-065a75f5704b service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086049 May 03 09:35:10.109359 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1556/2936] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:35:42.608668 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 09:35:42.609270 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: Tue May 3 09:35:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 03 09:37:03.646308 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 09:37:03.647235 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: Tue May 3 09:37:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 03 09:37:05.620456 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4860aff2-7e2e-4d62-8cd5-ca318c7b3990 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:37:05.621060 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4860aff2-7e2e-4d62-8cd5-ca318c7b3990 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] [instance: edefc60b-ae3d-40e2-9166-4435f10562b9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:37:05.627348 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4860aff2-7e2e-4d62-8cd5-ca318c7b3990 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:37:05.627831 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4860aff2-7e2e-4d62-8cd5-ca318c7b3990 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:37:05.628596 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4860aff2-7e2e-4d62-8cd5-ca318c7b3990 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:37:05.629034 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4860aff2-7e2e-4d62-8cd5-ca318c7b3990 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:37:05.652200 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.objects.instance [None req-4860aff2-7e2e-4d62-8cd5-ca318c7b3990 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lazy-loading 'flavor' on Instance uuid edefc60b-ae3d-40e2-9166-4435f10562b9 {{(pid=123392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 03 09:37:05.735600 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-4860aff2-7e2e-4d62-8cd5-ca318c7b3990 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] 10.222.0.11 "POST /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9/action" status: 202 len: 0 microversion: 2.1 time: 0.121384 May 03 09:37:05.736276 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1381/2937] 10.222.0.11 () {60 vars in 1277 bytes} [Tue May 3 09:37:05 2022] POST /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 09:37:05.742919 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5171f508-01dc-43e8-be0c-c552110e72d0] AMQP server on 10.222.0.11:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 03 09:37:05.747464 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b0750a2c-7882-4e5d-9a2a-e03bf3f54bca tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:37:05.747731 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b0750a2c-7882-4e5d-9a2a-e03bf3f54bca tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] [instance: edefc60b-ae3d-40e2-9166-4435f10562b9] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:37:05.754368 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b0750a2c-7882-4e5d-9a2a-e03bf3f54bca tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:37:05.754835 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b0750a2c-7882-4e5d-9a2a-e03bf3f54bca tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:37:05.755620 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b0750a2c-7882-4e5d-9a2a-e03bf3f54bca tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:37:05.756101 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b0750a2c-7882-4e5d-9a2a-e03bf3f54bca tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:37:05.900540 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b0750a2c-7882-4e5d-9a2a-e03bf3f54bca tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f78486cf7a74b068d83bf755edee919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653db297f7174d809801b3687717832b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:37:05.908596 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b0750a2c-7882-4e5d-9a2a-e03bf3f54bca tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] 10.222.0.11 "GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9" status: 200 len: 1568 microversion: 2.1 time: 0.167684 May 03 09:37:05.909162 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1557/2938] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:37:05 2022] GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:37:06.927485 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-73ea482a-5f42-4720-8aff-b7a6dc8ac9ad tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:37:06.928209 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-73ea482a-5f42-4720-8aff-b7a6dc8ac9ad tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] [instance: edefc60b-ae3d-40e2-9166-4435f10562b9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:37:06.938914 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-73ea482a-5f42-4720-8aff-b7a6dc8ac9ad tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:37:06.939372 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-73ea482a-5f42-4720-8aff-b7a6dc8ac9ad tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:37:06.940197 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-73ea482a-5f42-4720-8aff-b7a6dc8ac9ad tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:37:06.940637 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-73ea482a-5f42-4720-8aff-b7a6dc8ac9ad tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:37:07.078001 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-73ea482a-5f42-4720-8aff-b7a6dc8ac9ad tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f78486cf7a74b068d83bf755edee919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653db297f7174d809801b3687717832b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:37:07.087560 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-73ea482a-5f42-4720-8aff-b7a6dc8ac9ad tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] 10.222.0.11 "GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9" status: 200 len: 1568 microversion: 2.1 time: 0.164964 May 03 09:37:07.088340 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1382/2939] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:37:06 2022] GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:37:08.105465 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a3085e36-7464-4adf-89e5-2d5312c74750 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:37:08.106077 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a3085e36-7464-4adf-89e5-2d5312c74750 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] [instance: edefc60b-ae3d-40e2-9166-4435f10562b9] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:37:08.114283 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a3085e36-7464-4adf-89e5-2d5312c74750 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:37:08.114740 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a3085e36-7464-4adf-89e5-2d5312c74750 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:37:08.115506 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a3085e36-7464-4adf-89e5-2d5312c74750 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:37:08.115957 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a3085e36-7464-4adf-89e5-2d5312c74750 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:37:08.121184 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO oslo.messaging._drivers.impl_rabbit [-] [5171f508-01dc-43e8-be0c-c552110e72d0] Reconnected to AMQP server on 10.222.0.11:5672 via [amqp] client with port 38950. May 03 09:37:08.254763 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a3085e36-7464-4adf-89e5-2d5312c74750 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f78486cf7a74b068d83bf755edee919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653db297f7174d809801b3687717832b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:37:08.262429 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a3085e36-7464-4adf-89e5-2d5312c74750 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] 10.222.0.11 "GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9" status: 200 len: 1568 microversion: 2.1 time: 0.161021 May 03 09:37:08.263013 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1558/2940] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:37:08 2022] GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:37:09.279795 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0b113ee0-648c-4736-a8a7-1ad30cb01765 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:37:09.280438 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0b113ee0-648c-4736-a8a7-1ad30cb01765 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] [instance: edefc60b-ae3d-40e2-9166-4435f10562b9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:37:09.287338 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0b113ee0-648c-4736-a8a7-1ad30cb01765 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:37:09.287797 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0b113ee0-648c-4736-a8a7-1ad30cb01765 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:37:09.288588 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0b113ee0-648c-4736-a8a7-1ad30cb01765 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:37:09.289030 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0b113ee0-648c-4736-a8a7-1ad30cb01765 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:37:09.417225 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0b113ee0-648c-4736-a8a7-1ad30cb01765 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f78486cf7a74b068d83bf755edee919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653db297f7174d809801b3687717832b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:37:09.425267 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0b113ee0-648c-4736-a8a7-1ad30cb01765 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] 10.222.0.11 "GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9" status: 200 len: 1568 microversion: 2.1 time: 0.149518 May 03 09:37:09.425816 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1383/2941] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:37:09 2022] GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:37:10.443817 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-38e904c4-e445-43fa-8bed-227e8fc89f0d tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:37:10.444435 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-38e904c4-e445-43fa-8bed-227e8fc89f0d tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] [instance: edefc60b-ae3d-40e2-9166-4435f10562b9] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:37:10.451176 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-38e904c4-e445-43fa-8bed-227e8fc89f0d tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:37:10.451627 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-38e904c4-e445-43fa-8bed-227e8fc89f0d tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:37:10.452433 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-38e904c4-e445-43fa-8bed-227e8fc89f0d tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:37:10.452950 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-38e904c4-e445-43fa-8bed-227e8fc89f0d tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:37:10.581891 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-38e904c4-e445-43fa-8bed-227e8fc89f0d tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f78486cf7a74b068d83bf755edee919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653db297f7174d809801b3687717832b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:37:10.589863 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-38e904c4-e445-43fa-8bed-227e8fc89f0d tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] 10.222.0.11 "GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9" status: 200 len: 1568 microversion: 2.1 time: 0.150056 May 03 09:37:10.590426 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1559/2942] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:37:10 2022] GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:37:11.607374 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7c447e24-97c9-4729-8407-26a2b558fe47 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:37:11.607973 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7c447e24-97c9-4729-8407-26a2b558fe47 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] [instance: edefc60b-ae3d-40e2-9166-4435f10562b9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:37:11.614696 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7c447e24-97c9-4729-8407-26a2b558fe47 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:37:11.615146 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7c447e24-97c9-4729-8407-26a2b558fe47 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:37:11.615952 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7c447e24-97c9-4729-8407-26a2b558fe47 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:37:11.616380 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7c447e24-97c9-4729-8407-26a2b558fe47 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:37:11.747746 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7c447e24-97c9-4729-8407-26a2b558fe47 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f78486cf7a74b068d83bf755edee919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653db297f7174d809801b3687717832b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:37:11.755441 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7c447e24-97c9-4729-8407-26a2b558fe47 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] 10.222.0.11 "GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9" status: 200 len: 1568 microversion: 2.1 time: 0.152156 May 03 09:37:11.756047 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1384/2943] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:37:11 2022] GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:37:12.772710 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-03a7d7c9-b92f-474c-bdfc-0a369cc15168 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:37:12.773302 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-03a7d7c9-b92f-474c-bdfc-0a369cc15168 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] [instance: edefc60b-ae3d-40e2-9166-4435f10562b9] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:37:12.780013 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-03a7d7c9-b92f-474c-bdfc-0a369cc15168 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:37:12.780459 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-03a7d7c9-b92f-474c-bdfc-0a369cc15168 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:37:12.781334 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-03a7d7c9-b92f-474c-bdfc-0a369cc15168 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:37:12.781765 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-03a7d7c9-b92f-474c-bdfc-0a369cc15168 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:37:12.911422 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-03a7d7c9-b92f-474c-bdfc-0a369cc15168 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f78486cf7a74b068d83bf755edee919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653db297f7174d809801b3687717832b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:37:12.918994 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-03a7d7c9-b92f-474c-bdfc-0a369cc15168 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] 10.222.0.11 "GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9" status: 200 len: 1568 microversion: 2.1 time: 0.150225 May 03 09:37:12.919553 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1560/2944] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:37:12 2022] GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:37:13.936586 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-fffc2d83-9e79-42b2-b585-7b06ee936610 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:37:13.937192 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-fffc2d83-9e79-42b2-b585-7b06ee936610 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] [instance: edefc60b-ae3d-40e2-9166-4435f10562b9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:37:13.943957 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fffc2d83-9e79-42b2-b585-7b06ee936610 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:37:13.944374 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fffc2d83-9e79-42b2-b585-7b06ee936610 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:37:13.945149 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fffc2d83-9e79-42b2-b585-7b06ee936610 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:37:13.945582 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fffc2d83-9e79-42b2-b585-7b06ee936610 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:37:14.076762 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-fffc2d83-9e79-42b2-b585-7b06ee936610 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f78486cf7a74b068d83bf755edee919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653db297f7174d809801b3687717832b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:37:14.084809 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-fffc2d83-9e79-42b2-b585-7b06ee936610 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] 10.222.0.11 "GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9" status: 200 len: 1568 microversion: 2.1 time: 0.152469 May 03 09:37:14.085422 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1385/2945] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:37:13 2022] GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:37:15.102357 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-67d568f4-aac9-48c3-8b0a-dff0667a7af2 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:37:15.102948 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-67d568f4-aac9-48c3-8b0a-dff0667a7af2 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] [instance: edefc60b-ae3d-40e2-9166-4435f10562b9] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:37:15.110084 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-67d568f4-aac9-48c3-8b0a-dff0667a7af2 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:37:15.115216 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-67d568f4-aac9-48c3-8b0a-dff0667a7af2 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:37:15.115216 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-67d568f4-aac9-48c3-8b0a-dff0667a7af2 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:37:15.115216 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-67d568f4-aac9-48c3-8b0a-dff0667a7af2 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:37:15.245471 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-67d568f4-aac9-48c3-8b0a-dff0667a7af2 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f78486cf7a74b068d83bf755edee919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653db297f7174d809801b3687717832b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:37:15.254101 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-67d568f4-aac9-48c3-8b0a-dff0667a7af2 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] 10.222.0.11 "GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9" status: 200 len: 1568 microversion: 2.1 time: 0.155679 May 03 09:37:15.254682 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1561/2946] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:37:15 2022] GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:37:15.865922 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 09:37:15.866531 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: Tue May 3 09:37:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 03 09:37:16.272183 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ce8988b6-8bf5-44e0-9d56-265567af7166 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:37:16.272785 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ce8988b6-8bf5-44e0-9d56-265567af7166 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] [instance: edefc60b-ae3d-40e2-9166-4435f10562b9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:37:16.281974 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ce8988b6-8bf5-44e0-9d56-265567af7166 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:37:16.282738 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ce8988b6-8bf5-44e0-9d56-265567af7166 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:37:16.283994 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ce8988b6-8bf5-44e0-9d56-265567af7166 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:37:16.284643 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ce8988b6-8bf5-44e0-9d56-265567af7166 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:37:16.505438 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ce8988b6-8bf5-44e0-9d56-265567af7166 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f78486cf7a74b068d83bf755edee919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653db297f7174d809801b3687717832b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:37:16.513457 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ce8988b6-8bf5-44e0-9d56-265567af7166 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] 10.222.0.11 "GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9" status: 200 len: 1568 microversion: 2.1 time: 0.245213 May 03 09:37:16.514271 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1386/2947] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:37:16 2022] GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9 => generated 1568 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:37:17.531285 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ccbe27de-9749-4dd3-845d-a6cbff413cdf tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:37:17.532021 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-ccbe27de-9749-4dd3-845d-a6cbff413cdf tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] [instance: edefc60b-ae3d-40e2-9166-4435f10562b9] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:37:17.538989 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ccbe27de-9749-4dd3-845d-a6cbff413cdf tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:37:17.539445 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ccbe27de-9749-4dd3-845d-a6cbff413cdf tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:37:17.540256 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ccbe27de-9749-4dd3-845d-a6cbff413cdf tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:37:17.540677 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-ccbe27de-9749-4dd3-845d-a6cbff413cdf tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:37:17.700746 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-ccbe27de-9749-4dd3-845d-a6cbff413cdf tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f78486cf7a74b068d83bf755edee919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653db297f7174d809801b3687717832b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:37:17.710905 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ccbe27de-9749-4dd3-845d-a6cbff413cdf tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] 10.222.0.11 "GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9" status: 200 len: 1568 microversion: 2.1 time: 0.183454 May 03 09:37:17.711757 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1562/2948] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:37:17 2022] GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9 => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:37:18.728767 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e82ae1a4-16d9-48a9-8c1b-2043c8a276d9 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:37:18.729421 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e82ae1a4-16d9-48a9-8c1b-2043c8a276d9 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] [instance: edefc60b-ae3d-40e2-9166-4435f10562b9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:37:18.737528 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e82ae1a4-16d9-48a9-8c1b-2043c8a276d9 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:37:18.737984 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e82ae1a4-16d9-48a9-8c1b-2043c8a276d9 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:37:18.738744 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e82ae1a4-16d9-48a9-8c1b-2043c8a276d9 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:37:18.739185 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e82ae1a4-16d9-48a9-8c1b-2043c8a276d9 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:37:18.888594 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e82ae1a4-16d9-48a9-8c1b-2043c8a276d9 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f78486cf7a74b068d83bf755edee919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653db297f7174d809801b3687717832b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:37:18.896421 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e82ae1a4-16d9-48a9-8c1b-2043c8a276d9 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] 10.222.0.11 "GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9" status: 200 len: 1569 microversion: 2.1 time: 0.171749 May 03 09:37:18.900430 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1387/2949] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:37:18 2022] GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:37:18.915062 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-870fe336-72d6-4d4c-af4c-cbeef06491de tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:37:18.915688 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-870fe336-72d6-4d4c-af4c-cbeef06491de tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] [instance: edefc60b-ae3d-40e2-9166-4435f10562b9] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:37:18.924419 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-870fe336-72d6-4d4c-af4c-cbeef06491de tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:37:18.924892 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-870fe336-72d6-4d4c-af4c-cbeef06491de tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:37:18.925666 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-870fe336-72d6-4d4c-af4c-cbeef06491de tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:37:18.926098 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-870fe336-72d6-4d4c-af4c-cbeef06491de tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:37:19.021727 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-870fe336-72d6-4d4c-af4c-cbeef06491de tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] 10.222.0.11 "POST /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9/action" status: 202 len: 0 microversion: 2.1 time: 0.112087 May 03 09:37:19.022283 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1563/2950] 10.222.0.11 () {60 vars in 1277 bytes} [Tue May 3 09:37:18 2022] POST /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 09:37:19.030798 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-563810ce-f2e1-4350-a45e-6c6d4d12939a tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:37:19.031415 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-563810ce-f2e1-4350-a45e-6c6d4d12939a tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] [instance: edefc60b-ae3d-40e2-9166-4435f10562b9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:37:19.037619 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-563810ce-f2e1-4350-a45e-6c6d4d12939a tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:37:19.038085 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-563810ce-f2e1-4350-a45e-6c6d4d12939a tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:37:19.038855 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-563810ce-f2e1-4350-a45e-6c6d4d12939a tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:37:19.039284 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-563810ce-f2e1-4350-a45e-6c6d4d12939a tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:37:19.197397 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-563810ce-f2e1-4350-a45e-6c6d4d12939a tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f78486cf7a74b068d83bf755edee919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653db297f7174d809801b3687717832b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:37:19.211573 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-563810ce-f2e1-4350-a45e-6c6d4d12939a tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] 10.222.0.11 "GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9" status: 200 len: 1517 microversion: 2.1 time: 0.184740 May 03 09:37:19.212250 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1388/2951] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:37:19 2022] GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9 => generated 1517 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:37:20.229328 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-e6092ed8-f971-4b59-9fab-7b7d2ffb0594 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:37:20.229951 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-e6092ed8-f971-4b59-9fab-7b7d2ffb0594 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] [instance: edefc60b-ae3d-40e2-9166-4435f10562b9] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:37:20.238694 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e6092ed8-f971-4b59-9fab-7b7d2ffb0594 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:37:20.239155 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e6092ed8-f971-4b59-9fab-7b7d2ffb0594 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:37:20.239960 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e6092ed8-f971-4b59-9fab-7b7d2ffb0594 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:37:20.240385 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-e6092ed8-f971-4b59-9fab-7b7d2ffb0594 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:37:20.384315 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-e6092ed8-f971-4b59-9fab-7b7d2ffb0594 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f78486cf7a74b068d83bf755edee919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653db297f7174d809801b3687717832b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:37:20.392567 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-e6092ed8-f971-4b59-9fab-7b7d2ffb0594 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] 10.222.0.11 "GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9" status: 200 len: 1519 microversion: 2.1 time: 0.167746 May 03 09:37:20.393156 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1564/2952] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:37:20 2022] GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9 => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:37:21.410253 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-90263af5-ad25-4918-a358-4559a6ef723c tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:37:21.410829 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-90263af5-ad25-4918-a358-4559a6ef723c tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] [instance: edefc60b-ae3d-40e2-9166-4435f10562b9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:37:21.418667 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-90263af5-ad25-4918-a358-4559a6ef723c tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:37:21.419120 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-90263af5-ad25-4918-a358-4559a6ef723c tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:37:21.419939 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-90263af5-ad25-4918-a358-4559a6ef723c tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:37:21.420506 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-90263af5-ad25-4918-a358-4559a6ef723c tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:37:21.558122 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-90263af5-ad25-4918-a358-4559a6ef723c tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f78486cf7a74b068d83bf755edee919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653db297f7174d809801b3687717832b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:37:21.566619 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-90263af5-ad25-4918-a358-4559a6ef723c tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] 10.222.0.11 "GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9" status: 200 len: 1575 microversion: 2.1 time: 0.160561 May 03 09:37:21.567201 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1389/2953] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:37:21 2022] GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:37:22.584822 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-b082f106-473e-4ac1-ba42-15d801a9b91c tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:37:22.585384 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-b082f106-473e-4ac1-ba42-15d801a9b91c tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] [instance: edefc60b-ae3d-40e2-9166-4435f10562b9] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:37:22.592237 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b082f106-473e-4ac1-ba42-15d801a9b91c tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:37:22.592690 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b082f106-473e-4ac1-ba42-15d801a9b91c tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:37:22.593476 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b082f106-473e-4ac1-ba42-15d801a9b91c tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:37:22.593926 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-b082f106-473e-4ac1-ba42-15d801a9b91c tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:37:22.739063 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-b082f106-473e-4ac1-ba42-15d801a9b91c tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f78486cf7a74b068d83bf755edee919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653db297f7174d809801b3687717832b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:37:22.747599 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-b082f106-473e-4ac1-ba42-15d801a9b91c tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] 10.222.0.11 "GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9" status: 200 len: 1575 microversion: 2.1 time: 0.167376 May 03 09:37:22.748209 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1565/2954] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:37:22 2022] GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9 => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:37:22.795720 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-1690ce57-7bf9-43ce-beb3-37043090a6d6 req-f3c873b7-96ed-4bfd-9228-717bd9212d84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edefc60b-ae3d-40e2-9166-4435f10562b9", "name": "network-vif-unplugged", "status": "completed", "tag": "1f01b223-8985-4f4c-8e77-fd8545751d34"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:37:22.806852 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-1690ce57-7bf9-43ce-beb3-37043090a6d6 req-f3c873b7-96ed-4bfd-9228-717bd9212d84 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:37:22.806852 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-1690ce57-7bf9-43ce-beb3-37043090a6d6 req-f3c873b7-96ed-4bfd-9228-717bd9212d84 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:37:22.819689 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-1690ce57-7bf9-43ce-beb3-37043090a6d6 req-f3c873b7-96ed-4bfd-9228-717bd9212d84 service nova] Creating event network-vif-unplugged:1f01b223-8985-4f4c-8e77-fd8545751d34 for instance edefc60b-ae3d-40e2-9166-4435f10562b9 on hv-cinder-84027 May 03 09:37:22.825165 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-1690ce57-7bf9-43ce-beb3-37043090a6d6 req-f3c873b7-96ed-4bfd-9228-717bd9212d84 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033459 May 03 09:37:22.826101 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1390/2955] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:37:23.765219 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-6f03aee5-f6fe-4376-ba6e-38dce7cd3fd8 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:37:23.765836 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-6f03aee5-f6fe-4376-ba6e-38dce7cd3fd8 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] [instance: edefc60b-ae3d-40e2-9166-4435f10562b9] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:37:23.772915 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6f03aee5-f6fe-4376-ba6e-38dce7cd3fd8 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:37:23.773358 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6f03aee5-f6fe-4376-ba6e-38dce7cd3fd8 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:37:23.774126 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6f03aee5-f6fe-4376-ba6e-38dce7cd3fd8 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:37:23.774551 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-6f03aee5-f6fe-4376-ba6e-38dce7cd3fd8 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:37:23.907599 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-6f03aee5-f6fe-4376-ba6e-38dce7cd3fd8 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f78486cf7a74b068d83bf755edee919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653db297f7174d809801b3687717832b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:37:23.916343 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-6f03aee5-f6fe-4376-ba6e-38dce7cd3fd8 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] 10.222.0.11 "GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9" status: 200 len: 1575 microversion: 2.1 time: 0.154909 May 03 09:37:23.916932 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1566/2956] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:37:23 2022] GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:37:24.934696 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a9ebab22-f8ff-4784-81bd-5ebef00ad05d tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:37:24.935496 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a9ebab22-f8ff-4784-81bd-5ebef00ad05d tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] [instance: edefc60b-ae3d-40e2-9166-4435f10562b9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:37:24.943980 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a9ebab22-f8ff-4784-81bd-5ebef00ad05d tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:37:24.944424 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a9ebab22-f8ff-4784-81bd-5ebef00ad05d tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:37:24.945200 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a9ebab22-f8ff-4784-81bd-5ebef00ad05d tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:37:24.945610 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a9ebab22-f8ff-4784-81bd-5ebef00ad05d tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:37:25.088829 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a9ebab22-f8ff-4784-81bd-5ebef00ad05d tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f78486cf7a74b068d83bf755edee919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653db297f7174d809801b3687717832b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:37:25.097871 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a9ebab22-f8ff-4784-81bd-5ebef00ad05d tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] 10.222.0.11 "GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9" status: 200 len: 1575 microversion: 2.1 time: 0.167665 May 03 09:37:25.098441 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1391/2957] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:37:24 2022] GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9 => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:37:26.115462 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-a81ef5df-55e6-4c8a-9145-f2c3bfcd1cf0 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:37:26.116096 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-a81ef5df-55e6-4c8a-9145-f2c3bfcd1cf0 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] [instance: edefc60b-ae3d-40e2-9166-4435f10562b9] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:37:26.122913 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a81ef5df-55e6-4c8a-9145-f2c3bfcd1cf0 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:37:26.123361 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a81ef5df-55e6-4c8a-9145-f2c3bfcd1cf0 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:37:26.124165 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a81ef5df-55e6-4c8a-9145-f2c3bfcd1cf0 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:37:26.124599 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-a81ef5df-55e6-4c8a-9145-f2c3bfcd1cf0 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:37:26.265898 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-a81ef5df-55e6-4c8a-9145-f2c3bfcd1cf0 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f78486cf7a74b068d83bf755edee919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653db297f7174d809801b3687717832b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:37:26.273922 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-a81ef5df-55e6-4c8a-9145-f2c3bfcd1cf0 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] 10.222.0.11 "GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9" status: 200 len: 1575 microversion: 2.1 time: 0.162531 May 03 09:37:26.274503 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1567/2958] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:37:26 2022] GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:37:27.291022 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ac047b21-7f8f-41a6-b495-af50ca3f7659 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:37:27.291635 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ac047b21-7f8f-41a6-b495-af50ca3f7659 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] [instance: edefc60b-ae3d-40e2-9166-4435f10562b9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:37:27.298349 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ac047b21-7f8f-41a6-b495-af50ca3f7659 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:37:27.298796 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ac047b21-7f8f-41a6-b495-af50ca3f7659 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:37:27.299600 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ac047b21-7f8f-41a6-b495-af50ca3f7659 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:37:27.300059 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ac047b21-7f8f-41a6-b495-af50ca3f7659 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:37:27.435312 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ac047b21-7f8f-41a6-b495-af50ca3f7659 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f78486cf7a74b068d83bf755edee919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653db297f7174d809801b3687717832b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:37:27.443032 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ac047b21-7f8f-41a6-b495-af50ca3f7659 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] 10.222.0.11 "GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9" status: 200 len: 1575 microversion: 2.1 time: 0.156138 May 03 09:37:27.443603 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1392/2959] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:37:27 2022] GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:37:28.461778 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-07d06b3d-c057-4aec-91de-f67e0416aaba tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:37:28.462318 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-07d06b3d-c057-4aec-91de-f67e0416aaba tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] [instance: edefc60b-ae3d-40e2-9166-4435f10562b9] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:37:28.469528 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-07d06b3d-c057-4aec-91de-f67e0416aaba tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:37:28.469981 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-07d06b3d-c057-4aec-91de-f67e0416aaba tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:37:28.470766 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-07d06b3d-c057-4aec-91de-f67e0416aaba tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:37:28.471203 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-07d06b3d-c057-4aec-91de-f67e0416aaba tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:37:28.610968 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-07d06b3d-c057-4aec-91de-f67e0416aaba tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f78486cf7a74b068d83bf755edee919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653db297f7174d809801b3687717832b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:37:28.618921 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-07d06b3d-c057-4aec-91de-f67e0416aaba tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] 10.222.0.11 "GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9" status: 200 len: 1562 microversion: 2.1 time: 0.161882 May 03 09:37:28.619504 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1568/2960] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:37:28 2022] GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9 => generated 1562 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:37:30.887176 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-e3a323bb-d8c2-494c-97a0-3f9b6f2ca218 req-50c6bf3f-5f37-49d0-8f85-8c2d67f0bf70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edefc60b-ae3d-40e2-9166-4435f10562b9", "name": "network-vif-plugged", "status": "completed", "tag": "1f01b223-8985-4f4c-8e77-fd8545751d34"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:37:30.896379 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-e3a323bb-d8c2-494c-97a0-3f9b6f2ca218 req-50c6bf3f-5f37-49d0-8f85-8c2d67f0bf70 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:37:30.896829 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-e3a323bb-d8c2-494c-97a0-3f9b6f2ca218 req-50c6bf3f-5f37-49d0-8f85-8c2d67f0bf70 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:37:30.910019 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-e3a323bb-d8c2-494c-97a0-3f9b6f2ca218 req-50c6bf3f-5f37-49d0-8f85-8c2d67f0bf70 service nova] Creating event network-vif-plugged:1f01b223-8985-4f4c-8e77-fd8545751d34 for instance edefc60b-ae3d-40e2-9166-4435f10562b9 on hv-cinder-84027 May 03 09:37:30.915481 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-e3a323bb-d8c2-494c-97a0-3f9b6f2ca218 req-50c6bf3f-5f37-49d0-8f85-8c2d67f0bf70 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032148 May 03 09:37:30.916378 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1393/2961] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:37:35.562820 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 09:37:35.563374 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: Tue May 3 09:37:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 03 09:38:27.216895 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 09:38:27.217523 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: Tue May 3 09:38:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 03 09:38:45.003194 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-4caa2e51-6548-4bac-b815-23b05ed68c37 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:38:45.003825 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-4caa2e51-6548-4bac-b815-23b05ed68c37 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] [instance: edefc60b-ae3d-40e2-9166-4435f10562b9] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:38:45.011037 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4caa2e51-6548-4bac-b815-23b05ed68c37 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:38:45.011494 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4caa2e51-6548-4bac-b815-23b05ed68c37 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:38:45.012318 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4caa2e51-6548-4bac-b815-23b05ed68c37 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:38:45.012725 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-4caa2e51-6548-4bac-b815-23b05ed68c37 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:38:45.039174 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-4caa2e51-6548-4bac-b815-23b05ed68c37 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] [instance: edefc60b-ae3d-40e2-9166-4435f10562b9] Going to try to terminate instance {{(pid=123391) delete /opt/stack/nova/nova/compute/api.py:2664}} May 03 09:38:45.085067 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-7e613d36-7ae3-4779-b8a8-b9bebc8ab0a2 req-41c170bc-04c8-4c54-a4bf-cdb5ab39df51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edefc60b-ae3d-40e2-9166-4435f10562b9", "tag": "1f01b223-8985-4f4c-8e77-fd8545751d34"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:38:45.094835 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-7e613d36-7ae3-4779-b8a8-b9bebc8ab0a2 req-41c170bc-04c8-4c54-a4bf-cdb5ab39df51 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:38:45.095539 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-7e613d36-7ae3-4779-b8a8-b9bebc8ab0a2 req-41c170bc-04c8-4c54-a4bf-cdb5ab39df51 service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:38:45.107589 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-7e613d36-7ae3-4779-b8a8-b9bebc8ab0a2 req-41c170bc-04c8-4c54-a4bf-cdb5ab39df51 service nova] Creating event network-changed:1f01b223-8985-4f4c-8e77-fd8545751d34 for instance edefc60b-ae3d-40e2-9166-4435f10562b9 on hv-cinder-84027 May 03 09:38:45.113326 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-7e613d36-7ae3-4779-b8a8-b9bebc8ab0a2 req-41c170bc-04c8-4c54-a4bf-cdb5ab39df51 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112051 May 03 09:38:45.114278 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1394/2962] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:38:45.132707 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-4caa2e51-6548-4bac-b815-23b05ed68c37 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] 10.222.0.11 "DELETE /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9" status: 204 len: 0 microversion: 2.1 time: 0.133577 May 03 09:38:45.135847 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1569/2963] 10.222.0.11 () {58 vars in 1238 bytes} [Tue May 3 09:38:44 2022] DELETE /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 03 09:38:45.143160 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9b524cff-1163-45a6-992b-e243c625d21f tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:38:45.143892 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9b524cff-1163-45a6-992b-e243c625d21f tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] [instance: edefc60b-ae3d-40e2-9166-4435f10562b9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:38:45.150224 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9b524cff-1163-45a6-992b-e243c625d21f tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:38:45.150697 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9b524cff-1163-45a6-992b-e243c625d21f tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:38:45.151469 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9b524cff-1163-45a6-992b-e243c625d21f tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:38:45.151937 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9b524cff-1163-45a6-992b-e243c625d21f tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:38:45.290190 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9b524cff-1163-45a6-992b-e243c625d21f tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f78486cf7a74b068d83bf755edee919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653db297f7174d809801b3687717832b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:38:45.298685 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9b524cff-1163-45a6-992b-e243c625d21f tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] 10.222.0.11 "GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9" status: 200 len: 1568 microversion: 2.1 time: 0.160088 May 03 09:38:45.299265 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1395/2964] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:38:45 2022] GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 09:38:46.318981 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-22497124-9c77-4331-bd0d-f9009ea0ab23 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:38:46.320283 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-22497124-9c77-4331-bd0d-f9009ea0ab23 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] [instance: edefc60b-ae3d-40e2-9166-4435f10562b9] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:38:46.327325 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-22497124-9c77-4331-bd0d-f9009ea0ab23 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:38:46.327794 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-22497124-9c77-4331-bd0d-f9009ea0ab23 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:38:46.328563 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-22497124-9c77-4331-bd0d-f9009ea0ab23 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:38:46.329046 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-22497124-9c77-4331-bd0d-f9009ea0ab23 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:38:46.529544 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-22497124-9c77-4331-bd0d-f9009ea0ab23 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f78486cf7a74b068d83bf755edee919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653db297f7174d809801b3687717832b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:38:46.539119 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-22497124-9c77-4331-bd0d-f9009ea0ab23 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] 10.222.0.11 "GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9" status: 200 len: 1568 microversion: 2.1 time: 0.226123 May 03 09:38:46.539859 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1570/2965] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:38:46 2022] GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9 => generated 1568 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:38:47.251501 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-e759ab35-d34f-4e10-9238-dc03cc3cdd06 req-cdf1a390-15fd-41fb-bae8-b055097e4b3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edefc60b-ae3d-40e2-9166-4435f10562b9", "name": "network-vif-deleted", "tag": "1f01b223-8985-4f4c-8e77-fd8545751d34"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 09:38:47.262804 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-e759ab35-d34f-4e10-9238-dc03cc3cdd06 req-cdf1a390-15fd-41fb-bae8-b055097e4b3f service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:38:47.263280 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-e759ab35-d34f-4e10-9238-dc03cc3cdd06 req-cdf1a390-15fd-41fb-bae8-b055097e4b3f service nova] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:38:47.277336 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-e759ab35-d34f-4e10-9238-dc03cc3cdd06 req-cdf1a390-15fd-41fb-bae8-b055097e4b3f service nova] Creating event network-vif-deleted:1f01b223-8985-4f4c-8e77-fd8545751d34 for instance edefc60b-ae3d-40e2-9166-4435f10562b9 on hv-cinder-84027 May 03 09:38:47.282266 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-e759ab35-d34f-4e10-9238-dc03cc3cdd06 req-cdf1a390-15fd-41fb-bae8-b055097e4b3f service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034754 May 03 09:38:47.282859 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1396/2966] 10.222.0.11 () {64 vars in 1317 bytes} [Tue May 3 09:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 09:38:47.558381 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-3dec6043-f05e-4caf-8f24-817248cd8b84 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Calling method '>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:38:47.559075 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.compute.api [None req-3dec6043-f05e-4caf-8f24-817248cd8b84 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] [instance: edefc60b-ae3d-40e2-9166-4435f10562b9] Fetching instance by UUID {{(pid=123391) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:38:47.565408 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3dec6043-f05e-4caf-8f24-817248cd8b84 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:38:47.565824 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3dec6043-f05e-4caf-8f24-817248cd8b84 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:38:47.566607 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3dec6043-f05e-4caf-8f24-817248cd8b84 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:38:47.567025 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG oslo_concurrency.lockutils [None req-3dec6043-f05e-4caf-8f24-817248cd8b84 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:38:47.639049 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.policy [None req-3dec6043-f05e-4caf-8f24-817248cd8b84 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f78486cf7a74b068d83bf755edee919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653db297f7174d809801b3687717832b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123391) authorize /opt/stack/nova/nova/policy.py:199}} May 03 09:38:47.647209 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-3dec6043-f05e-4caf-8f24-817248cd8b84 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] 10.222.0.11 "GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9" status: 200 len: 1219 microversion: 2.1 time: 0.093241 May 03 09:38:47.647972 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1571/2967] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:38:47 2022] GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 09:38:48.669432 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d050b475-d228-4ce9-b36f-523cee40a7b7 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:38:48.670585 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d050b475-d228-4ce9-b36f-523cee40a7b7 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] [instance: edefc60b-ae3d-40e2-9166-4435f10562b9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2918}} May 03 09:38:48.678109 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d050b475-d228-4ce9-b36f-523cee40a7b7 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:38:48.678558 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d050b475-d228-4ce9-b36f-523cee40a7b7 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:38:48.679325 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d050b475-d228-4ce9-b36f-523cee40a7b7 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 03 09:38:48.679758 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d050b475-d228-4ce9-b36f-523cee40a7b7 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Lock "704ac130-5e75-4d30-aa38-214e2e8ddc38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 03 09:38:48.693045 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-d050b475-d228-4ce9-b36f-523cee40a7b7 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] HTTP exception thrown: Instance edefc60b-ae3d-40e2-9166-4435f10562b9 could not be found. May 03 09:38:48.693624 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d050b475-d228-4ce9-b36f-523cee40a7b7 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Returning 404 to user: Instance edefc60b-ae3d-40e2-9166-4435f10562b9 could not be found. {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 03 09:38:48.694723 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d050b475-d228-4ce9-b36f-523cee40a7b7 tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] 10.222.0.11 "GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9" status: 404 len: 111 microversion: 2.1 time: 0.032935 May 03 09:38:48.695267 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1397/2968] 10.222.0.11 () {58 vars in 1235 bytes} [Tue May 3 09:38:48 2022] GET /compute/v2.1/servers/edefc60b-ae3d-40e2-9166-4435f10562b9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 09:38:48.860760 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: DEBUG nova.api.openstack.wsgi [None req-ccda8331-728d-498d-8c38-a024d4a0915c tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] Calling method '.version_select at 0x7f09ce6eb040>' {{(pid=123391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 09:38:48.883513 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO nova.api.openstack.requestlog [None req-ccda8331-728d-498d-8c38-a024d4a0915c tempest-TestShelveInstance-206930502 tempest-TestShelveInstance-206930502-project] 10.222.0.11 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-678972420" status: 202 len: 0 microversion: 2.1 time: 0.026777 May 03 09:38:48.884133 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: [pid: 123391|app: 0|req: 1572/2969] 10.222.0.11 () {58 vars in 1250 bytes} [Tue May 3 09:38:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-678972420 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 09:40:18.476222 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 09:40:18.477280 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: Tue May 3 09:40:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 03 09:40:23.657225 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 09:40:23.657837 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: Tue May 3 09:40:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 03 09:40:35.875541 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 09:40:35.876260 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: Tue May 3 09:40:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 03 09:41:47.226231 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 09:41:47.226732 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: Tue May 3 09:41:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 03 09:43:38.488263 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 09:43:38.489024 dv-cinder-840276-2-iscsi devstack@n-api.service[123391]: Tue May 3 09:43:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 03 09:43:43.667971 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 09:43:43.668579 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: Tue May 3 09:43:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 03 09:43:55.884838 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 09:43:55.885521 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: Tue May 3 09:43:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 03 09:44:02.622922 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 09:44:02.623499 dv-cinder-840276-2-iscsi devstack@n-api.service[123392]: Tue May 3 09:44:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!